Data Engineer Associate

Your Team Responsibilities

We are hiring an Associate Data Engineer to support our core data pipeline development efforts and gain hands-on experience with industry-grade tools like PySpark, Databricks, and cloud-based data warehouses. The ideal candidate is curious, detail-oriented, and eager to learn from senior engineers while contributing to the development and operationalization of critical data workflows.

Your Key Responsibilities

• Assist in the development and maintenance of ETL/ELT pipelines using PySpark and Databricks under senior guidance.

• Support data ingestion, validation, and transformation tasks across Rating Modernization and Regulatory programs.

• Collaborate with team members to gather requirements and document technical solutions.

• Perform unit testing, data quality checks, and process monitoring activities.

• Contribute to the creation of stored procedures, functions, and views.

• Support troubleshooting of pipeline errors and validation issues.

Your skills and experience that will help you excel

• Bachelor’s degree in Computer Science, Engineering, or related discipline.

• 3+ years of experience in data engineering or internships in data/analytics teams.

• Working knowledge of Python, SQL, and ideally PySpark.

• Understanding of cloud data platforms (Databricks, BigQuery, Azure/GCP).

• Strong problem-solving skills and eagerness to learn distributed data processing.

• Good verbal and written communication skills.