Job description

Position: Lead Data Engineer

Location: Goregaon, Mumbai

Experience: 8+ years

Degree: Bachelors degree or a related field.

About the job

Designing, building, and maintaining data pipelines using cloud technologies to

ensure efficient data flow and quality for analysis by data scientists and business

users.

Key Responsibilities.

Data ingestion and extraction: Utilize Airbyte to establish connections to

various data sources, configure data extraction pipelines, and manage data

replication schedules.

Data transformation with dbt: Write dbt models to clean, transform, and

aggregate data according to business requirements, leveraging dbt's declarative

syntax for maintainable data pipelines.

Snowflake data modeling: Design and implement data models in Snowflake,

optimizing for performance and query efficiency, including dimensional

modeling techniques.

Pipeline monitoring and maintenance: Monitor data pipelines for errors,

troubleshoot issues, and implement alerts to ensure data quality and reliability.

Data quality checks: Implement data validation processes to identify and

address data inconsistencies or errors before loading into Snowflake.

Collaboration with stakeholders: Work closely with data analysts, data

scientists, and business teams to understand data needs, define data

requirements, and deliver actionable insights.

Required skills:

Knowledge of ETL/ELT processes, data modelling, data quality best

practices, and change data capture (CDC).

SQL - Strong SQL skills to query, manipulate, and transform data

Airbyte - Understanding of Airbyte connectors, configuration, and data

synchronization capabilities.

dbt - Familiarity with dbt syntax, development workflow, and best practices

for data transformation.

Snowflake - Understanding of Snowflake architecture, data warehousing

concepts, and performance optimization techniques.

Cloud computing skills - Familiarity with cloud platforms like AWS, Azure.

Data Engineer