Exp: 5+yrs

Location: India

Key Responsibilities

Design and implement data pipelines using S3 Medallion Architecture (Bronze, Silver, Gold layers)

Build and maintain scalable ETL/ELT workflows using AWS Lambda and Step Functions

Develop data ingestion frameworks to pull data from external APIs

Transform and load data into Amazon Redshift for analytics and reporting

Write efficient, reusable, and scalable code in Python

Ensure data quality, validation, and monitoring across pipelines

Optimize data storage and query performance in S3 and Redshift

Collaborate with data analysts, data scientists, and business stakeholders

Implement logging, alerting, and error-handling mechanisms

Maintain documentation for pipelines, data models, and workflows

Required Skills & Qualifications

Strong hands-on experience with AWS services:

S3 (data lake design)

Redshift

Lambda

Step Functions

Solid understanding of Medallion Architecture (Bronze/Silver/Gold layers)

Proficiency in Python for data engineering tasks

Experience with API integrations (REST/JSON, authentication, pagination handling)

Strong SQL skills and experience with data warehousing concepts

Familiarity with workflow orchestration and event-driven architectures

Understanding of data modeling and schema design

Preferred Qualifications

Experience with Glue / Athena / EMR (nice to have)

Knowledge of CI/CD pipelines for data workflows

Experience with data quality frameworks and monitoring tools

Exposure to streaming pipelines (Kafka/Kinesis) is a plus

Familiarity with infrastructure as code (Terraform/CloudFormation)

Data Engineer