Data Engineer

We are seeking a Data Engineer to design and deliver a pipeline to integrate Python, SQL, object storage and the analytical warehouse to demonstrate end-to-end ingestion, transformation and analytics. The engineer will own the pipeline design, develop transformation models and tests, optimize performance and produce the architecture and operational runbook documentation. The role collaborates with platform engineers to integrate into the broader orchestration and CI/CD framework.

Roles & Responsibilities

• Design and implement ETL/ ELT pipelines using Python scripts and SQL transformations.
• Ingest data from object storage (S3) into the analytical warehouse (Redshift) and validate outputs against defined acceptance criteria.
• Develop transformation models and tests; optimize for performance and operational reliability.
• Document architecture, code and operational runbooks; support User Acceptance Testing (UAT).
• Collaborate with platform engineers for integration into orchestration and CI/CD pipelines.
• Troubleshoot pipeline issues across dev, pre-prod and production environments.
• Contribute to PoC learnings, recommendations and platform productization roadmap.

Mandatory Skills

ETL/ ELT, Python, Redshift, AWS S3, AWS SDK, SQL, Data Pipeline