Sr. Data Engineer

Were looking foraData Engineerto design, build, and scale modern data platforms onAWS. Youll work withPython, Spark, DBT, and AWS-native servicesin an Agile environment to deliver scalable, secure, and high-performance data solutions.

What youll do

• Develop and optimizeETL/ELT pipelineswith Python, DBT, and AWS services (Data Ops Live).
• Build and manageS3-based data lakesusing modern data formats (Parquet, ORC, Iceberg).
• Deliver end-to-end data solutions withGlue, EMR, Lambda, Redshift, and Athena.
• Implement strongmetadata, governance, and securityusing Glue Data Catalog, Lake Formation, IAM, and KMS.
• Orchestrate workflows withAirflow, Step Functions, or AWS-native tools.
• Ensurereliability and automationwith CloudWatch, CloudTrail, CodePipeline, and Terraform.
• Collaborate with analysts and data scientists to deliverbusiness insightsin an Agile setting.

Required Skills & Experience

• 47 years of experience indata engineering, with 3+ years on AWS platforms
• Strong inPython (incl. AWS SDKs), DBT, SQL, and Spark
• Proven expertise withAWS data stack(S3, Glue, EMR, Redshift, Athena, Lambda)
• Hands-on experience withworkflow orchestration(Airflow/Step Functions)
• Familiarity withdata lake formats(Parquet, ORC, Iceberg) andDevOps practices(Terraform, CI/CD)
• Solid understanding ofdata governance & securitybest practices

Bonus

• Exposure to Data Mesh principles and platforms like Data.World
• Familiarity withHadoop/HDFS in hybrid or legacy environments

Kindly Note this is Hybrid Work Arrangement with 3 Days a week in office ( Bangalore / HSR Layout) .