Data Engineer

Job Title: Data Engineer

Job Type: Full-time

Location: Hyderabad, Chennai, Bangalore, and Noida

Work regime: Hybrid

Keywords: PySpark, AWS Glue, and ETL

Role Summary

We are seeking a skilled Cloud Data Engineer with strong expertise in PySpark, AWS Glue, and SAS, who will play a key role in building, modernizing, and supporting largescale data processing solutions. The role involves designing cloudnative ETL pipelines, migrating legacy SAS and Informatica workloads to AWS, and ensuring robust, scalable, and wellmonitored data platforms.

Key Responsibilities

• Design, develop, and optimize cloudnative ETL pipelines using PySpark and AWS Glue.
• Build and maintain scalable batch data processing solutions leveraging AWS services such as Glue, S3, IAM, and CloudWatch.
• Lead and support the migration of legacy SAS and Informatica ETL workflows to AWS Gluebased architectures.
• Develop and maintain PySparkbased transformations for largescale, highvolume datasets.
• Support and maintain existing Informatica mappings and complex workflows during the transition and migration phases.
• Provide ongoing support for SASbased extracts and reports, with a strong focus on modernization and cloud adoption.
• Write, optimize, and tune complex SQL queries for data validation, reconciliation, and performance improvement.
• Orchestrate and schedule endtoend data workflows using BMC ControlM, including dependency management and error handling.
• Implement monitoring, logging, alerting, and performance optimization for cloud data pipelines.
• Collaborate closely with crossfunctional teams to gather requirements, troubleshoot issues, and ensure data accuracy and quality.

Required Skills & Experience

• Strong handson experience with PySpark for distributed and largescale data processing.
• Proven experience developing, deploying, and maintaining AWS Glue jobs in production environments.
• Solid understanding of cloud data engineering concepts, distributed computing, and scalable data architectures.
• Working knowledge of Informatica, including developing and supporting mappings and workflows.
• Strong foundation in SAS (Data Step, Macros, Procs) to support legacy systems and migration efforts.
• Excellent SQL skills with experience handling large and complex datasets.
• Experience with BMC ControlM or other enterprisegrade scheduling and orchestration tools.
• Strong analytical, problemsolving, and troubleshooting skills, with the ability to work across legacy and modern data platforms.

Preferred Qualifications

• Experience modernizing or migrating onprem ETL platforms to AWS or other cloudbased solutions.
• Familiarity with CI/CD pipelines, version control, and Infrastructure as Code (IaC) in AWS.
• Experience working in Agile or Scrumbased data engineering teams.
• AWS certification or equivalent practical cloud engineering experience is a plus.