Data Engineer | 4 to 8 Years | 15 to 22 LPA | One of the Leading Big4

Job Title: Data Engineer

Experience: 4 to 8 Years

Budget: 15 to 22 LPA

Location: Mumbai

Type: Full-Time

About the Role

We are looking for a skilled Data Engineer who can design, build, and optimize scalable data pipelines. The ideal candidate should have strong expertise in Python, PySpark, and SQL , along with working knowledge of Databricks and cloud platforms like AWS or Azure .

Key Responsibilities

• Develop and maintain scalable ETL/ELT pipelines using Python, PySpark, and SQL.
• Work on batch and streaming data workflows , ensuring reliability and performance.
• Build and optimize data models, data ingestion frameworks, and transformation processes.
• Collaborate with Data Scientists, Analysts, and Product teams to understand data needs.
• Perform data validation, quality checks , and ensure high data accuracy and integrity.
• Use Databricks for data processing, job orchestration, and notebook-based development.
• Deploy and monitor data pipelines on AWS or Azure cloud services.
• Implement best practices in data governance, security, and performance tuning.
• Troubleshoot pipeline failures and ensure timely resolution of data issues.
• Support migration of legacy data pipelines to modern cloud-based architecture.

Required Skills

• Strong programming skills in Python .
• Hands-on experience with PySpark for large-scale data processing.
• Excellent command over SQL (writing complex queries, performance optimization).
• Good understanding of Databricks (notebooks, jobs, Delta tables preferred).
• Working knowledge of AWS (Glue, S3, Lambda, EMR) or Azure (ADF, Data Lake, Synapse) .
• Knowledge of CI/CD , version control (Git), and job orchestration tools.