Data Engineer consultant

Position: Data Engineer

Work Location: Chennai

Job Type: Contract

Relevant years of Experience: 7+ years

Salary Range: Max 10$ / Hour

We are looking for a highly skilled Data Engineer with strong hands-on experience in Spark / PySpark, SQL, AWS and Python. The ideal candidate will have experience working in modern data platforms, cloud environments, and scalable data processing frameworks.

Required Skills (Must Have)

AWS, Spark or PySpark Strong hands-on experience

SQL Advanced proficiency

Python Strong development skills

Good to Have

Databricks Working experience preferred

Cloud Services: Azure / AWS / GCP

Hadoop, Hive, Sqoop Optional but beneficial

Azure / AWS / GCP Certification High priority

Databricks Certification High priority

Key Responsibilities

Develop and optimize large-scale data pipelines using Spark/PySpark

Build, automate, and maintain ETL/ELT workflows

Write efficient, scalable SQL for data extraction and transformation

Work with Python to build data processing logic and reusable components

Collaborate with cloud platforms (Azure/AWS/GCP) for data engineering tasks

Work with Databricks for data pipeline development (if applicable)

Perform data validation, data quality checks, and troubleshooting

Optimize performance of distributed data processing systems

Partner with cross-functional teamsanalytics, product, and engineering

Support production deployments, monitoring, and incident resolution

Ensure best practices in performance tuning, code quality, and documentation