Greetings for the Day!!!

We are looking for a Data Engineer for one of our esteemed clients in Hyderabad/Bangalore having experience into Python,Pyspark/Spark,SQL

Exp: - 6+ years

Location: Hyderabad/Bangalore

Shifts : - General shifts

Job Description:-

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Python and Apache Spark for large-scale data processing.
Build and optimize ETL/ELT workflows to ingest, transform, and load data from multiple structured and unstructured sources.
Work with distributed data processing frameworks like Spark (PySpark/Scala) to handle big data efficiently.
Develop data solutions on cloud platforms such as AWS / Azure / GCP using services like S3, Glue, Databricks, or BigQuery.
Implement data modeling techniques and optimize data storage using data lakes and data warehouses.
Ensure data quality, integrity, and governance through validation, monitoring, and automated checks.
Collaborate with data scientists, analysts, and business teams to deliver reliable datasets and insights.
Optimize performance of Spark jobs through partitioning, caching, and tuning techniques.
Use orchestration tools like Airflow or similar for workflow scheduling and monitoring.
Work with SQL/NoSQL databases such as PostgreSQL, MySQL, MongoDB, or Hive.
Implement CI/CD pipelines and follow best practices for version control using Git.
Troubleshoot production issues and ensure high availability and performance of data systems.

*We are looking for candidates who can join us within 15 days*

Data Engineer