Senior Data Engineer

Role Overview

We are looking for a skilled Data Engineer with strong communication abilities and hands-on experience in modern data engineering tools and technologies. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, transforming raw data into reliable business insights, and collaborating with cross-functional stakeholders to deliver data-driven solutions.

Key Responsibilities

Understand business requirements clearly and coordinate with internal teams and stakeholders for successful project delivery.

Build, maintain, and optimize scalable data pipelines using Databricks and PySpark.

Develop robust data processing solutions for handling large and complex datasets.

Write efficient SQL queries for data extraction, transformation, validation, and reporting.

Design and implement ETL workflows using Python and PySpark.

Perform joins, aggregations, filtering, and data cleansing to ensure high-quality data outputs.

Monitor and troubleshoot pipeline performance issues to improve efficiency and reliability.

Ensure data accuracy, consistency, and governance standards across systems.

Work closely with analysts, developers, and business teams to support data needs.

Required Skills

Strong communication and stakeholder management skills.

Hands-on experience with Databricks.

Strong proficiency in PySpark.

Advanced SQL skills for large-scale data processing.

Experience in Python-based ETL development.

Good understanding of data modeling and data warehousing concepts.

Experience in optimizing queries and workflows for performance.

Preferred Qualifications

Experience working with cloud platforms such as Azure or AWS.

Familiarity with version control tools like Git.

Knowledge of scheduling/orchestration tools such as Airflow or Azure Data Factory.

Understanding of CI/CD practices in data engineering.

Experience

2 - 7 years of relevant experience in Data Engineering.

Location

Pune

Immediate joiners Preferred

Please share your CVs at shailendra.sharma@celebaltech.com