Sr/Lead Data Engineer- Azure

Job Title:Senior / Lead Azure Data Engineer

Employment Type: Full Time, Permanent

Position Location: Hyderabad

Reports to: Software Development Manager (IT Solutions Delivery)

Qualifications: BE/B.Tech/MCA Degree in Computer Science, Engineering, or similar relevant field

Total Experience: 7 - 12 Years

Working Model: Work From Office/Hybrid

About the Role:

We are looking for aSenior / Lead Azure Data Engineerto design, build, and maintain scalable data pipelines and platforms on Microsoft Azure. This role will work closely with data engineering, analytics, and platform teams to deliver reliable, secure, and high-quality data solutions for enterprise use cases.

Key Responsibilities

Strong experience in migrating data workloads from Azure Synapse Analytics to Databricks.

Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL.

Build and optimize data solutions using Azure SQL, SQL Server, and other Azure data services.

Develop and manage ETL/ELT workflows for structured and semi-structured data processing.

Implement CI/CD pipelines for data engineering workloads using Azure DevOps or similar tools.

Perform data modelling to support analytics, reporting, and downstream data consumption.

Ensure data quality, performance, scalability, and reliability across data pipelines.

Collaborate with architects, analysts, and application teams to deliver enterprise data solutions.

Support deployment, monitoring, troubleshooting, and production support activities.

Follow enterprise security, governance, and compliance standards.

Required Skills

Strong hands-on experience with Databricks, including notebooks, workflows, clusters, and optimization.

Proven experience in migrating data platforms from Azure Synapse to Databricks.

Strong expertise in Python and PySpark for large-scale data processing and transformation.

Solid experience with SQL and relational databases (Azure SQL / SQL Server).

Good understanding of Azure Synapse and modern data platform migration approaches.

Experience working in Microsoft Azure cloud environments.

Hands-on experience with CI/CD pipelines using Azure DevOps.

Strong understanding of data modelling concepts (dimensional and relational).

Experience with version control tools like Git and Agile delivery practices.

Strong problem-solving skills and ability to work with cross-functional teams and US-based teams.