Senior Data Engineer

Job Title: Sr. Data Engineer

Experience: 56 Years

Location: Hyderabad

About the Role

We are looking for an experienced Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions on the Azure Data Platform . The ideal candidate will have strong hands-on experience with modern Azure data services and a solid foundation in SQL, Python, and Spark.

Key Responsibilities

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF) .
• Build and optimize data models and analytical datasets using Azure Synapse Analytics and Microsoft Fabric .
• Develop scalable data processing solutions using Databricks and Apache Spark .
• Ensure data quality, reliability, performance, and security across data platforms.
• Collaborate with analytics, BI, and business teams to understand data requirements and deliver insights.
• Optimize SQL queries and improve performance of large-scale datasets.
• Implement best practices for data engineering, monitoring, and documentation.
• Support production deployments and troubleshoot data pipeline issues.

Required Skills & Experience

• 56 years of hands-on experience as a Data Engineer or in a similar role.
• Strong experience with Azure Data Platform , including:

• Azure Synapse Analytics
• Azure Fabric
• Azure Data Factory (ADF)
• Azure Databricks

• Strong proficiency in SQL for data modeling and query optimization.
• Hands-on experience with Python for data processing and automation.
• Solid understanding of Apache Spark and distributed data processing.
• Experience working with large datasets and performance tuning.
• Understanding of data warehousing concepts and ETL/ELT processes.

Nice to Have

• Experience with CI/CD for data pipelines.
• Knowledge of data governance, security, and compliance on Azure.
• Exposure to Power BI or other reporting/analytics tools.
• Azure certifications related to data engineering.
• Experience working in other Public clouds like AWS & GCP.
• Understanding of Cloud Infrastructure & Networking.