Senior Data Engineer

Role Summary

We are seeking an experienced Senior Azure Data Engineer to design and implement robust data solutions on Azure. The role involves building scalable ETL/ELT pipelines, working with big-data processing frameworks, and collaborating with architects to deliver cloud-based data warehouse solutions. The ideal candidate will have strong hands-on expertise in Azure data services and modern data engineering practices.

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using Azure Data Factory and Azure Synapse Pipelines
• Implement error handling mechanisms and optimize pipeline performance by identifying and resolving bottlenecks
• Work with Azure Databricks (PySpark), Azure Data Lake Storage (ADLS Gen 2), Azure Synapse, and Microsoft Fabric
• Collaborate with architects to design and implement Cloud Data Warehouse solutions
• Develop reporting framework layers for Power BI and Tableau
• Apply big-data processing approaches and schema-on-read methodologies
• Write efficient code in Python (PySpark) and SQL for data transformation and processing

Required Skills

• 6-10 years of hands-on experience with Azure data services
• Strong expertise in Azure Data Factory, Azure Databricks (PySpark), ADLS Gen 2, Azure Synapse, and Microsoft Fabric
• Proficiency in Python (PySpark) and SQL
• Experience designing and implementing ETL/ELT pipelines with error handling and performance tuning
• Knowledge of Cloud Data Warehouse design and implementation
• Understanding of big-data processing and schema-on-read methodologies
• Experience designing reporting frameworks for BI tools

Good-to-have Skills

• Power BI DAX development experience
• Exposure to Tableau
• Performance optimization and troubleshooting skills

Additional Information

• Shift Timings: 11:00 AM to 8:00 PM IST (Candidate must be flexible for 4-hour overlap with US hours)
• Work Mode: Hybrid 2-3 days per week from Pune office
• Project Duration: 6 months (Contract to Hire)
• Immediate to 5 weeks notice period preferred

#AzureDataEngineer #DataEngineering #AzureDataFactory #AzureDatabricks #PySpark #AzureSynapse #MicrosoftFabric #CloudDataWarehouse #ETLPipelines #BigData #PowerBI #Pune #HybridJob #C2H #DataEngineeringJobs #HiringNow