Senior Data Engineer

Location : Bangalore,Chennai, Gurgaon ,Pune,Noida,Bohopal

Job Summary:

We are looking for an experienced Azure Data Engineer with 5 to 8 years of hands-on experience in designing, developing, and implementing end-to-end data solutions on Microsoft Azure. The ideal candidate will have a strong background in data integration, data warehousing, data modeling, and building scalable data pipelines using Azure services.

Key Responsibilities:

• Design and develop scalable and secure data pipelines using Azure Data Factory, Azure Synapse Analytics, and Databricks.
• Implement ETL/ELT processes to ingest data from various structured and unstructured sources.
• Build and maintain data lakes and data warehouses on Azure (e.g., Azure Data Lake Storage Gen2, Synapse).
• Work closely with data analysts, scientists, and business stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize and monitor data pipelines for performance, reliability, and cost-efficiency.
• Apply data governance, security, and compliance standards, including role-based access controls and encryption.
• Perform data modeling (dimensional and relational) and develop data dictionaries and documentation.
• Integrate with external tools such as Power BI, Azure DevOps, or third-party APIs as needed.
• Ensure CI/CD practices in data development and deployment workflows.
• Must have experience in Event hub, Realtime data Streaming (using kafka).

Required Skills & Experience:

• 8+ years of experience in data engineering or BI development, with a focus on Azure Data Services.
• Strong experience with:
• Azure Data Factory (ADF)
• Azure Synapse Analytics
• Azure SQL Database / SQL Server / SQL DW
• Azure Data Lake Storage (ADLS Gen2)
• Azure Databricks / Apache Spark
• Proficiency in writing complex SQL queries and performance tuning.
• Experience with Python, PySpark, or Scala for data transformation and orchestration.
• Experience with CI/CD tools (Azure DevOps, GitHub Actions, etc.) and automated deployment strategies.
• Knowledge of data security and compliance standards (GDPR, HIPAA, etc.).
• Familiarity with Power BI or other visualization tools is a plus.

Preferred Qualifications:

• Microsoft Azure certification(s) such as:
• DP-203: Azure Data Engineer Associate
• AZ-900 / DP-900 (Foundational)
• Experience with Agile/Scrum methodology.
• Knowledge of Data Governance, Master Data Management (MDM), and Data Quality frameworks.
• Familiarity with real-time data processing (Event Hubs, Stream Analytics) is a plus.

Soft Skills:

• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to work independently and in a cross-functional team environment.
• Eagerness to learn and adapt to new technologies.