Senior Data Engineer

Job Title

Senior Data Engineer Microsoft Stack

Experience

712 years

Role Overview

We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions on Microsoft Fabric. The role requires strong programming skills, deep knowledge of Spark-based data processing, and hands-on experience optimizing enterprise data workflows.

Key Responsibilities

• Design and implement end-to-end data solutions on Microsoft Fabric
• Develop Apache Spark jobs using Microsoft Fabric Notebooks
• Build data transformations using Python, PySpark, SparkSQL, and T-SQL
• Develop and manage ETL/ELT pipelines and data integration workflows
• Work with File Transfer Services for secure data movement
• Leverage Microsoft Fabric components including Lakehouse, OneLake, Data Pipelines, Real-Time Analytics, Power BI integration, and Semantic Models
• Optimize data pipelines for performance, reliability, and scalability
• Experience with DevOps practices such as CI/CD for data pipelines and IaC
• Knowledge of data governance and enterprise data best practices

Mandatory Skills

• Strong expertise in Microsoft Azure and Microsoft Fabric data services
• Proficiency in Python and advanced SQL
• Hands-on experience with PySpark for distributed data processing
• Solid understanding of ETL/ELT frameworks and data pipeline orchestration