Data Engineer

Role Overview:

Experience Above : 7 to 12 years

We are building an accelerator for migrating workloads from Azure Synapse and Azure Data Factory (ADF) to Microsoft Fabric. We are looking for a highly skilled Data Engineer with strong hands-on expertise in Microsoft Fabric, Synapse, ADF, and Databricks to drive design, development, and implementation of scalable migration solutions.

Key Responsibilities:

Design and develop migration frameworks/accelerators for moving data workloads from Azure Synapse and ADF to Microsoft Fabric.

Analyze existing architectures and define optimal migration strategies, including data pipelines, transformations, and storage layers.

Build and optimize data ingestion, transformation, and orchestration pipelines using Fabric, ADF, and Databricks.

Develop reusable components, templates, and best practices for large-scale migrations.

Collaborate with cross-functional teams (architecture, presales, delivery) to define solution approaches and estimates.

Ensure performance optimization, cost efficiency, and scalability of migrated solutions.

Implement data governance, security, and monitoring frameworks within Fabric.

Provide technical leadership, mentorship, and code reviews for engineering teams.

Required Skills & Experience:

Core Technologies:

Strong hands-on experience with Microsoft Fabric (Lakehouse, Data Factory, Pipelines, Notebooks).

Deep expertise in Azure Synapse Analytics (SQL pools, Spark pools, pipelines).

Proven experience with Azure Data Factory (ADF) for orchestration and ETL/ELT pipelines.

Strong working knowledge of Databricks (Delta Lake, notebooks, job orchestration).

Programming & Data Skills:

Proficiency in PySpark and Python for data transformations.

Advanced SQL skills with strong problem-solving ability.

Experience with data modeling (star/snowflake schemas, medallion architecture).

Data Engineering & Architecture:

Strong understanding of data engineering principles, distributed data processing, and big data frameworks.