Microsoft Fabric Engineer

Microsoft Fabric Engineer

We are seeking a Senior Data Engineer with strong Microsoft Fabric expertise and handson PySpark skills to lead the migration of analytics and data engineering workloads into the Fabric ecosystem. You will assess current-state platforms, design future-state architecture on Fabric (Lakehouse, Warehouse, Data Factory, Real-Time Analytics, Power BI integration), and drive endtoend migration, performance tuning, and operational readiness.

Key Responsibilities

Own endtoend migration of data pipelines, models, and analytical workloads into Microsoft Fabric.

Assess existing estates (e.g., ADF, Synapse, Databricks, Snowflake, onprem) and define migration strategy, roadmap, and cutover plans.

Design and implement Fabric Lakehouse architectures (Delta/Medallion), Warehouses, and Data Engineering pipelines using Data Factory, Dataflows Gen2, and Notebooks.

Build and optimize PySpark/SQL code for ingestion, transformation, and enrichment on Fabric Spark.

Establish CI/CD and DevOps practices for Fabric (Git integration, environments, deployment pipelines).

Implement data governance, security, and compliance (workspaces, capacities, permissions, Purview lineage where applicable).

Set up monitoring, observability, and cost/capacity management; tune pipelines and queries for performance and reliability.

Partner with BI teams on Power BI datasets/models and ensure performant endtoend analytics.

Lead testing and validation (schema mapping, data quality checks, reconciliation), and coordinate cutover and hypercare.

Document architecture, patterns, and runbooks; enable and mentor engineering and analytics teams on Fabric best practices.

Engage stakeholders, manage risks, and communicate progress to technical and business audiences.

Required Qualifications

6+ years in data engineering/analytics with a strong track record migrating workloads to modern cloud platforms.

12+ years working with Microsoft Fabric components or equivalent experience in Synapse/Databricks plus proven Fabric adoption.

Strong PySpark development skills for ETL/ELT, optimization, and troubleshooting.

Advanced SQL (TSQL/ANSI SQL), delta/partitioning strategies, and Lakehouse/Medallion architecture.

Handson with Fabric features: Lakehouse, Warehouse, Data Engineering (Notebooks/Spark), Data Factory, Dataflows Gen2, OneLake, and Git integration.

Solid understanding of Power BI integration with Fabric (datasets, Direct Lake, semantic models).

Experience with Azure ecosystem: ADLS/OneLake concepts, Entra ID (Azure AD), Key Vault, Event Hub/Eventstream (nice), networking/security basics.

CI/CD with Azure DevOps or GitHub; environment promotion and release management.

Strong stakeholder management, planning, and communication; ability to lead crossfunctional migration efforts.

Bachelors in Computer Science, Engineering, or related field (or equivalent experience).

Preferred/Good to Have

Microsoft Certified: Fabric Analytics Engineer Associate (DP600) and/or Azure Data Engineer Associate (DP203).

Prior migrations from Synapse/ADF/Databricks/Snowflake/onprem (SSIS/SQL Server) into Fabric.

DAX/Power BI modeling familiarity for endtoend solutioning.

IaC exposure (Bicep/Terraform) for Azure services where applicable; scripting in Python/PowerShell.

Experience with Agile/Scrum and working in productcentric teams.