Azure Data Engineer

About the Role:

Job role: Hybrid

Location: Kathmandu, Nepal

We are seeking a Senior Data Engineer to architect our Azure-based data ecosystem. You will transform Dynamics 365 and API data into high-performance pipelines for our Power BI and AI teams, bridging traditional data warehousing with modern Data Lakehouse architecture.

Key Responsibilities:

1. Data Architecture & Pipeline Engineering

Design & Build: Architect robust, scalable, and automated ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Synapse Analytics.

Dynamics 365 Integration: Lead the extraction and transformation of complex data from Dynamics 365 F&O, Business Central, and CE (Dataverse) using Synapse Link and Power Platform connectors.

Lakehouse Implementation: Implement a Medallion Architecture (Bronze/Silver/Gold) using Azure Data Lake Storage (ADLS Gen2) and Delta Lake to ensure data reliability.

Advanced Processing: Use Azure Synapse Spark or Azure Databricks (PySpark) for complex data transformations, feature engineering, and real-time streaming (Event Hubs/IoT Hub)

2. Analytics & BI Support

Data Modeling: Design and optimize Star and Snowflake schemas to support high-performance Power BI semantic models

Serving Layer Design: Deliver curated datasets using Delta Lake and Azure SQL / Synapse SQL to meet enterprise reporting and concurrency requirements

Performance Optimization: Perform advanced SQL tuning, indexing, and workload optimization to ensure scalability and cost efficiency across Azure analytics services

3. Data Governance & DevOps

CI/CD & DataOps: Implement and maintain DataOps practices using Azure DevOps, with infrastructure-as-code via Terraform or Bicep

Data Quality & Governance: Enforce data standards, validation, lineage, and master data management practices

Security & Compliance: Apply RBAC, managed identities, and access controls to ensure data privacy and regulatory compliance

Skills & Qualifications:

Core Technical Requirements:

1. Experience: 5+ years of Data Engineering experience, with 3+ years focused on the Microsoft Azure ecosystem
2. SQL Expertise: Advanced T-SQL, including performance tuning, indexing strategies, and complex query optimization.
3. Python & Spark: Strong proficiency in Python and PySpark for data transformation and automation
4. Azure Platform Expertise: Hands-on experience with:
5. Azure Data Factory (ADF)
6. Azure Synapse Analytics (SQL & Spark)
7. Azure Data Lake Storage Gen2 (ADLS)
8. Azure SQL Database and Managed Instances
9. Azure Functions and Logic Apps
10. Enterprise Data: Experience working with Dynamics 365 or other large-scale ERP/CRM platforms