Senior Data Engineer

Senior Data Engineer

Job Summary

We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Fabric, PySpark, Azure Databricks, Synapse Analytics, and SQL . The role involves

designing, developing, and optimizing large-scale data pipelines, ensuring data quality and

performance, and enabling data-driven insights for business growth. The ideal candidate will have deep hands-on experience in Azure data services and modern data engineering practices.

Primary Skills

• Proven experience in MicrosoftFabric for data integration, orchestration, and analytics.
• Strong proficiency in PySpark for scalable data transformation and processing.
• Expertise in Azure Databricks and Spark SQL for advancedETL and data modeling.
• Strong hands-on knowledge of Azure Synapse Analytics for warehousing and analytical workloads.
• Proficiency in SQL and relational databases, with focus on performance tuning and query optimization.
• Solid understanding of ETL/ELT processes , Delta Lake ,and data lakehouse architectures .
• Knowledge of Azure Data Factory , Azure DevOps , and CI/CD pipelinesfor deployment automation.
• Understanding of data governance, security, and compliance (KeyVault, RBAC, Managed Identities).

Key Responsibilities

• Design, develop, and maintainscalable, end-to-end data pipelines using Microsoft Fabric, PySpark, and Databricks .
• Build and optimize data models and ETL workflows tosupport analytics, reporting, and machine learning.
• Integrate data from relational databases, APIs, and flat files intoAzure Data Lake (ADLS) and Synapse .
• Implement Delta Lake architecture toensure ACID compliance and maintain historical data versions.
• Collaborate with data architects, analysts, and business teams to translate business requirements into technical solutions.
• Optimize Spark and SQLperformance for high-volume data workloads.
• Implement monitoring, alerting, and logging solutions using Azure Monitor andLog Analytics .
• Contribute to data governance andsecurity standards , ensuring data quality and reliability across environments.
• Mentor junior engineers and promote best practices in modern data engineering and Azure cloud technologies.

Preferred Skills

• Experience with Power BI or similar visualization tools for integrated analytics.
• Exposure to real-timedata processing andevent-driven architectures (Kafka, Event Hubs).
• Familiarity with CI/CD best practices usingAzure DevOps and Git-based workflows.
• Strong problem-solving, analytical, and communication skills.

Why Join KANINI?

• Join KANINIs award-winning Data Engineering Team, recognized as the "Outstanding Data Engineering Team" at DES 2025
• Work on real-world problemsat the intersection of data, AI, and product development
• Be part of a collaborative, innovative, and growth-driven environment.
• Access to cutting-edge tools, leadership support, and continuous learning opportunities.