Data Engineer

Job Title: Data Engineer

Experience: 3 10 Years

Location: Kochi

Work Mode: Onsite

Overview

We are seeking a skilled and motivated Data Engineer to join our growing data team. The ideal candidate will have strong hands-on experience with Microsoft Fabric and will be responsible for building, optimizing, and maintaining scalable data pipelines and data architectures. You will collaborate closely with data analysts, BI developers, and software engineers to ensure reliable data availability and efficient data processing that supports analytics and informed business decision-making.

Key Responsibilities

• Design, build, and maintain scalable data pipelines and transformation processes using Microsoft Fabric components, including Data Factory, OneLake, Dataflows, and Notebooks.
• Develop and manage robust data models and analytics solutions.
• Build and manage ETL processes, integrating data from diverse on-cloud and on-premise sources into centralized, governed environments using Fabric capabilities.
• Ensure data quality, integrity, consistency, security, governance, and compliance with industry standards such as Uniclass and SFG20 across all data storage layers.
• Monitor system performance and optimize data models, pipelines, and cost efficiency of Microsoft Fabric components.
• Collaborate with BI developers, data analysts, and application developers to understand business requirements and translate them into effective technical data solutions.
• Troubleshoot and resolve data-related issues in a timely and efficient manner.
• Implement best practices in data engineering, including coding standards, testing, version control, and deployment processes.
• Prepare and maintain comprehensive documentation for data architecture, workflows, pipelines, and configurations.

Requirements

• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in Python, T-SQL, Power Query, and KQL.
• Solid understanding of Microsoft Fabric, including Data Factory, data pipelines, Notebooks, and Lakehouse architecture.
• Experience with data integration, data modeling, and analytics solutions.
• Familiarity with Microsoft security and governance frameworks, including Microsoft Purview and RBAC.
• Exposure to CI/CD practices and tools, preferably within Azure DevOps.
• Excellent analytical, problem-solving, and troubleshooting skills.

Desirable Skills

• Understanding of the machine learning lifecycle.
• Experience with Azure Machine Learning or other cloud-based ML platforms for deploying and managing models.