Senior Data Engineer

Job Title: Data Engineer / Azure Databricks Data Engineer

Experience: 5 10 Years

Employment Type: Full-Time

Location :- Bengaluru / Hyderabad / Chennai / Pune / Noida / Coimbatore

Industry: Product / SaaS / Enterprise / Technology Services

Job Summary

We are seeking a highly skilled Data Engineer with strong experience in Azure Cloud, Azure Databricks, and Python to design, build, and maintain scalable data platforms. The ideal candidate will be responsible for developing robust data pipelines, optimizing data workflows, and enabling analytics and data-driven decision-making across the organization.

This role requires hands-on expertise in big data processing, cloud-native data engineering, and working with large-scale datasets in an enterprise environment.

Location :- Bengaluru / Hyderabad / Chennai / Pune / Noida / Coimbatore

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks and Python
• Build and optimize ETL/ELT workflows for structured and unstructured data
• Work with large-scale datasets to support analytics, reporting, and machine learning use cases
• Develop and manage data solutions on Microsoft Azure Cloud
• Implement data ingestion from multiple sources such as APIs, databases, files, and streaming platforms
• Optimize Databricks jobs for performance, reliability, and cost efficiency
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements
• Ensure data quality, data governance, security, and compliance best practices
• Monitor and troubleshoot data pipelines in production environments
• Participate in code reviews and ensure adherence to engineering best practices
• Document data architecture, pipelines, and operational procedures.

Location :- Bengaluru / Hyderabad / Chennai / Pune / Noida / Coimbatore

Required Skills & Experience

• Core Skills
• 510 years of hands-on experience as a Data Engineer
• Strong proficiency in Python for data engineering and automation
• Extensive experience with Azure Databricks
• Solid understanding of Azure Cloud services, including:
• Azure Data Factory
• Azure Data Lake Storage (ADLS Gen2)
• Azure Synapse Analytics (good to have)
• Strong SQL skills for data querying and transformation
• Experience working with big data technologies and distributed computing concepts
• Hands-on experience in designing and managing ETL/ELT pipelines

Good to Have (Nice to Have)

• Experience with Spark (PySpark) and performance tuning
• Knowledge of Delta Lake and data versioning
• Exposure to CI/CD pipelines for data engineering workloads
• Experience with data modeling and dimensional modeling concepts
• Familiarity with streaming technologies (Kafka, Event Hubs)
• Azure certifications (DP-203, AZ-900, etc.)

Location :- Bengaluru / Hyderabad / Chennai / Pune / Noida / Coimbatore