Senior Data Engineer

Were Hiring: Senior & Lead Data Engineers

Location: Whitefield, Bangalore

Platform Specialization: Databricks

Project Scope: Complex DWH & Migration initiatives across the full data engineering lifecycle

Are you passionate about building scalable data pipelines, optimizing performance, and solving real-world data challenges? Were looking for hands-on Data Engineers and Lead engineers (510 years experience) who thrive in fast-paced environments and bring deep expertise in SQL, Python, Spark, Databricks, and cloud-native data platforms.

Role Overview

Senior Data Engineers (58 years):

Build and optimize robust data pipelines for ingestion, transformation, and analytics

Work across structured and semi-structured data sources, ensuring performance and reliability

Collaborate with cross-functional teams to deliver scalable solutions on Databricks

Strong coding skills in SQL, Python, and Spark are a must

Experience in data validations, reconciliation, and quality checks across ingestion and transformation stages

Lead Data Engineers (810 years):

Own solution architecture and consultative delivery for complex DWH and migration projects

Be hands-on with Databricks, Spark, and orchestration frameworks

Guide teams on best practices, performance tuning, and modular design

Engage with stakeholders to define scope, KPIs, and delivery milestones

Lead validation strategies and ensure data integrity across migration workflows

Core Skills & Competencies

Must-Have Technical Skills:

Advanced SQL (window functions, CTEs, performance tuning)

Python (data manipulation, modular design, error handling)

Advanced Apache Spark Programming

Databricks (Notebooks, Delta Lake, Job Orchestration, Unity Catalog, Delta Live Tables, DB Asset Bundles, Lakehouse Architecture, Workspace Management, Cluster Configuration, MLflow Integration, and Role-Based Access Control)

CI/CD pipelines, version control (Git), and testing frameworks

Experience with cloud platforms (Azure, AWS, or GCP)

Software Engineering Fundamentals:

Clean code practices and modular design

Agile delivery and sprint planning

Debugging, logging, and exception handling

Code reviews and mentoring junior engineers

Understanding of system design and scalability

Bonus Skills:

Exposure to data modeling (dimensional, star/snowflake schemas)

Familiarity with data governance, lineage, and cataloging tools

Prior experience in large-scale data migration projects and validation frameworks