Senior Data Engineer

Job Title: Senior Data Engineer

Location: Bengaluru, Karnataka, India

Type: Full Time

Our client is looking for a Senior Data Engineer to design, build, and scale modern data platforms that power advanced analytics and data-driven decision-making. This role focuses on developing robust data frameworks, leading engineering teams, and delivering high-impact data solutions across the organization.

Role Overview

This is a senior-level position responsible for architecting and delivering scalable data pipelines and frameworks using cloud technologies. You will lead data engineering initiatives, partner with business and technology stakeholders, and help shape the organizations data strategy while enabling the development of data products.

Key Responsibilities

Data Engineering & Architecture

• Design, develop, and maintain scalable data pipelines and full-stack data frameworks (ETL/ELT, data processing, storage, and orchestration).
• Build robust solutions to handle structured and unstructured data, ensuring data quality, normalization, and harmonization.
• Implement modern data architectures using cloud platforms and distributed processing frameworks.

Cloud & Platform Development

• Develop and manage cloud-based data platforms using technologies such as Azure, AWS, or GCP.
• Work with cloud data tools and platforms (e.g., Databricks, Snowflake, Synapse, Redshift) for large-scale data processing.
• Integrate data from multiple sources using APIs, streaming, and batch processing methods.

Leadership & Delivery

• Lead and mentor data engineering teams, driving planning, execution, and delivery of projects.
• Manage multiple high-priority initiatives with competing timelines and evolving requirements.
• Use Agile methodologies (Scrum/Kanban) within a DevSecOps environment to ensure efficient delivery.

Data Products & Innovation

• Build and enable data products using modern approaches such as data mesh or data fabric architectures.
• Collaborate with product, analytics, and business teams to align data solutions with business outcomes.
• Challenge existing approaches and drive innovation in data architecture and engineering practices.

Stakeholder Collaboration

• Communicate effectively with technical and non-technical stakeholders to translate business needs into technical solutions.
• Influence decision-making through strong analytical thinking and solution design expertise.

Required Qualifications

• Bachelors or Masters degree in Computer Science, Software Engineering, or a related field.
• 8+ years of progressive experience in data engineering or related roles.
• 3+ years of experience leading data engineering teams.
• Strong experience building end-to-end data pipelines and frameworks (ETL/ELT, SQL, PySpark, Python).
• Hands-on experience with cloud platforms (Azure, AWS, or GCP) and modern data platforms (Databricks, Snowflake, Synapse, etc.).
• Experience working with APIs, streaming data, and large-scale distributed systems.
• Strong understanding of data modeling, data integration, and data quality practices.

Preferred Qualifications

• Experience with real-time data processing and unstructured data handling.
• Familiarity with data cataloging and data governance tools.
• Background in retail, consumer goods, or similar industries.
• Exposure to data & analytics product management practices.