Data Engineer

Data Engineer Data & Cloud Engineering

Location: Bengaluru

Experience Level: 6-9 years

Employment Type: Full-time

About the Role:

We are seeking a highly skilled Data Engineer to join our Data & Cloud Engineering team. In this role, you will design and build scalable data pipelines and cloud-based data platforms, supporting advanced analytics and data-driven products.

Key Responsibilities:

• Design, develop, and maintain data pipelines for multi-modal ADAS data.
• Build and manage pipelines and interfaces for data products, ensuring delivery of business value.
• Ensure data traceability, sequencing, and integrity across systems.
• Implement scalable ETL/ELT pipelines for cloud-based data workflows.
• Manage deployment and operations in Azure Cloud environments using Docker and Kubernetes.
• Develop and maintain Infrastructure as Code (IaC) using Terraform.
• Collaborate with cross-functional teams to gather requirements and define system architecture.
• Follow best practices in testing, version control, and documentation.
• Monitor, troubleshoot, and optimize large-scale distributed systems.

Required Skills & Qualifications:

• Strong proficiency in Python programming.
• Hands-on experience with data management systems, including data lake architectures and data product management.
• Experience with containerization and orchestration tools such as Docker and Kubernetes.
• Proficiency in big data technologies like Apache Spark, Hadoop, or Kafka.
• Strong experience with databases and data platforms (SQL, Databricks, MongoDB).
• Solid understanding of data modeling, serialization, and deserialization techniques.
• Proven ability to troubleshoot and optimize large-scale data systems.

Preferred Qualifications:

• Experience working with automated driving (ADAS) data workflows.
• Exposure to LLMs and AI tools.