Senior Data Engineer

Hiring: Senior Data Engineer | Azure | Python | GenAI

Location: Bangalore | Pune | Hyderabad | Chennai

Experience: 610 Years

Job Type: Permanent

Notice Period: Immediate

Interview Mode: Virtual / Face-to-Face

About the Role

We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data platforms that power analytics, AI, and Generative AI (LLM) solutions. This role blends strong data engineering fundamentals with hands-on experience in LLM workflows, RAG pipelines, and cloud-native architectures .

Youll work closely with cross-functional teams to deliver reliable, production-grade data and AI systems in a fast-paced environment.

Key Responsibilities

• Design and deploy AI-driven workflows , including LLM-based systems, RAG pipelines, and agentic orchestration (LangChain, LangGraph, CrewAI).
• Build and optimize scalable data pipelines using Python and Azure services.
• Implement ETL/ELT pipelines , API-based integrations, and data transformations.
• Deploy and automate applications using Docker, Kubernetes , and cloud-native architectures (Azure/AWS/GCP).
• Ensure data quality, monitoring, governance , and pipeline reliability.
• Collaborate with data scientists, analysts, and product teams to translate business needs into technical solutions.
• Troubleshoot and resolve data pipeline and infrastructure issues .
• Create and maintain technical documentation for data pipelines and architectures.

Required Skills & Qualifications

• Bachelors or Masters degree in Computer Science, IT, or related field.
• 610 years of hands-on experience in Data Engineering .
• Strong proficiency in Python , SQL , ETL/ELT , and REST APIs .
• Solid experience with Azure cloud services (Data Engineering stack).
• Hands-on knowledge of Spark, Hadoop, Kafka .
• Experience with CI/CD tools (Jenkins, GitLab CI/CD).
• Proficiency in Docker, Kubernetes , and cloud-native deployments.
• Experience with SQL & NoSQL databases .
• Understanding of ML fundamentals , LLM fine-tuning , prompt engineering , and RAG architectures .
• Strong communication, analytical, and problem-solving skills.