Senior AI Data Platform Engineer

Sr. Data Engineer / AI Data Platform Engineer

Hyderabad - Hybrid

We are looking for:

1. A strong programmer in the data space

2. Experience working with LLMs and their product ionization

3. Solid system design skills

Required skills:

• Python and/or Scala for data engineering
• Apache Spark for large-scale data processing
• Apache Airflow for pipeline orchestration
• Databricks on AWS
• AWS ecosystem (S3, Lambda, Glue)
• Data lake architecture and Medallion (Bronze, Silver, Gold)
• Streaming and batch data pipelines
• REST/GraphQL APIs and data integration patterns
• Data governance, cataloging, and monitoring.
• LLM orchestration frameworks
• RAG (Retrieval-Augmented Generation) architectures
• Model Context Protocol (MCP)
• AWS Bedrock
• AWS Nova Pro