Data Engineer - Databricks

Greetings from TCS!!!

TCS is hiring Data Engineer (Databricks)

Location Any

Years of Experience 4-15 years

Job Description

Role - Senior Data Engineer Databricks

Required Technical Skill Set

Databricks, PySpark, Delta Lake, MLflow, Azure/AWS/GCP, Data Lakehouse architecture, CI/CD, DataOps

Desired Competencies

Must-Have

• Expertise in building scalable data pipelines using Databricks and PySpark
• Experience with Delta Lake and Lakehouse architecture
• Familiarity with MLflow and model tracking
• Strong understanding of data modernization and legacy system migration
• Ability to collaborate with AI/ML teams to embed models into pipelines
• Cloud-native development experience

Good-to-Have

• Exposure to GenAI/LLM integration
• Experience with streaming data (Kafka, Spark Streaming)
• Knowledge of data governance and cataloging tools (Unity Catalog, Purview)
• Familiarity with BI tools and dashboarding

Responsibility of / Expectations from the Role

• Build and optimize data pipelines using Databricks and PySpark
• Collaborate with AI/ML teams to integrate models into production workflows
• Drive data modernization efforts and ensure scalable, secure data architecture