Data Engineer – Technical Lead (Databricks & AWS)

Data Engineer Technical Lead (Databricks & AWS)

Location: Bangalore / Hyderabad (Hybrid, 23 days onsite

)Budget: Up to 40 LP

AExperience: 10+ Year

sJoiners: Immediate / within 15 day

s
About the Ro

leWe are seeking an experienced Data Engineer Technical Lead to drive end-to-end architecture, solutioning, and client engagement for large-scale cloud data platforms. The ideal candidate will combine deep technical expertise with strong leadership and communication skills to deliver scalable, secure, and high-performance solution

s.
Key Responsibilit

• iesLead technical solution design, ensuring scalability, reliability, and performan
• ce.Establish coding standards, conduct code reviews, and mentor team membe
• rs.Develop optimized Spark jobs (PySpark/Scala) with performance tuni
• ng.Build ETL/ELT pipelines using Databricks notebooks, Workflows, and AWS Gl
• ue.Integrate data into ADLS/S3 with robust security and metadata manageme
• nt.Define IAM roles, ACLs, and storage permissions for secure operatio
• ns.Collaborate with stakeholders, architects, and DevOps teams for deployment readine

ss.
Must-Have Sk

• ills8+ years in Data Engineering / Big Data / Cloud Data Platfo
• rms.6+ years hands-on with Databricks (PySpark/Scala, Delta Lake, Lakehouse, RBAC/AC
• Ls).5+ years designing Spark-based ingestion & transformation pipeli
• nes.4+ years with AWS Glue (ETL jobs, Workflows, Crawlers, Glue Catal
• og).Strong expertise in Athena, Spark, Python script

ing.
Soft S

• killsExcellent communication (verbal, email, instant messag
• ing).Strong interpersonal skills for stakeholder and team collabora
• tion.Analytical mindset with proven problem-solving abi
• lity.Agile/Scrum experience with tools like Jira/Azure De