Senior Data Engineer

Location: Bangalore

WorkMode: Hybrid

Experience: 69 years

Job Type: Full-time

About the Role

Were looking for seasoned data engineers who can take end-to-end ownership of complex data engineering engagementsright from architecture and design to development and delivery. Youll work with client stakeholders, lead data initiatives, and guide teams in building modern, scalable data platforms that support business intelligence, advanced analytics, and AI/ML applications.

Key Responsibilities

• Lead the design and implementation of scalable, secure, and high-performance data architectures.
• Architect and optimise data pipelines for batch and real-time processing across varied source systems.
• Model and implement enterprise-grade data lakes, lakehouses, and warehouses to support analytical workloads.
• Collaborate with client teams and internal stakeholders to define data strategies, tooling, and standards.
• Set up and enforce best practices around code quality, pipeline observability, testing, and CI/CD.
• Guide technical decision-making and mentor junior/mid-level engineers.
• Troubleshoot complex data issues and provide architectural solutions across heterogeneous systems.

Must-Have Skills

• Strong expertise in Python and advanced proficiency in SQL.
• Hands-on experience with Databricks.
• Deep understanding of data engineering architecture: ETL/ELT pipelines, data modeling (dimensional and normalised), warehousing, streaming systems, and data integration patterns.
• Proven experience with distributed data processing frameworks (e.g., Apache Spark, Flink).
• Proficient with orchestration tools like Airflow or similar, and production-grade data workflows.
• Solid grounding in cloud-native data services (compute, storage, IAM, monitoring).
• Experience leading technical implementations and collaborating with business stakeholders.

Good to Have

• Multi-cloud experience (AWS preferred; GCP or Azure familiarity is valued).
• Hands-on experience with Databricks, dbt, and collaborative data development environments.
• Awareness of data governance, security, lineage, and quality frameworks.
• Certifications such as AWS Certified Data Analytics, Databricks Certified Data Engineer Professional, or equivalent.

Other Expectations

• Strong leadership, ownership, and client communication skills.
• Ability to balance hands-on contributions with technical guidance.
• Adaptability to new tools, tech stacks, and problem domains.
• Willingness to travel within India for short/medium-term client assignments.

Kindly drop your resume (annesha.manna@coffeebeans.io OR sanchita.s@coffeebeans.io)