Data Engineer

We Are Hiring: Senior Data Engineer / Data Engineering Lead

We are looking for a highly skilled Senior Data Engineer / Data Engineering Lead to join our growing data platform team. The ideal candidate will have strong experience in Python, PySpark, Databricks, DBT, SQL, and Cloud technologies and will play a key role in designing and delivering scalable data solutions.

If you are passionate about large-scale distributed data systems, cloud data platforms, and mentoring engineering teams, this opportunity is for you.

Key Responsibilities

Data Engineering Leadership

• Provide technical direction and best practices to data engineers working on the data platform.
• Support engineering teams with design reviews, testing processes, and implementation guidance.
• Mentor and onboard new data engineers within delivery squads.
• Ensure engineering standards, coding practices, and quality processes are followed.

Data Platform Development

• Design, develop, and optimize data pipelines and distributed data processing systems.
• Work with Databricks, DBT, Python, PySpark, and SQL for scalable data processing.
• Implement and manage cloud data solutions on AWS, Azure, or GCP.
• Ensure data quality, data modelling, storage optimization, and access control.

Delivery & Project Management

• Interpret feature and component design specifications and implement solutions.
• Participate in Agile (Scrum/Kanban) development cycles.
• Estimate effort, manage development timelines, and ensure on-time delivery.
• Perform defect root cause analysis and quality improvements.

Collaboration & Stakeholder Engagement

• Work closely with customers, architects, designers, and cross-functional teams.
• Present technical solutions and architecture options to stakeholders.
• Conduct product demos and technical discussions with clients.

Knowledge & Continuous Learning

• Stay updated with state-of-the-art tools, programming techniques, and data technologies.
• Contribute to documentation, knowledge bases, and reusable components.
• Encourage team learning through mentoring and coaching.

Required Skills & Experience

• Strong experience in Python and PySpark
• Experience with Databricks and DBT
• Expertise in SQL and data modelling
• Hands-on experience with cloud platforms (AWS / Azure / GCP)
• Experience building large-scale distributed data processing systems
• Knowledge of Agile development frameworks
• Experience with Linux Shell scripting
• Strong understanding of:
• Data quality and testing
• Data storage and access strategies
• Data engineering lifecycle

Preferred Skills

• Experience in data architecture and system design
• Knowledge of CI/CD pipelines
• Strong problem-solving and analytical skills
• Ability to mentor engineers and manage technical teams
• Excellent communication and stakeholder management skills