Data Engineer

Job Title: Data Engineer

Location: Hyderabad

Mode of Work: Work from Office

Shift: 2:00 PM 11:00 PM

About the Role

We are looking for a skilled and hands-on Data Engineer to join our One Truth Data Team. This is a delivery-focused role where you will contribute to building scalable data pipelines and high-quality datasets that power critical business decisions.

This role is ideal for someone who enjoys working on complex data systems, collaborates well in distributed teams, and can effectively communicate progress, risks, and solutions.

Key Responsibilities

• Design, build, and optimize data pipelines across batch and real-time platforms
• Work with PySpark and Databricks to process large-scale distributed data
• Integrate data from multiple systems such as SQL Server, Oracle, and AS/400 (DB2)
• Implement CDC and event-driven architectures
• Collaborate with senior engineers to translate requirements into scalable technical solutions
• Actively participate in sprint planning, estimations, and delivery tracking
• Ensure strong engineering practices through:
• Code reviews
• Testing & validation
• Documentation
• Troubleshoot pipeline failures and perform root-cause analysis
• Work closely with cross-functional teams including DevOps, Product, Architecture, and Release teams

Required Skills

• Strong experience in Data Engineering with modern analytics platforms
• Hands-on expertise in:
• PySpark
• Databricks
• Distributed data processing
• Experience with:
• SQL Server
• Oracle
• AS/400 / DB2
• Solid understanding of:
• Data pipeline orchestration
• Performance tuning
• Data reliability & scalability
• Experience with streaming/event-driven architectures
• Strong debugging and problem-solving skills
• Ability to work effectively in a distributed/offshore team environment

Preferred Qualifications

• Exposure to cloud-native data platforms
• Experience with monitoring, observability, and operational analytics
• Familiarity with CI/CD or DevOps practices in data engineering
• Experience contributing to code reviews, documentation, and team standards

What Were Looking For

• Strong communication and collaboration skills
• Proactive mindset with the ability to raise risks early
• Ability to work independently while aligning with team goals
• Ownership and accountability in delivery
• Willingness to learn and grow with guidance from senior engineers

Why Join Us?

• Work on enterprise-scale data platforms
• Opportunity to collaborate with global teams
• Strong focus on engineering excellence and best practices
• High-impact role contributing to business-critical systems