Senior Data Engineer

Overview

The Data & Insights organization at Insight Global is responsible for delivering Trusted Data & Verified Insights to drive business decisions across the company. As a Data Engineer based in Hyderabad, India, you will be part of a newly established offshore team focused on building and maintaining scalable data pipelines, supporting platform operations, and enabling analytics, data science, and machine learning use cases.

This is a hands-on role reporting to the Data Engineering Manager with direct impact on Insight Globals ability to deliver high-quality, actionable data to the business.

Primary Responsibilities

• Design and build scalable, reliable data pipelines for analytics and data science.
• Monitor and maintain data pipelines, automate operational tasks, and ensure SLA adherence.
• Troubleshoot and fix bugs across the data platform, contributing to platform stability and performance.
• Improve data quality, performance, and process efficiency.
• Develop and maintain metadata catalogs and optimize resource usage.
• Apply CI/CD and automated testing to ensure code quality and deployment reliability.
• Collaborate across business, analytics, and IT teams to deliver data solutions.
• Work with structured and unstructured data in both batch and streaming environments.
• Participate in on-call rotations and support deployment activities.

Required Skills

• 5+ years of experience in Data Engineering, Analytics, or Software Engineering.
• Strong SQL skills for data analysis and pipeline development.
• Proficiency in Python (PySpark) for data pipeline creation and troubleshooting.
• Experience with Databricks and Azure Data Factory.
• Effective communication and collaboration across technical and business teams.
• Experience structuring data for analytics and machine learning.

Preferred Skills

• Experience with Databricks Unity Catalog.
• Familiarity with data modeling and diagramming tools.
• Focus on continuous improvement and data quality.
• Exposure to operational monitoring and incident response practices.

This Role Is Ideal If You:

• Are excited to be part of a growing offshore team and help shape its success.
• Thrive in Agile environments and enjoy working across disciplines.
• Take ownership of both development and operational responsibilities.
• Are passionate about delivering reliable, high-quality data solutions.
• Embody Insight Globals shared values and contribute to a collaborative, high-performance culture.