Data Engineer

Required Skills

• 4+ years of experience in Data Engineering, Analytics, or Software Engineering.
• Strong SQL skills for data analysis and pipeline development.
• Proficiency in Python (PySpark) for data pipeline creation and troubleshooting.
• Experience with Databricks and Azure Data Factory.
• Experience structuring data for analytics and machine learning.

Overview

The Data & Insights organization at Insight Global is responsible for delivering Trusted Data & Verified Insights to drive business decisions across the company. As a Data Engineer based in Hyderabad, India, you will be part of a newly established offshore team focused on building and maintaining scalable data pipelines, supporting platform operations, and enabling analytics, data science, and machine learning use cases.

This is a hands-on role reporting to the Data Engineering Manager with direct impact on Insight Globals ability to deliver high-quality, actionable data to the business.

Primary Responsibilities

• Design and build scalable, reliable data pipelines for analytics and data science.
• Monitor and maintain data pipelines, automate operational tasks, and ensure SLA adherence.
• Troubleshoot and fix bugs across the data platform, contributing to platform stability and performance.
• Improve data quality, performance, and process efficiency.
• Develop and maintain metadata catalogs and optimize resource usage.
• Apply CI/CD and automated testing to ensure code quality and deployment reliability.
• Collaborate across business, analytics, and IT teams to deliver data solutions.
• Work with structured and unstructured data in both batch and streaming environments.
• Participate in on-call rotations and support deployment activities.