Senior Data Engineer

About Ganit

Ganit is a leading data science and analytics company founded by industry experts, with offices in Chennai, Bengaluru, Mumbai, and New Jersey. We help global enterprises maximize their Decision-Making Power (#DMP) by transforming data into actionable business insights.

Since our inception in 2017, we have grown into a team of 150+ data scientists, analysts, and engineers serving Fortune 500 clients across the US, Singapore, Africa, UAE, and India.

Senior Data Engineer

Roles & Responsibilities

• Design, develop, and maintain scalable data pipelines using formats such as JSON, Parquet, CSV, and ORC, supporting both batch and streaming data ingestion.
• Lead cloud migration initiatives and build scalable Spark-based data processing pipelines.
• Implement and manage Medallion Architecture (Bronze, Silver, and Gold layers) for efficient and scalable data systems.
• Optimize Spark code to improve performance, scalability, and cloud migration efficiency.
• Develop and maintain robust data models while ensuring strong data governance practices.
• Implement data cataloging strategies using Unity Catalog to enhance data quality, discoverability, and governance.
• Design and implement Delta Live Tables (DLT) pipelines to support secure, reliable, and scalable data processing.
• Collaborate closely with clients to understand business requirements, optimize cloud migration strategies, and establish best practices in data architecture and governance.

Qualifications

Experience

• Minimum 5 years of hands-on experience in Data Engineering.
• Proven expertise in developing complex data pipelines and executing cloud migration projects.

Education

• Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.

Technical Skills

• Strong proficiency in Spark, SQL, Python, and modern data engineering technologies.
• Hands-on experience with Databricks, including Delta Live Tables (DLT).
• Expertise in Spark optimization and on-premises to cloud migration projects.
• Strong understanding of Medallion Architecture and data governance frameworks.
• Experience with AWS services; exposure to Azure or GCP is an added advantage.

Soft Skills

• Excellent communication, stakeholder management, and collaboration skills.
• Ability to work effectively with clients and cross-functional teams in a fast-paced environment.

Good to Have

• AWS, Azure, or GCP Data Engineer Certifications.