Consultant - Data Engineer

Genpact

5 - 10 years

Gurugram

Posted: 03/09/2024

Getting a referral is 5x more effective than applying directly

Job Description

Responsibilities

· Oversees an assigned Data Science data operation, Architecture and Software Design.
· setting up or migrated into and worked in AWS environments
· A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
· Should have very well experienced in writing complex SQL using Joins and window functions .
· Strong skill sets required with Python library like Pandas ,numpy ,wrangler and Pyspark
· Ability to assemble large, complex data sets that meet functional / non-functional business requirements using AWS data services like ( datasync ,glue,athena,lambda,redshift ,aurora )
· Close interaction with both the data scientists and data warehouse team to deploy emerging technologies to all areas of the business.
· Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
· Ensure a high-performing team through the development of strong development processes including the development of best practice

Minimum Qualifications

· Bachelor's degree in Computer Science, Computer Engineering, Informatics, MIS, or related field
· technical experience with the above qualifications.
· Experience using cloud-based technology, especially data operation services AWS datasync ,glue,athena,lambda,redshift ,aurora.
· Mastery of ELT principles (such as SCD, parallel processing, partition, etc.)
· Experience handling bigdata (parquet, ORC formats, hive based metadata) and real-time data processing
Preferred Skills
· Experience with medical malpractice, workers compensation, or other low-frequency, high-severity industries is preferred, but not required. Experience with dirty medical data is also preferred
· Exposure of the complete lifecycle (from idea to execution) for machine learning projects in Python or R would be very helpful.
· Docker or similar tools for scripting deployment.

About Company

Genpact is a global professional services firm delivering digital transformation by putting digital and data to work to create competitive advantage.