Principal Consultant - Snowflake Sr. Data Engineer

Genpact

5 - 10 years

Bengaluru

Posted: 03/09/2024

Getting a referral is 5x more effective than applying directly

Job Description

Responsibilities

:
• Requirement gathering, creating design document, providing solutions to customer, work with offshore team etc.
• Writing SQL queries against Snowflake, developing scripts to do Extract, Load, and Transform data.
• Hands-on experience with Snowflake utilities such as SnowSQL, Bulk copy, Snowpipe, Tasks, Streams, Time travel, Cloning, Optimizer, Metadata Manager, data sharing, stored procedures and UDFs, Snowsight.
• Have experience with Snowflake cloud data warehouse and AWS S3 bucket or Azure blob storage container for integrating data from multiple source system.
• Should have have some exp on AWS services (S3, Glue, Lambda) or Azure services ( Blob Storage, ADLS gen2, ADF)
• Should have good experience in Python/Pyspark.integration with Snowflake and cloud (AWS/Azure) with ability to leverage cloud services for data processing and storage.
• Proficiency in Python programming language, including knowledge of data types, variables, functions, loops, conditionals, and other Python-specific concepts.
• Knowledge of ETL (Extract, Transform, Load) processes and tools, and ability to design and develop efficient ETL jobs using Python and Pyspark.
• Should have some experience on Snowflake RBAC and data security.
• Should have good experience in implementing CDC or SCD type-2.
• Should have good experience in implementing Snowflake Best Practices
• In-depth understanding of Data Warehouse, ETL concepts and Data Modelling
• Experience in requirement gathering, analysis, designing, development, and deployment.
• Should Have experience building data ingestion pipeline
• Optimize and tune data pipelines for performance and scalability
• Able to communicate with clients and lead team.
• Proficiency in working with Airflow or other workflow management tools for scheduling and managing ETL jobs.
• Good to have experience in deployment using CI/CD tools and exp in repositories like Azure repo , Github etc.

Minimum Qualifications

• B.E./ Masters in Computer Science, Information technology, or Computer engineering or any equivalent degree with good IT experience and relevant as Senior Snowflake Data Engineer.
• Skill Metrix:

• Snowflake, Python/PySpark, AWS/Azure, ETL concepts, Data Modeling & Data Warehousing concepts

About Company

Genpact is a global professional services firm delivering digital transformation by putting digital and data to work to create competitive advantage.