Principal Consultant - Snowflake Sr. Data Engineer
Genpact
5 - 10 years
Gurugram
Posted: 9/3/2024
Job Description
Responsibilities
:• Able to work on requirement gathering, analysis, designing, development, and deployment.
• Writing SQL queries against Snowflake, developing scripts to do Extract, Load, and Transform data.
• Good understanding on Data Warehouse concepts and Snowflake Architecture
• Hands-on experience with Snowflake utilities such as SnowSQL, SnowPipe, bulk copy, Snowpark, tables, Tasks, Streams, Time travel, Cloning, Optimizer, Metadata Manager, data sharing, stored procedures and UDFs, Snowsight.
• Have experience with Snowflake AWS data services (S3, Glue,lambda) or Azure data services (blob storage container, ADLS, ADF) etc
• Strong experience in integrating DBT (Data Build Tool) with Snowflake and cloud platforms such as AWS or Azure.
• Extensive knowledge of leveraging DBT to build and manage efficient data transformation pipelines in Snowflake.
• Experience in designing and developing efficient and scalable data models using DBT, including the creation of tables, views, and macros.
• Knowledge of SQL and ability to write complex queries and transformations using DBT's templating language.
• Proficiency in using DBT's testing and documentation features to ensure the accuracy and reliability of data transformations.
• Understanding of data lineage and metadata management concepts, and ability to track and document data transformations using DBT's lineage capabilities.
• Understanding of software engineering best practices and ability to apply these principles to DBT development, including version control, code reviews, and automated testing.
• Should have experience building data ingestion pipeline.
• Should have good experience in implementing CDC or SCD type 2
• Proficiency in working with Airflow or other workflow management tools for scheduling and managing ETL jobs.
• Good to have experience in repository tools like Github/Gitlab, Azure repo
Minimum Qualifications
• B.E./ Masters in Computer Science, Information technology, or Computer engineering or any equivalent degree with IT experience and relevant working experience as Snowflake Sr. Data Engineer.
Snowflake, DBT, AWS/Azure, SQL, ETL concepts, Airflow or any orchestration tools, Data Warehousing concepts
About Company
Genpact is a global professional services firm delivering digital transformation by putting digital and data to work to create competitive advantage.
Services you might be interested in
One-Shot Campaign
Reach out to ideal employees in one shot!
The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).