Data Engineer

Data Engineer

Keys Skills - Snowflake, Python, AWS and Airflow.

Exp: 6 8 years

Location: Mumbai (preferred), Bangalore, Chennai & Gandhinagar

Job description

We are seeking an experienced Level II Data Engineer to design, build, and maintain data pipelines. In this role, you will develop scalable data pipelines, optimize Snowflake data solutions, and ensure high-quality data is available for analytics and machine learning initiatives. A strong understanding of Snowflake databases, proficiency in Python programming, and experience with Airflow are essential for this role. Additionally, the candidate must have experience with AWS services relevant to data engineering workflows.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Snowflake, Airflow, and Python
• Architect and implement enterprise-wide data solutions that support business intelligence and analytics initiatives
• Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions
• Ensure data quality, integrity, and security across all data platforms
• Optimize data models and query performance for maximum efficiency
• Implement data governance policies and documentation standards
• Troubleshoot and resolve complex data issues

Essential Technical Skills

• Strong proficiency in Python programming (5+ years)
• Experience with Apache Airflow for workflow orchestration (3+ years)
• Advanced knowledge of Snowflake, including architecture, optimization, and best practices (3+ years)
• Expertise in SQL and data modeling techniques
• Experience with data integration tools and ETL/ELT processes
• Experience with API interfaces and leverage efficient methods to parse various formats of the files like JSON, PARQUET
• Familiarity with cloud platforms (AWS, Azure, or GCP)
• Knowledge of data governance and security principles

Required Experience

• 5+ years of professional experience in data engineering roles
• Proven track record of building enterprise-scale data solutions
• Experience working with large datasets
• Bachelors degree in Computer Science, Engineering, or related field

Preferred Qualifications

• Masters degree in Computer Science, Data Science, or related field
• Familiarity with CI/CD pipelines and DevOps practices
• Experience with data visualization tools (Tableau, Power BI)
• Certifications in relevant technologies (Snowflake, AWS)

Soft Skills & Collaboration Expectations

• Excellent problem-solving abilities with strong analytical thinking
• Effective communication skills to translate technical concepts and excellent documentation skills
• Collaborative mindset with experience in cross-functional team environments
• Self-motivated with the ability to work independently when needed