Lead Data Engineer

About the Company

Growexx is looking for a Lead Data Engineer to drive our data engineering, analytics, and AI initiatives.

About the Role

The ideal candidate will have strong hands-on expertise in Python, SQL, AWS cloud platforms, workflow orchestration, and containerization, along with the ability to architect scalable data solutions and guide technical teams. This role requires strategic thinking, strong problem-solving skills, and cross-functional collaboration.

Responsibilities

• Lead and mentor data engineering, data science, and analytics team members.
• Architect and implement scalable end-to-end data pipelines and distributed data processing.
• Design and optimize ETL/ELT workflows using Airflow, Spark/PySpark, and related tools.
• Develop and manage REST APIs and microservices and integrate external systems and tools.
• Build and maintain cloud infrastructure with strong focus on AWS services.
• Manage containerization and orchestration using Docker and advanced Kubernetes.
• Implement and manage enterprise data warehousing solutions, preferably Snowflake.
• Support research and implementation of GenAI-based solutions.
• Define and enforce data standards, governance, and data quality frameworks.
• Collaborate with business and product teams to deliver data-driven insights.

Qualifications

• Bachelors degree in Computer Science, Engineering, or related field.
• Minimum 7+ years of relevant experience in data engineering, data science, or software development.

Required Skills

• 5+ years hands-on experience with Python and SQL.
• 5+ years experience in AWS cloud services.
• Strong Docker expertise (5+ years) and advanced Kubernetes experience.
• Airflow experience (5+ years) for workflow orchestration.
• Hands-on experience with Spark / PySpark.
• Data warehousing experience (Snowflake preferred).
• Basic understanding of ELK stack.
• Experience with system integrations (Slack, Glean AI, OpenMetadata preferred).
• Intermediate experience with GenAI / LLM-based implementations.