Data Engineering Manager - Python & AI (7 to 12 yrs)

Data Engineering Manager Python & AI

Experience: 7 to 12 Years

Location: Remote (Work from Home) / Bangalore / India

Mode of Engagement: Full-time

No of Positions: 2

Educational Qualification: MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry: IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period: Immediate

What We Are Looking For:

• 712 years of experience in managing end-to-end data engineering and delivery projects , including Python-based data scraping, ETL, and dashboarding .
• Proven experience in leading teams , setting up complex data engineering projects , and establishing data pipelines integrating scraping, processing, and analytics.
• Hands-on proficiency in Python, SQL, ETL frameworks , and web scraping , with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen .
• Experience with AWS, GitHub, CI/CD, Jira, ClickUp , and DevOps tools for delivery tracking, workflow automation, and performance optimization.

Responsibilities:

• Lead and manage multiple data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.
• Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.
• Collaborate with cross-functional teams Data Engineers, Python Developers, and Analysts to design, build, and optimize large-scale data systems and dashboards.
• Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows .
• Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.
• Establish and monitor data quality, governance, and compliance standards throughout project execution.
• Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns .
• Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI/CD pipelines .

Qualifications:

• Bachelor's or master's degree in engineering, Computer Science, or related field.
• Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .
• Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.
• Working knowledge of AWS , GitHub , DevOps (Docker, Kubernetes) , and workflow automation tools .
• Proven experience managing cross-functional data delivery teams and handling international client communication .
• Excellent analytical, leadership, and problem-solving skills.
• Project Management certifications (PMP, Agile, or Scrum Master ) are an added advantage.