Data Engineer

Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Ab Initio
Good to have skills : Data Architecture Principles, UNIX Shell Scripting, GCP Dataflow
Minimum 15 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary: As a Data Architect Lead, you will design, develop and maintain data solutions for data generation, collection, and processing. You will create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems. Roles & Responsibilities: - Expected to be a SME with deep knowledge and experience. - Should have Influencing and Advisory skills. - Responsible for team decisions. - Engage with multiple teams and contribute on key decisions. - Expected to provide solutions to problems that apply across multiple teams. - Design and develop data solutions for data generation, collection, and processing. - Create and maintain data pipelines to ensure efficient data flow. - Implement ETL processes to extract, transform, and load data across systems. - Ensure data quality and integrity throughout the data lifecycle. - Collaborate with cross-functional teams to understand data requirements and provide technical expertise. - Identify and resolve data-related issues and optimize data processes. - Stay updated with industry trends and best practices in data engineering. - Train and mentor junior data engineers to enhance their skills and knowledge. Professional & Technical Skills: - Must To Have Skills: Proficiency in Ab Initio, DevOps, Data ETL, UNIX Shell Scripting,Collibra. - Good To Have Skills: Experience with UNIX Shell Scripting, Cloud (AWS/GCP), Python, Data Architecture Principles. - Strong understanding of data engineering concepts and principles. - Experience in designing and implementing data solutions using Ab Initio. - Knowledge of ETL processes and data integration techniques. - Familiarity with data modeling and database design. - Proficiency in SQL and scripting languages. - Experience with data warehousing and data management systems. - Ability to troubleshoot and optimize data pipelines. - Excellent problem-solving and analytical skills. Additional Information: - The candidate should have a minimum of 15 years of experience in Ab Initio. - This position is based at our Bengaluru office. - A 15 years full time education is required.