Data Engineer

Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Python (Programming Language)
Good to have skills : AWS S3 (Simple Storage Service), MySQL, AWS Glue
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary: As a Data Engineer, you will design, develop, and maintain data solutions for data generation, collection, and processing. You will create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems. Your typical day will involve designing and developing data solutions, collaborating with cross-functional teams, and ensuring data integrity and security. Roles & Responsibilities: - Expected to perform independently and become an SME. - Required active participation/contribution in team discussions. - Contribute in providing solutions to work-related problems. - Design and develop data solutions for data generation, collection, and processing. - Create and maintain data pipelines to ensure efficient data flow. - Implement ETL processes to migrate and deploy data across systems. - Collaborate with cross-functional teams to understand data requirements and provide technical expertise. - Ensure data quality and integrity by implementing data validation and cleansing techniques. - Optimize data storage and retrieval processes for improved performance. - Monitor and troubleshoot data pipelines and ETL processes to identify and resolve issues. - Stay updated with industry trends and best practices in data engineering. - Contribute to the documentation of data solutions and processes. Professional & Technical Skills: - Must To Have Skills: Proficiency in Python (Programming Language). - Good To Have Skills: Experience with AWS Glue, AWS S3 (Simple Storage Service), MySQL. - Strong understanding of statistical analysis and machine learning algorithms. - Experience with data visualization tools such as Tableau or Power BI. - Hands-on implementing various machine learning algorithms such as linear regression, logistic regression, decision trees, and clustering algorithms. - Solid grasp of data munging techniques, including data cleaning, transformation, and normalization to ensure data quality and integrity. Additional Information: - The candidate should have a minimum of 3 years of experience in Python (Programming Language). - This position is based at our Hyderabad office. - A 15 years full-time education is required.