Responsibilities
You will need to be well spoken and have an easy time establishing productive long lasting working relationships with a large variety of stakeholders • Take the lead on data pipeline design with strong analytical skills and a keen eye for detail to really understand and tackle the challenges businesses are facing • You will be confronted with a large variety of Data Engineer tools and other new technologies as well with a wide variety of IT, compliance, security related issues. • Design and develop world-class technology solutions to solve business problems across multiple client engagements. • Collaborate with other teams to understand business requirements, client infrastructure, platforms and overall strategy to ensure seamless transitions. • Work closely with AI and A team to build world-class solutions and to define AI strategy. • You will possess strong logical structuring and problem-solving skills with expert level understanding of database and have an inherent desire to turn data into actions. • Strong verbal, written and presentation skills
Technical Requirements
Requirements (AWS Data Engineer) >> • 3 – 10 years of strong python or Java data engineering experience • Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, on AWS. • Experience in developing ETL, OLAP based and Analytical Applications. • Experience in ingesting batch and streaming data from various data sources. • Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.) • Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.) • Experience in Airflow DAGS, AWS EMR, S3, IAM and other services • Experience working on Test cases using pytest/ unit test or any other framework. • Snowflake or Redshift data warehouses • Experience of DevOps and CD/CD tools. • Familiarity with Rest APIs • Experience with CI/CD pipelines, branching strategies, & GIT for code management • Bachelor's degree in computer science, information technology, or a similar field
Preferred Skills
Technology->Analytics - Packages->Python - Big Data
Technology->Data Science->Machine Learning
Technology->Cloud Platform->Azure Analytics Services->Azure Databricks
Technology->Cloud Platform->AWS Data Analytics
Additional Responsibilities
• Comfortable working in Agile projects • Clear and precise communication skills • Ability to quickly learn and develop expertise in existing highly complex applications and architectures.
Educational Requirements
Bachelor of Engineering
