AWS Data Engineer

Role AWS Data Engineer

Required Technical Skill Set AWS Redshift, Glue, PySpark

Desired Experience Range 4-10 Years

Location of Requirement Chennai/Pune

Desired Competencies (Technical/Behavioral Competency)

Must-Have Strong hands-on experience in Python programming and PySpark

Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)

Experience working with Apache Spark and Hadoop ecosystem.

Experience in writing and optimizing SQL for data manipulations

Good Exposure to scheduling tools. Airflow is preferable.

Must Have Data Warehouse Experience with AWS Redshift or Hive

Experience in implementing security measures for data protection.

Expertise to build/test complex data pipelines for ETL processes (batch and near real time) Readable documentation of all the components being developed.

Knowledge of Database technologies for OLTP and OLAP workloads

Good-to-Have Good understanding of Data warehouse and Data Lakes Familiarize ETL tools like Netezza or Informatica. Experience working with NoSQL databases like DynamoDB or MongoDB. Good to have exposure to AWS services (Step Functions, Athena) Data Modelling exposure Familiarity with Investment Banking domain