Data Engineer

Job title: Senior Data Engineer

Location: Hyderabad

Work type: Onsite

Roles & Responsibilities:

8 years of experience in application design, development and analysis

Experience in AWS Cloud Solutions. Retail Industry experience preferred.

Implement data transformations and data structures for data warehouse and lake/repository.

Manage cloud and/or on-premises solutions for data transfer and storage.

Process data using spark (PySpark)

Collaborate and work with data analysts in various functions to ensure that data meets their reporting and analysis needs.

Experience in creating Various ETL Frameworks in processing or extracting the data from cloud databases by using AWS Services by leveraging Lambda, Glue, PySpark, Step Functions, SNS, SQS and Batch.

Should have sound knowledge in various AWS Services

Able to understand the existing Frameworks built in AWS PySpark and Glue

Able to scan ETL Frameworks and propose optimizations and cost savings.

Understanding of and experience working in an Agile environment