AWS Data Engineer
Key words - Sas, Sas bi, Sas di. Sas MA
Experience - 5 to 8 years
Location - Hyderabad and Chennai
Responsibilities:
Participate in efforts to design, build, and develop rapid solutions and services
Implement ETL/ELT Processes: Develop Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, Open Source and AWS tools.
Build applications using Python, SQL and AWS
Be a key team member in design and development of the Data pipeline.
Apply knowledge of basic principles, methods and practices to simple and moderately complex assignments
Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
Implement standardized, automated operational and quality control processes to deliver accurate and timely data and reporting to meet or exceed SLAs
Collaborate with the other engineering team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms
Review functional and technical designs to identify areas of risk and/or missing requirements
Provide technical write-ups and drawings to promote the proposed solutions.
Requirements:
6-7 years’ experience with automation of DevOps build
Experience working directly with technical and business teams
Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon Athena, Amazon Redshift, Amazon Cloud watch, Amazon SNS and AWS Step Functions.
Strong experience with modern programming languages such as Python, Spark, and Scala.
Create Email alerts to send any notification mail.
Create new airflow DAG's and workflows for each source systems.
Define Trigger events either time or file based on the requirements
Familiar with AWS Services like EC2, S3, Redshift/Spectrum, Glue, Athena, RDS, Lambda, and API gateway;
Familiar with software DevOps CI/CD tools, such Git, Jenkins, Linux, and Shell Script
Ability to learn quickly, be organized and detail oriented
Build of DAG's and Airflow
Experience in Software Engineering and Development
Understanding of database schema design
