AWS Data Engineer

Overview

We are seeking a skilled AWS Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable data pipelines and cloud-based data solutions. The ideal candidate will have strong expertise in AWS data services, ETL development, data warehousing, and big data technologies, with the ability to support data-driven business initiatives.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT pipelines using AWS cloud services.

Build and optimize data ingestion, transformation, and processing frameworks for structured and unstructured data.

Develop and manage data lakes and data warehouse solutions on AWS.

Collaborate with business stakeholders, data analysts, and application teams to gather requirements and deliver data solutions.

Implement data quality, validation, and monitoring processes to ensure data integrity and reliability.

Optimize data pipelines for performance, scalability, and cost efficiency.

Develop and maintain data models to support reporting, analytics, and business intelligence requirements.

Integrate data from multiple sources including databases, APIs, flat files, and third-party applications.

Troubleshoot and resolve data-related issues across development, testing, and production environments.

Follow best practices for security, governance, and compliance within AWS environments.

Create technical documentation, data flow diagrams, and support materials.

Required Skills & Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

5+ years of experience in Data Engineering, ETL Development, or Data Warehousing.

Strong hands-on experience with AWS services.

Experience building and maintaining ETL/ELT pipelines.

Strong SQL skills with experience working on large datasets.

Experience with Python or PySpark for data processing and automation.

Knowledge of data modeling, data warehousing concepts, and dimensional modeling.

Experience with workflow orchestration tools such as Apache Airflow or AWS Step Functions.

Understanding of CI/CD processes and version control systems such as Git.

Experience working with APIs, JSON, XML, and various data formats.

Strong analytical and problem-solving skills.

Excellent verbal and written communication skills.