Job Title: AWS Data Engineer
Location: Indore
Job Type: Full-time
Job Overview:
We are looking for a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will have strong experience in designing, implementing, and optimizing data pipelines in AWS. You will work closely with data scientists, analysts, and other engineering teams to ensure the seamless flow of data across systems.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines on AWS using services such as AWS Glue, Lambda, S3, Redshift, Athena, etc.
- Build and manage ETL/ELT processes for large-scale data processing.
- Implement best practices for data storage, data warehousing, and data transformation.
- Collaborate with data scientists, analysts, and other stakeholders to define data requirements and solutions.
- Ensure data quality, consistency, and governance across systems.
- Monitor and troubleshoot data pipelines, identifying and resolving issues proactively.
- Implement data security and compliance standards in line with company policies and industry regulations.
- Perform data migration from on-premise to AWS cloud infrastructure.
- Automate data ingestion and transformation using AWS tools and services.
- Stay updated on the latest AWS services and tools relevant to data engineering and recommend improvements.
Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 5+ years of experience in data engineering with hands-on experience in AWS cloud services.
- Strong experience with AWS services like S3, Redshift, Glue, Lambda, Athena, EMR, and RDS.
- Proficiency in SQL and experience with database management systems like Redshift, PostgreSQL, or MySQL.
- Expertise in ETL/ELT processes and tools (e.g., AWS Glue, Informatica, or Talend).
- Experience with data warehousing, data lakes, and big data processing technologies.
- Familiarity with infrastructure-as-code (IaC) tools such as AWS CloudFormation or Terraform.
- Proficiency in scripting languages like Python, Scala, or Java for data processing.
- Experience with CI/CD pipelines and version control tools such as Git.
- Understanding of data governance, security, and compliance in the cloud environment.
- Strong analytical and problem-solving skills with attention to detail.
Preferred Qualifications:
- AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Associate.
- Experience with machine learning pipelines and data science tools.
- Knowledge of data visualization tools like Tableau, QuickSight, or Power BI.
- Familiarity with Kubernetes or Docker for container orchestration.