Job Summary
We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience in AWS Glue Studio AWS Glue ETL AWS Glue Catalog Amazon S3 and Apache Spark. The ideal candidate will work from our office during day shifts contributing to the development and optimization of our data processing solutions. This role does not require travel.
Responsibilities
Develop and maintain data processing solutions using AWS Glue Studio AWS Glue ETL and AWS Glue Catalog.Design and implement data pipelines to efficiently process and store large datasets in Amazon S3.Utilize Apache Spark to optimize data processing and ensure high performance.Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.Monitor and troubleshoot data processing workflows to ensure reliability and accuracy.Provide technical guidance and support to team members on AWS Glue and related technologies.Ensure data security and compliance with company policies and industry standards.Continuously evaluate and improve existing data processing solutions to enhance performance and scalability.Document technical specifications and maintain comprehensive records of data processing workflows.Participate in code reviews to ensure code quality and adherence to best practices.Stay updated with the latest advancements in AWS Glue and related technologies to drive innovation.Contribute to the overall success of the team by sharing knowledge and expertise.Support the companys mission by delivering high-quality data solutions that drive business growth.
Qualifications
Possess strong expertise in AWS Glue Studio AWS Glue ETL and AWS Glue Catalog.Demonstrate proficiency in designing and implementing data pipelines using Amazon S3.Have extensive experience with Apache Spark for data processing optimization.Show ability to collaborate effectively with cross-functional teams.Exhibit strong troubleshooting skills to ensure data processing reliability.Maintain a deep understanding of data security and compliance requirements.
Certifications Required
AWS Certified Big Data - Specialty or equivalent certification preferred.