Job Summary
We are seeking an experienced Architect with 10 to 14 years of experience to join our team. The ideal candidate will have expertise in AWS Glue Studio AWS Glue ETL Amazon S3 and Apache Spark. This role requires working from the office during day shifts. The Architect will play a crucial role in designing and implementing scalable data solutions that drive our companys success.
Responsibilities
Lead the design and implementation of scalable data solutions using AWS Glue Studio and AWS Glue ETLOversee the integration of data from various sources into Amazon S3Provide technical expertise in Apache Spark to optimize data processing workflowsCollaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needsEnsure data quality and integrity throughout the data lifecycleDevelop and maintain documentation for data architecture and processesMonitor and troubleshoot data pipelines to ensure smooth operationImplement best practices for data security and complianceMentor and guide junior team members in data engineering practicesStay updated with the latest trends and technologies in data engineeringContribute to the continuous improvement of data engineering processes and toolsParticipate in code reviews to ensure high-quality deliverablesCommunicate effectively with stakeholders to provide updates and gather feedback
Qualifications
Possess extensive experience in AWS Glue Studio and AWS Glue ETLDemonstrate proficiency in Amazon S3 for data storage and managementHave strong expertise in Apache Spark for data processingShow a solid understanding of data integration and ETL processesExhibit excellent problem-solving and analytical skillsHave a proven track record of designing and implementing scalable data solutionsDisplay strong communication and collaboration skillsBe committed to maintaining data quality and integrityHave experience mentoring and guiding junior team membersStay current with the latest data engineering trends and technologiesBe detail-oriented and able to manage multiple tasks effectivelyDemonstrate a proactive approach to identifying and resolving issuesPossess a strong commitment to continuous improvement in data engineering practices.
Certifications Required
AWS Certified Solutions Architect AWS Certified Big Data Specialty
