Job Summary
We are seeking a highly skilled Sr. Developer with 8 to 12 years of experience in Big Data and AWS technologies. The ideal candidate will work in a hybrid model utilizing their expertise in AWS EC2 AWS EMR Amazon S3 Apache Spark and Python to drive innovative solutions. This role offers the opportunity to make a significant impact on our projects and contribute to the companys success.
Responsibilities
- Develop and implement scalable big data solutions using AWS EC2 AWS EMR and Amazon S3 to enhance data processing capabilities.
- Collaborate with cross-functional teams to design and optimize data pipelines ensuring efficient data flow and storage.
- Utilize Apache Spark to perform complex data transformations and analytics delivering actionable insights for business decisions.
- Write and maintain high-quality Python code to automate data processing tasks and improve system performance.
- Monitor and troubleshoot data processing workflows ensuring reliability and accuracy of data outputs.
- Participate in code reviews and provide constructive feedback to peers fostering a culture of continuous improvement.
- Stay updated with the latest industry trends and technologies applying new knowledge to enhance existing systems.
- Ensure data security and compliance with industry standards protecting sensitive information and maintaining trust.
- Contribute to the development of best practices and standards for big data processing and cloud computing.
- Provide technical guidance and support to junior developers sharing expertise and promoting skill development.
- Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
- Optimize resource utilization on AWS platforms reducing costs and improving system efficiency.
- Document technical specifications and project progress ensuring clear communication and alignment with project goals.
Qualifications
- Possess a strong understanding of big data technologies and cloud computing particularly AWS services.
- Demonstrate proficiency in Apache Spark and Python with a proven track record of successful project implementations.
- Exhibit excellent problem-solving skills and the ability to work independently in a hybrid work model.
- Show experience in designing and optimizing data pipelines for large-scale data processing.
- Have a keen eye for detail and a commitment to delivering high-quality results.
- Display effective communication skills both written and verbal to collaborate with diverse teams.
Certifications Required
AWS Certified Big Data Specialty Apache Spark Developer Certification