Job Summary
Join our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal advancements through data-driven insights.
Responsibilities
- Develop and implement scalable data processing solutions using Spark and Scala to enhance data analytics capabilities.
- Collaborate with data scientists and analysts to optimize data workflows and ensure efficient data processing.
- Design and maintain data pipelines using SparkSQL and Python to support business intelligence initiatives.
- Troubleshoot and resolve technical issues related to Spark applications to ensure seamless data operations.
- Conduct code reviews and provide feedback to team members to maintain high-quality code standards.
- Participate in agile development processes to deliver projects on time and within scope.
- Analyze complex data sets to identify trends and insights that drive business decisions.
- Document technical specifications and processes to ensure knowledge sharing and continuity.
- Stay updated with the latest industry trends and technologies to continuously improve data solutions.
- Work closely with stakeholders to understand requirements and translate them into technical solutions.
- Ensure data security and compliance with company policies and industry regulations.
- Provide technical support and guidance to junior developers to foster a collaborative team environment.
- Contribute to the companys mission by delivering data-driven solutions that positively impact society.
Qualifications
- Possess a strong background in Spark Scala Python and SparkSQL with a minimum of 5 years of experience.
- Demonstrate proficiency in designing and implementing data pipelines and workflows.
- Exhibit excellent problem-solving skills and the ability to troubleshoot complex technical issues.
- Show experience in working within agile development environments and delivering projects on time.
- Have a keen understanding of data security and compliance requirements.
- Display strong communication skills to effectively collaborate with cross-functional teams.
- Be committed to continuous learning and staying updated with industry advancements.
Certifications Required
Certified Spark Developer Python for Data Science Certification