Job Summary
We are seeking a Sr. Developer with 6 to 9 years of experience to join our team. The ideal candidate will have expertise in PySpark and Snowflake and will work from our office during day shifts. This role does not require travel. The Sr. Developer will contribute to the development and optimization of our data processing systems ensuring high performance and reliability.
Responsibilities
Develop and maintain scalable data pipelines using PySpark to process large datasets efficiently.Optimize and fine-tune existing PySpark code to improve performance and reduce processing time.Design and implement data storage solutions using Snowflake to ensure data integrity and accessibility.Collaborate with data engineers and analysts to understand data requirements and deliver solutions that meet business needs.Provide technical guidance and support to junior developers ensuring best practices are followed.Conduct code reviews to maintain code quality and consistency across the team.Troubleshoot and resolve issues related to data processing and storage in a timely manner.Monitor and manage data pipeline performance identifying and addressing bottlenecks.Implement data security measures to protect sensitive information and ensure compliance with company policies.Stay updated with the latest industry trends and technologies to continuously improve our data processing capabilities.Document technical solutions and processes to facilitate knowledge sharing within the team.Participate in team meetings and contribute to project planning and progress discussions.Ensure that all development work aligns with the companys goals and contributes to its mission of delivering high-quality data solutions.
Qualifications
Possess strong expertise in PySpark for developing and optimizing data pipelines.Have extensive experience with Snowflake for designing and managing data storage solutions.Demonstrate proficiency in troubleshooting and resolving data processing issues.Show ability to collaborate effectively with cross-functional teams.Exhibit strong problem-solving skills and attention to detail.Have excellent communication skills to provide technical guidance and support.Stay updated with industry trends and continuously seek to improve technical skills.Possess a proactive approach to identifying and addressing performance bottlenecks.Demonstrate commitment to maintaining code quality and consistency.Show ability to document technical solutions and processes clearly.Have a strong understanding of data security measures and compliance requirements.Exhibit a passion for delivering high-quality data solutions that meet business needs.Demonstrate a commitment to contributing to the companys mission and goals.
Certifications Required
Certified Snowflake SnowPro Core Databricks Certified Associate Developer for Apache Spark
