Job Summary
We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our team. The ideal candidate will have expertise in Python Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role requires working from the office during day shifts. The candidate will play a crucial role in developing and optimizing data workflows and ensuring data integrity.
Responsibilities
Develop and maintain scalable data pipelines using Python and PySpark.Optimize and manage Databricks SQL queries to ensure efficient data retrieval.Implement and manage Databricks Delta Lake for data storage and processing.Design and execute Databricks Workflows to automate data processing tasks.Collaborate with data engineers and analysts to understand data requirements and deliver solutions.Ensure data quality and integrity through rigorous testing and validation.Monitor and troubleshoot data workflows to ensure smooth operations.Provide technical guidance and support to junior developers and team members.Document data workflows processes and best practices for future reference.Stay updated with the latest industry trends and technologies to continuously improve data solutions.Participate in code reviews to maintain high code quality standards.Work closely with stakeholders to gather requirements and deliver data solutions that meet business needs.Contribute to the overall success of the team by sharing knowledge and expertise.
Qualifications
Possess strong experience in Python programming for data processing.Have in-depth knowledge of Databricks SQL for efficient data querying.Demonstrate expertise in Databricks Delta Lake for data storage and processing.Show proficiency in designing and managing Databricks Workflows.Exhibit strong skills in PySpark for large-scale data processing.Have excellent problem-solving and troubleshooting abilities.Display strong communication and collaboration skills.Be detail-oriented with a focus on data quality and integrity.Have a proactive approach to learning and staying updated with new technologies.Show ability to work independently and as part of a team.Possess a strong understanding of data engineering principles.Demonstrate experience in working with large datasets and optimizing data workflows.Have a bachelors degree in Computer Science Engineering or a related field.
Certifications Required
Databricks Certified Associate Developer for Apache Spark Python Certification
