Job Summary
We are seeking a skilled Developer with 3 to 5 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. This role is based in the office and operates during day shifts. The candidate will contribute to the development and optimization of data solutions ensuring high performance and reliability.
Responsibilities
Develop and maintain data solutions using Databricks SQL to ensure efficient data processing and querying.Implement and manage Databricks Workflows to automate data pipelines and ensure seamless data integration.Utilize PySpark to build and optimize large-scale data processing applications.Collaborate with data engineers and analysts to understand data requirements and deliver solutions that meet business needs.Ensure data quality and integrity by implementing robust validation and testing procedures.Monitor and troubleshoot data workflows to identify and resolve issues promptly.Optimize data processing performance to enhance system efficiency and reduce processing times.Provide technical support and guidance to team members on Databricks and PySpark-related tasks.Document data solutions and workflows to ensure knowledge sharing and maintain project transparency.Stay updated with the latest advancements in Databricks and PySpark technologies to incorporate best practices.Participate in code reviews to ensure code quality and adherence to standards.Contribute to the continuous improvement of data processes and workflows.Communicate effectively with stakeholders to understand project requirements and deliver solutions that align with business goals.
Qualifications
Must have strong experience with Databricks SQL for efficient data querying and processing.Must have hands-on experience with Databricks Workflows for automating data pipelines.Must be proficient in PySpark for building and optimizing large-scale data processing applications.Nice to have experience with data validation and testing procedures to ensure data quality.Nice to have experience in troubleshooting and optimizing data workflows for enhanced performance.Nice to have excellent communication skills to collaborate with team members and stakeholders.Nice to have a proactive approach to staying updated with the latest data technologies and best practices.
Certifications Required
Databricks Certified Associate Developer for Apache Spark Databricks Certified Data Engineer Associate
