Job Summary
We are seeking a Sr. Developer with 5 to 8 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Payer domain is a plus. This hybrid role requires working in a day shift with no travel requirements. The candidate will play a crucial role in developing and optimizing data solutions to drive our companys success.
Responsibilities
Develop and optimize data solutions using Databricks SQL to ensure efficient data processing and analysis.Implement and manage Databricks Workflows to automate data pipelines and improve operational efficiency.Utilize PySpark to build scalable and high-performance data processing applications.Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.Ensure data quality and integrity by implementing robust data validation and cleansing processes.Monitor and troubleshoot data workflows to identify and resolve issues promptly.Provide technical guidance and support to junior developers and team members.Stay updated with the latest industry trends and best practices in data engineering and analytics.Contribute to the continuous improvement of development processes and methodologies.Participate in code reviews to maintain high standards of code quality and performance.Document technical solutions and processes to ensure knowledge sharing and maintainability.Work closely with stakeholders to deliver data solutions that meet business needs and drive decision-making.Ensure compliance with data security and privacy regulations in all data processing activities.
Qualifications
Possess strong expertise in Databricks SQL for efficient data processing and analysis.Have extensive experience with Databricks Workflows to automate and optimize data pipelines.Demonstrate proficiency in PySpark for building scalable data processing applications.Experience in the Payer domain is a plus providing valuable insights into industry-specific data challenges.Exhibit excellent problem-solving skills and the ability to troubleshoot complex data workflows.Show strong collaboration skills to work effectively with cross-functional teams and stakeholders.
Certifications Required
Databricks Certified Data Engineer Associate Apache Spark Developer Certification
