Job Summary
We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. This role requires working from the office during day shifts. The candidate will play a crucial role in developing and optimizing data workflows to support our business objectives.
Responsibilities
Develop and optimize data workflows using Databricks SQL and Databricks Workflows to support business objectives.Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet those needs.Implement and maintain PySpark applications to process large datasets efficiently.Ensure data quality and integrity by performing regular data validation and testing.Provide technical guidance and support to junior developers and team members.Monitor and troubleshoot data workflows to ensure smooth and efficient operations.Participate in code reviews to maintain high standards of code quality and performance.Stay updated with the latest industry trends and best practices in data engineering and big data technologies.Contribute to the continuous improvement of development processes and methodologies.Document technical specifications and maintain comprehensive project documentation.Communicate effectively with stakeholders to provide updates on project progress and address any issues.Ensure compliance with data security and privacy regulations in all data workflows.Support the deployment and maintenance of data infrastructure in the production environment.
Qualifications
Must have strong experience with Databricks SQL and Databricks Workflows.Must be proficient in PySpark and have experience with large-scale data processing.Should have excellent problem-solving skills and attention to detail.Should have strong communication and collaboration skills.Nice to have experience with cloud platforms such as AWS or Azure.Nice to have experience with data visualization tools.Should be able to work independently and as part of a team.Must be able to work from the office during day shifts.Should have a proactive approach to learning and staying updated with new technologies.Must have a strong understanding of data security and privacy regulations.Should have experience with version control systems like Git.Nice to have experience with Agile development methodologies.
Certifications Required
Databricks Certified Data Engineer Associate AWS Certified Big Data Specialty
