Job Summary
We are seeking a skilled Developer with 3 to 5 years of experience to join our team. The ideal candidate will have expertise in Databricks PySpark and Azure Data Factory. This role requires working from the office during day shifts. The candidate will be responsible for developing and maintaining data solutions that drive our business forward.
Responsibilities
Develop and maintain data pipelines using Databricks PySpark and Azure Data Factory to ensure efficient data processing and integration.Collaborate with data engineers and analysts to understand data requirements and translate them into technical solutions.Optimize and troubleshoot existing data workflows to improve performance and reliability.Implement best practices for data management including data quality data governance and data security.Provide technical support and guidance to team members on data-related projects and initiatives.Monitor and maintain data infrastructure to ensure high availability and scalability.Participate in code reviews and contribute to the continuous improvement of the development process.Stay updated with the latest industry trends and technologies to ensure our data solutions remain cutting-edge.Work closely with stakeholders to gather requirements and deliver data solutions that meet business needs.Document data workflows processes and technical specifications for future reference.Ensure compliance with company policies and regulatory requirements in all data-related activities.Contribute to the development of data strategies and roadmaps to support long-term business goals.Collaborate with cross-functional teams to deliver integrated data solutions that drive business value.
Qualifications
Possess strong experience in Databricks PySpark and Azure Data Factory.Demonstrate proficiency in developing and maintaining data pipelines.Exhibit excellent problem-solving and troubleshooting skills.Show ability to work collaboratively in a team environment.Have strong communication skills to effectively interact with stakeholders.Display knowledge of data management best practices.Hold a Bachelors degree in Computer Science Information Technology or a related field.Have experience with data quality data governance and data security practices.Show commitment to continuous learning and staying updated with industry trends.Demonstrate ability to document technical processes and workflows.Possess a proactive approach to identifying and addressing data-related issues.Exhibit strong organizational skills and attention to detail.Have experience with code reviews and development process improvements.
Certifications Required
Azure Data Engineer Associate Databricks Certified Associate Developer for Apache Spark