Job Summary
We are seeking a Sr. Developer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have strong expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This hybrid role offers the flexibility of working both remotely and on-site during day shifts. No travel is required.
Responsibilities
- Develop and maintain scalable data pipelines using Databricks SQL and Databricks Workflows.
- Collaborate with cross-functional teams to design and implement data solutions that meet business requirements.
- Optimize and troubleshoot PySpark applications to ensure high performance and reliability.
- Provide technical guidance and mentorship to junior developers on best practices and coding standards.
- Conduct code reviews to ensure code quality and adherence to development standards.
- Implement data security and privacy measures to protect sensitive information.
- Work closely with stakeholders to gather and analyze requirements for new data projects.
- Create and maintain comprehensive documentation for data processes and workflows.
- Monitor and manage data pipeline performance making necessary adjustments to improve efficiency.
- Stay updated with the latest industry trends and technologies to continuously improve data solutions.
- Participate in agile development processes including sprint planning daily stand-ups and retrospectives.
- Ensure data quality and integrity by implementing robust validation and testing procedures.
- Collaborate with the DevOps team to automate deployment and monitoring of data solutions.
Qualifications
- Possess strong expertise in Databricks SQL and Databricks Workflows.
- Demonstrate proficiency in PySpark for developing and optimizing data applications.
- Have experience in the Cards & Payments domain which is a plus.
- Exhibit excellent problem-solving skills and attention to detail.
- Show ability to work effectively in a hybrid work model.
- Display strong communication and collaboration skills.