Job Summary
We are seeking an experienced Architect with 10 to 14 years of experience to join our team. The ideal candidate will have a strong background in Databricks SQL Databricks Workflows and PySpark. This hybrid role offers the opportunity to work on innovative projects that drive our companys success and positively impact society.
Responsibilities
Lead the design and implementation of data architecture solutions using Databricks SQL and Databricks WorkflowsOversee the development and optimization of PySpark applications to ensure efficient data processingProvide technical guidance and mentorship to team members on best practices for using Databricks and PySparkCollaborate with cross-functional teams to gather requirements and translate them into scalable data solutionsEnsure data integrity and security by implementing robust data governance policiesConduct performance tuning and troubleshooting to maintain optimal system performanceDevelop and maintain documentation for data architecture and workflowsStay updated with the latest industry trends and technologies to continuously improve our data solutionsParticipate in code reviews to ensure high-quality code and adherence to standardsWork closely with stakeholders to understand business needs and deliver data solutions that drive valueContribute to the development of data strategies and roadmaps to support long-term business goalsMonitor and manage data pipelines to ensure timely and accurate data deliveryProvide support and troubleshooting for data-related issues in a timely manner
Qualifications
Extensive experience with Databricks SQL and Databricks WorkflowsStrong proficiency in PySpark for data processing and analysisProven ability to design and implement scalable data architecture solutionsExcellent problem-solving skills and attention to detailStrong communication and collaboration skillsExperience with data governance and security best practicesFamiliarity with performance tuning and optimization techniquesAbility to mentor and guide team members on technical topicsKnowledge of industry trends and emerging technologies in data engineeringExperience with documentation and code review processesAbility to work in a hybrid work model and manage time effectivelyStrong understanding of business requirements and ability to translate them into technical solutionsCommitment to delivering high-quality data solutions that drive business value.
Certifications Required
Databricks Certified Data Engineer Associate Apache Spark Developer Certification