Job Summary
We are seeking an experienced Architect with 10 to 14 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role requires working from the office during day shifts. The Architect will play a crucial role in designing and implementing data solutions that drive our companys success.
Responsibilities
Lead the design and implementation of data solutions using Databricks SQL Databricks Delta Lake and Databricks Workflows.Oversee the development and optimization of PySpark applications to ensure high performance and scalability.Provide technical guidance and mentorship to junior team members to foster their growth and development.Collaborate with cross-functional teams to gather and analyze requirements ensuring data solutions align with business objectives.Develop and maintain data pipelines and workflows to support data integration and transformation processes.Ensure data quality and integrity by implementing robust data validation and monitoring processes.Conduct performance tuning and optimization of data solutions to meet SLAs and improve efficiency.Stay updated with the latest industry trends and best practices in data engineering and architecture.Participate in code reviews and provide constructive feedback to maintain high coding standards.Document technical designs processes and procedures to ensure knowledge sharing and continuity.Troubleshoot and resolve complex technical issues related to data solutions and workflows.Contribute to the continuous improvement of data architecture and engineering practices within the organization.Engage with stakeholders to understand their data needs and provide solutions that drive business value.
Qualifications
Must have strong experience in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark.Nice to have experience with other big data technologies and cloud platforms.Must possess excellent problem-solving and analytical skills.Nice to have strong communication and collaboration abilities.Must have a proven track record of delivering high-quality data solutions.Nice to have experience in mentoring and guiding junior team members.Must be detail-oriented and committed to maintaining data integrity.Nice to have familiarity with agile methodologies and practices.Must be able to work independently and as part of a team.Nice to have a proactive attitude towards learning and adopting new technologies.Must have a strong understanding of data architecture principles and best practices.Nice to have experience in performance tuning and optimization of data solutions.Must be able to document technical designs and processes clearly and concisely.
Certifications Required
Databricks Certified Data Engineer Associate or equivalent certification.
