Job Summary
We are seeking an experienced Architect with 10 to 12 years of experience to join our team. The ideal candidate will have strong technical skills in Kafka Databricks SQL Databricks Workflows and PySpark. This hybrid role offers the opportunity to work on cutting-edge projects driving innovation and efficiency within our organization. The position requires no travel and operates during day shifts. Knowledge on Dremio is additional Add on
Responsibilities
Design and implement scalable data architectures using Kafka Databricks SQL Databricks Workflows and PySpark.Oversee the development and deployment of data pipelines to ensure efficient data processing and integration.Collaborate with cross-functional teams to understand data requirements and provide technical solutions.Provide technical guidance and mentorship to junior team members to enhance their skills and knowledge.Ensure data quality and integrity by implementing robust data validation and monitoring processes.Optimize data workflows and processes to improve performance and reduce latency.Conduct regular code reviews to maintain high standards of code quality and best practices.Develop and maintain comprehensive documentation for data architectures and workflows.Troubleshoot and resolve technical issues related to data processing and integration.Stay updated with the latest industry trends and technologies to continuously improve our data solutions.Participate in project planning and provide accurate estimates for development tasks.Communicate effectively with stakeholders to ensure alignment on project goals and deliverables.Contribute to the overall success of the company by driving innovation and efficiency in data management.
Qualifications
Possess strong technical skills in Kafka Databricks SQL Databricks Workflows and PySpark.Have a minimum of 10 years of experience in data architecture and engineering.Demonstrate excellent problem-solving and analytical skills.Exhibit strong communication and collaboration abilities.Show proficiency in designing and implementing scalable data solutions.Have experience in optimizing data workflows and processes.Be capable of mentoring and guiding junior team members.Maintain a proactive approach to learning and staying updated with industry trends.Display a strong commitment to data quality and integrity.Be able to work effectively in a hybrid work model.Have a track record of successful project delivery.Show ability to document technical solutions comprehensively.Demonstrate experience in troubleshooting and resolving technical issues.
Certifications Required
Certified Apache Kafka Developer Databricks Certified Associate Developer for Apache Spark Databricks Certified Professional Data Engineer
