Skill: Azure Databricks
Experience: 6 to 9 years
Location: AIA Kochi
Job Summary
The Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and offers a day shift schedule with no travel requirements.
Responsibilities
- Develop and maintain scalable data processing solutions using Kafka Python and PySpark to enhance data flow and analytics capabilities.
- Collaborate with cross-functional teams to design and implement Databricks Workflows that streamline data operations and improve efficiency.
- Utilize Databricks SQL to perform complex data queries and generate actionable insights for business stakeholders.
- Ensure data integrity and quality by implementing robust data validation and error-handling mechanisms.
- Optimize existing data pipelines for performance and scalability ensuring they meet the evolving needs of the organization.
- Provide technical guidance and support to junior developers fostering a culture of continuous learning and improvement.
- Participate in code reviews and contribute to the development of best practices and coding standards.
- Work closely with product managers and business analysts to understand requirements and translate them into technical solutions.
- Monitor and troubleshoot data processing systems to ensure high availability and reliability.
- Stay updated with the latest industry trends and technologies to drive innovation and maintain a competitive edge.
- Document technical specifications and system designs to facilitate knowledge sharing and collaboration.
- Engage in regular team meetings to discuss project progress challenges and opportunities for improvement.
- Contribute to the companys purpose by developing solutions that enhance operational efficiency and deliver value to society.