Job Summary
We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our team in the Asset & Wealth Management domain. The ideal candidate will have expertise in Spark Streaming Kafka Kafka Connect and Python. This role is hybrid and requires working during the day shift. The candidate will play a crucial role in developing and maintaining our data streaming and processing systems.
Responsibilities
- Develop and maintain data streaming applications using Spark Streaming to ensure real-time data processing.
- Implement and manage Kafka and Kafka Connect to facilitate seamless data integration and streaming.
- Write efficient and scalable Python code to support data processing and analytics tasks.
- Collaborate with cross-functional teams to gather requirements and design solutions that meet business needs.
- Ensure the reliability and performance of data streaming systems through continuous monitoring and optimization.
- Troubleshoot and resolve issues related to data streaming and processing in a timely manner.
- Provide technical guidance and mentorship to junior developers to foster their growth and development.
- Participate in code reviews to maintain code quality and ensure best practices are followed.
- Stay updated with the latest industry trends and technologies to continuously improve the data streaming infrastructure.
- Work closely with stakeholders in the Asset & Wealth Management domain to understand their requirements and deliver solutions that drive business value.
- Document technical designs processes and procedures to ensure knowledge sharing and maintain system integrity.
- Contribute to the overall architecture and design of the data streaming platform to ensure scalability and robustness.
- Collaborate with DevOps teams to automate deployment and monitoring processes for data streaming applications.
Qualifications
- Must have strong experience in Spark Streaming for real-time data processing.
- Must have expertise in Kafka and Kafka Connect for data integration and streaming.
- Must be proficient in Python for data processing and analytics tasks.
- Must have experience in the Asset & Wealth Management domain to understand business requirements.
- Nice to have experience with cloud platforms such as AWS or Azure.
- Nice to have experience with containerization technologies like Docker and Kubernetes.