AVP - Bigdata Engineer (Spark/Scala/ Java)

The Applications Development Sr Programmer Analyst is responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.

Responsibilities:

• Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
• Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
• Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
• Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
• As a key member of our team, you'll play a vital role in developing and maintaining the systems that power near real-time / Batch, information retrieval (IR), and grounding (RAG) services
• Design and build highly scalable web crawling and data extraction systems capable of acquiring structured and Unstructured data across Citi systems efficiently
• Continuously optimize the data extraction architecture to ensure peak performance, scalability, resilience, and cost-effectiveness
• Develop robust systems to process vast volumes and extract meaningful insights through advanced data processing techniques
• Design and implement high-throughput data pipelines and infrastructure to handle petabyte-scale datasets seamlessly
• Continuously explore and implement innovative solutions to complex technical challenges, pushing the boundaries of what's possible in data storage and processing.
• Drive adoption of capabilities across regions by partnering with regional business and technology teams
• Develop approaches to integrate data into the DataHub (EAP) and prototype methods of developing insights on that data with our business analytics teams and digital product teams.
• Must Have Skills
  • Hadoop
  • Spark
  • Oracle
  • CICD
  • Light speed
  • OpenShift
  • Java
  • Microservices

Qualifications:

• 8+ years of relevant experience in Apps Development or systems analysis.
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 5+ years in technology/engineering roles within medium to large financial enterprises
• Subject Matter Expert (SME) in at least one area of Applications Development
• Consistently demonstrates clear and concise written and verbal communication
• Experience with Python, analytic methods and frameworks is a plus.
• Experience with real-time streaming and stream processing frameworks is a plus
• Prior experience in financial industry is a must.
•  Proven ability to assist in attracting, developing, engaging and sustaining world-class engineering/technical talent; foster a culture of innovation and excellence.

Education:

• Bachelor’s degree/University degree or equivalent experience
• Master’s degree preferred