Generative AI Lead Engineer - Vice President

Discover your future at Citi

Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.

Job Overview

Responsibilities:

• Design, prototype, and implement Generative AI applications, ensuring robust, scalable, and secure solutions.
• LangChain & Orchestration: Drive the practical implementation and advanced utilization of LangChain (or similar orchestration frameworks) for building complex LLM applications, managing conversational flows, agentic behaviors, and tool integration.
• Vector Databases: Architect, select, and manage vector databases (e.g., Pinecone, Weaviate, Chroma, Milvus) for efficient similarity search, RAG (Retrieval Augmented Generation), and knowledge management, ensuring optimal performance and data freshness.
• LLM Validation & Evaluation: Establish and implement rigorous methodologies for the validation, testing, and continuous evaluation of LLMs (e.g., perplexity, factual consistency, safety, bias, performance metrics, A/B testing of prompt variations). Develop automated pipelines for tracking and reporting LLM performance.
• Practical LLM Platform Knowledge: Demonstrate and apply deep practical knowledge of various LLM platforms and versions (e.g., Gemini, OpenAI GPT-3.5/4, open-source models like Llama 2, Mistral). This includes understanding their respective strengths, limitations, APIs, fine-tuning capabilities, and cost implications.
• Expertise in AI  and Machine learning algorithms and related business usecases/applications
• Architecture Implementation: Lead the practical implementation of end-to-end architectures for Generative AI use cases, encompassing data ingestion, pre-processing, model serving, prompt engineering, RAG pipelines, output post-processing, and integration with existing enterprise systems.
• Provide expert-level guidance on Generative AI best practices, model selection, and prompt engineering techniques.
• Work with cross-functional teams in the practical application of LangChain, vector databases, and LLM evaluation.

Qualifications:

• 12 - 14 years of relevant experience in the Financial Service industry
• Experience as Applications Development Lead/manager
• Competent in Gen AI skills
• Expertise in prompt engineering / Open AI / Vertex models
• Stakeholder and people management experience
• Demonstrated leadership skills
• Proven project management skills
• Basic knowledge of industry practices and standards
• Consistently demonstrates clear and concise written and verbal communication

Education:

• Bachelor’s degree/University degree or equivalent experience
• Master’s degree preferred