RAG Implementation: Construct and refine Retrieval-Augmented Generation (RAG) pipelines, including document ingestion, embedding, and vector search integration with databases like Azure AI Search or Pinecone.
Containerization & Deployment: Package AI services using Docker and deploy them on Kubernetes, contributing to CI/CD pipelines for smooth and reliable releases.
Observability & Evaluation: Instrument AI workflows using platforms like Langfuse for tracing and debugging. Implement and maintain evaluation harnesses to ensure model quality and performance.
Qualifications
6+ years of professional experience in a role blending software development and data science/machine learning.
Expert-level Python development skills and a proven track record of designing and building scalable backend services and APIs (FastAPI preferred).
Deep, hands-on experience designing and building solutions with multiple agentic frameworks (e.g., LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel).
Extensive experience architecting and optimizing RAG systems and integrating with vector databases (e.g., OpenSearch, Pinecone, Weaviate).
Proven expertise in designing and deploying containerized (Docker/Kubernetes) AI systems on a major cloud platform (AWS, Azure, or GCP).
Strong experience implementing MLOps principles, including CI/CD, observability, and evaluation frameworks for LLM-based systems.
In-depth understanding of AI risk, safety, and enterprise governance requirements.
Strong background in ML, deep learning, and NLP, including Transformer architectures.
Preferred Qualifications
Experience leading the design of LLM evaluation harnesses for automated release validation.
Deep experience with Langfuse or similar AI observability and tracing platforms.
Hands-on expertise with AWS Bedrock, Azure AI Foundry, or GCP Vertex AI.
Knowledge of GraphRAG patterns and advanced multi-hop retrieval strategies.
AWS certifications (e.g., Solutions Architect, AI/ML Specialty) or equivalent.
Background in financial services or another highly regulated industry.
Job Family Group
Risk Management
Job Family
Model Development and Analytics
Time Type
Full time
- Most Relevant Skills
- Analytical Thinking, Credible Challenge, Data Analysis, Governance, Policy, Procedure, and Regulation, Risk Management Lifecycle.
- Other Relevant Skills
- For complementary skills, please see above and/or contact the recruiter.
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.