Agent Orchestration: Architect and implement multi-agent workflows using frameworks such as LangGraph, AutoGen, or CrewAI, ensuring alignment with real-world use cases
Platform Development: Design and build resilient, scalable, multi-tenant AI platforms that support continuous innovation and production deployment
Evaluation & Benchmarking: Own the design and implementation of LLM and agent evaluation frameworks, including metrics for accuracy, hallucination, safety, and performance
Performance Optimization: Optimize system architecture and infrastructure for scalability, latency, and cost-efficiency across AI workloads
Best Practices: Establish and enforce standards across MLOps, AIOps, CI/CD, model versioning, experimentation tracking, and system observability
Leadership & Mentorship: Provide technical leadership, guide architectural decisions, and mentor engineering teams to ensure high-quality delivery
Innovation & Research: Stay updated with advancements in AI, LLMs, and agentic frameworks, continuously improving system capabilities
Documentation: Create and maintain comprehensive architectural and technical documentation
Required Skills & Qualifications
12+ years of experience in software engineering with strong expertise in Python and backend system development
Extensive experience in designing scalable, secure, multi-tenant AI/ML platforms
Deep expertise in LLMs (OpenAI, Gemini, Anthropic, Llama) and agentic AI systems
Hands-on experience with agent frameworks such as AutoGen, CrewAI, LangGraph, and LangChain ecosystem (LangChain, LangSmith, LangFlow)
Strong experience building RAG-based systems and working with vector databases
Proficiency in Python ecosystem including PyTorch, Scikit-learn, LlamaIndex, and evaluation tools like DeepEval
Deep understanding of LLM concepts (prompt engineering, fine-tuning, function/tool calling, RAG)
Strong experience in microservices architecture, REST APIs, and event-driven systems
Expertise in relational (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Redis)
Experience with cloud platforms (AWS, Azure, GCP) and cloud-native architectures
Familiarity with Docker, Kubernetes, and modern DevOps practices
Experience with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions)
Strong exposure to observability tools for logging, monitoring, and tracing AI systems
Strong understanding of system design, scalability, and engineering best practices
Proven ability to lead architectural discussions, mentor teams, and engage with stakeholders and clients
Compensation, Benefits and Duration
Minimum Compensation: USD 46,000
Maximum Compensation: USD 162,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post.
