Testing & Evaluation: Develop testing strategies and evaluation frameworks to measure agent accuracy, reliability, performance, and overall effectiveness.
Performance Optimization: Optimize AI workflows, token utilization, model selection, and infrastructure to improve latency and cost efficiency.
Required Skills & Qualifications
6–9 years of experience in software development with strong expertise in Python.
Hands-on experience with Python frameworks such as FastAPI, Flask, or Django.
Strong experience in developing REST APIs, microservices, and backend applications.
Experience working with Agentic AI frameworks such as LangGraph, CrewAI, AutoGen, Agent Development Kit (ADK), or similar technologies.
Experience building and supporting RAG-based applications and AI-powered solutions.
Hands-on experience with LangChain, LlamaIndex, LangSmith, or LangFlow.
Working knowledge of LLMs including OpenAI, Gemini, Anthropic, Llama, or equivalent models.
Strong understanding of prompt engineering, function calling, tool integration, and agent orchestration patterns.
Experience with vector databases such as Pinecone, Weaviate, Chroma, or Milvus.
Proficiency in relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Redis).
Experience with cloud platforms such as AWS, Azure, or GCP.
Familiarity with Docker, Kubernetes, and containerized application deployments.
Experience working with CI/CD pipelines and tools such as Jenkins, GitHub Actions, or GitLab CI.
Compensation, Benefits and Duration
Minimum Compensation: USD 35,000
Maximum Compensation: USD 123,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post