Writes evaluations for agent behaviour (offline test sets, regression suites in CI/CD, LLM-as-judge checks) and instruments services with OpenTelemetry tracing
Applies enterprise-authorized AI-assisted development tools to improve code quality and delivery speed, validating AI outputs for correctness, performance, and security
Identifies opportunities to eliminate or automate remediation of recurring issues to improve the operational stability of agents and model services
Adds to team culture of diversity, opportunity, inclusion, and respect
Required qualifications, capabilities, and skills
Formal training or certification on software engineering concepts and applied experience
Hands-on practical experience in system design, application development, testing, and operational stability
Strong hands-on development experience in Python and/or Java, and ability to code in one or more additional languages (e.g., TypeScript, SQL)
Strong understanding of concurrency and parallelism — multithreading, processes, worker pools, and task queues — and of distributed computation across multiple nodes
Experience building and consuming APIs and event-driven services in a cloud environment
Experience with data processing frameworks such as Apache Spark, and working with large structured datasets
Working knowledge of how LLM-based applications are built: prompting, tool calling, retrieval, and evaluation
Experience using approved AI-assisted software development tools, with sound judgement on validating their outputs
Understanding of responsible AI use in engineering workflows, including data sensitivity and secure handling of inputs and outputs
Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
Practical cloud native experience (AWS preferred), including containers and Kubernetes
Preferred qualifications, capabilities, and skills
Experience with agent frameworks (e.g., Google ADK, LangGraph) and agent protocols such as MCP, A2A, or AG-UI
Experience with Databricks, MLflow, and Delta Lake or Apache Iceberg
Exposure to model serving on Kubernetes and to model monitoring (drift, latency, accuracy)
Familiarity with CRM platforms such as Salesforce and their APIs
Exposure to payments, commercial card, or supplier onboarding (KYC) processes
Familiarity with Terraform and infrastructure as code