Appsierra
From Appsierra's careers page
Status: listed on the employer's own careers page when we last checked (daily). Confirm on their site before applying.
What you will deliver Activities will vary from service to service.
Role: AI Engineer/Developer
Language: French OR Dutch
The AI Platform runs on a hybrid operating model: managed Azure services (Microsoft Foundry with the OpenAI model family for LLM and embeddings, Azure AI Search, Azure API Management, Azure AI Content Safety) combined with self-hosted open-source components on AKS (agent orchestration in Python with LangChain, ingestion pipeline), with MLflow on Databricks for evaluation and tracing (OpenTelemetry). The Digital Innovation / AI CoE team owns Infrastructure-as-Code for all application-scoped Azure resources, using Terraform and Azure DevOps pipelines.
operate the AI services in production: monitor availability, latency and errors, handle incidents and service requests, analyse root causes, then fix or escalate ;
keep answer quality under control: run and maintain evaluation sets (golden sets) with business content owners, track answer quality, non-answer rate and user feedback, and detect and investigate quality regressions ;
operate the ingestion pipelines: incremental refresh, failed documents, index health, and onboarding of new content sources or business domains within existing connectors ;
operate agent integrations: monitor tool and integration calls to business systems, handle failures and timeouts, and review action logs and exceptions for agents that act on users’ behalf ;
manage change safely: model version upgrades and retirements, prompt and configuration changes, dependency and security updates, each validated against the evaluation sets before release ;
follow run cost: token consumption and cost per service, alerting on drift and proposing optimisations ;
maintain the Terraform, Helm and Azure DevOps artefacts, and keep the DEV, TST, ACC and PROD environments consistent ;
apply data protection rules: trace retention, erasure and access restrictions, as defined in each service’s data protection impact assessment ;
maintain runbooks and documentation, and report service health to service owners and the AI CoE on a regular basis ;
deliver small enhancements and fixes; structural changes and new features stay with the Build team.
Interested? Apply now at jobs@phoenix-tech.eu
Scores your resume against this job the way resume scanners do: the job's hard and soft skills, searchability, recruiter tips and formatting.
Create a free account to see your score. Your resume stays in this browser until then, and we never store it.
Already a member? Sign in