OnJob.io
AI Engineer/Developer
Phoenix Technologies
Sponsorship not confirmed
You apply on the original listing. Flieva never charges you to apply and never asks for payment for a job.
About the job
Role: AI Engineer/Developer Location: Brussels BE Language: French OR Dutch The AI Platform runs on a hybrid operating model: managed Azure services (Microsoft Foundry with the OpenAI model family for LLM and embeddings, Azure AI Search, Azure API Management, Azure AI Content Safety) combined with self-hosted open-source components on AKS (agent orchestration in Python with LangChain, ingestion pipeline), with MLflow on Databricks for evaluation and tracing (OpenTelemetry). The Digital Innovation / AI CoE team owns Infrastructure-as-Code for all application-scoped Azure resources, using Terraform and Azure DevOps pipelines. What you will deliver Activities will vary from service to service. Typically you will: operate the AI services in production: monitor availability, latency and errors, handle incidents and service requests, analyse root causes, then fix or escalate ; keep answer quality under control: run and maintain evaluation sets (golden sets) with business content owners, track answer quality, non-answer rate and user feedback, and detect and investigate quality regressions ; operate the ingestion pipelines: incremental refresh, failed documents, index health, and onboarding of new content sources or business domains within existing connectors ; operate agent integrations: monitor tool and integration calls to business systems, handle failures and timeouts, and review action logs and exceptions for agents that act on users’ behalf ; manage change safely: model version upgrades and retirements, prompt and configuration changes, dependency and security updates, each validated against the evaluation sets before release ; follow run cost: token consumption and cost per service, alerting on drift and proposing optimisations ; maintain the Terraform, Helm and Azure DevOps artefacts, and keep the DEV, TST, ACC and PROD environments consistent ; apply data protection rules: trace retention, erasure and access restrictions, as defined in each service’s data protection impact assessment ; maintain runbooks and documentation, and report service health to service owners and the AI CoE on a regular basis ; deliver small enhancements and fixes; structural changes and new features stay with the Build team. Interested? Apply now at [email protected]
More jobs like this
Commercial Growth Project Manager (m/w/d)CrewmeisterMunich · GermanySponsorship stated in listingPrincipal Engineer, PrivacyAnthropicRemote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY · United StatesSponsorship stated in listingProduct EngineerStratosLondon · United KingdomSponsorship stated in listingForward Deployed Engineer (Graduate)StratosLondon · United KingdomSponsorship stated in listing
Flieva