Data by YubHub
Product Manager - AI Evaluations and Governance
Royal Bank of Canada (RBC)
Sponsorship not confirmed
You apply on the original listing. Flieva never charges you to apply and never asks for payment for a job.
About the job
Deploying AI at scale in Canada's largest bank is the opportunity of a lifetime. This role focuses on one of the most critical enablers of AI at RBC, connecting deep evaluation of agents' performance and accuracy with the risk-based governance that allows AI to be enabled for safe use. Own product strategy for the evaluations and governance capabilities that let the bank build and scale agentic AI responsibly , the layer that assesses AI system quality and safety before and after deployment, and turns those assessments into risk and compliance reporting that business leaders across the bank can act on. Responsibilities: Product Strategy & Roadmap Own end-to-end product strategy and a multi-year roadmap for the evaluations and governance capability area, prioritized against business risk, regulatory need, and platform adoption Lead discovery and requirements definition, translating input from engineering, risk, compliance, and business stakeholders into clear product requirements Own portfolio-level prioritization and sequencing across the capability area's roadmap, balancing near-term regulatory/compliance needs against longer-term platform investment Evaluate build-vs-buy-vs-partner options for evaluation and governance tooling, weighing internal investment against third-party solutions Delivery Partnership Partner with engineering and architecture leadership on feasibility, sequencing, and trade-offs, converging on a plan both sides can commit to Work with the project-management function to convert prioritized requirements into a funded, scheduled program of work Stay engaged through delivery, resolving product-scope questions and re-planning trade-offs as they arise Stakeholder & Business Engagement Represent the capability area to risk, audit, and compliance stakeholders across the bank's business lines Serve as the primary product voice to senior leadership on the health and trajectory of the capability area Represent product considerations within architecture reviews, governance forums, and vendor evaluations Partner with adjacent product and engineering leaders across the platform so requirements are considered early, not retrofitted later Launch & Value Input Help define value messaging and target user personas for the capability area's launches, in partnership with your peer Principal for go-to-market Define and track success metrics for the capability area and use them to inform ongoing prioritization Contribute the capability area's inputs into the broader business case articulating value delivered People Leadership Build, mentor, and lead a team of product managers focused on evaluations and governance, giving them ownership of their individual areas Help your team apply consistent discovery, prioritization, and delivery practices as they build out their own areas Foster a culture of iterative delivery, understanding of user needs, and decision-making backed by data Requirements: Must-have: 10+ years of product management experience, including several years focused on risk, compliance, safety, or governance-oriented technology products or services Demonstrated experience delivering production AI/ML systems in an enterprise environment, including hands-on experience with LLM API integration (e.g., Anthropic Claude, OpenAI, Azure OpenAI, or equivalent) and direct ownership of how those systems are tested, evaluated, or monitored for quality and risk Experience operating in a regulated industry (e.g., financial services, healthcare, government) with direct exposure to audit and regulatory review processes Strong technical foundation , able to engage credibly with engineers and architects on system design, API integration patterns (authentication, rate limiting, observability), data pipelines, and vector database/retrieval-augmented generation (RAG) architecture as it relates to evaluating AI system outputs Excellent communication skills, with proven ability to represent a complex technical and risk-related agenda cred
More jobs like this
Beach Street Station This link will open in a new window is hiring Line Cook with LMIALMIA.CAOntario, CanadaSponsorship stated in listingFood Packing Jobs in Canada with Visa SponsorshipThe Elite JobCalgary, Alberta, CanadaSponsorship stated in listingVisa Sponsorship Caregiver Jobs In Canada For ForeignersThe Elite JobCanadaSponsorship stated in listingAI Security Expert: securing an LLM platform, legaltech startup, Montréal (hybrid)AbbealMontréal, QC · CanadaSponsorship stated in listing
Flieva