Data by YubHub
Technical Product Leader - AI Quality and Evaluation
Salesforce
Sponsorship not confirmed
You apply on the original listing. Flieva never charges you to apply and never asks for payment for a job.
About the job
We are looking for a technical product leader with deep AI expertise to help build the next generation of Agentforce, combining the pace and ownership of a startup with access to enterprise customers and Salesforce's distribution. Core Responsibilities & Scope Set a coherent product strategy and roadmap for AI quality and evaluation, connecting customer needs, technical opportunities, and measurable business outcomes. Establish shared quality definitions, evaluation requirements, coverage priorities, and release criteria with research, engineering, and product partners. Make explicit investment tradeoffs across customer quality improvements, evaluation capabilities, and product features; align teams on priorities and decision ownership. Personally lead customer investigations and experiments. Build an operating approach that connects customer feedback, evaluation evidence, experiments, releases, and learning across teams. Partner with researchers, applied scientists, and engineers to design credible evaluations. Lead delivery of capabilities that help customers understand and improve AI performance. Coach product partners, junior designers, and technical program managers in problem framing, experimentation, and delivery; raise the quality of decisions through mentorship and practical example. Bring verified competitive insight into strategy and communicate differentiation, limitations, and investment choices clearly to customers and senior stakeholders. Minimum Requirements A record of building AI/ML products and delivering measurable customer outcomes, with increasing ownership, scope, and impact. Deep hands-on experience building AI agents and evaluation capabilities in close partnership with AI researchers, applied scientists, or AI engineers. Strong applied AI/ML judgment across model behavior, prompting, retrieval, agent/tool workflows, and the tradeoffs among model, data, system, and product improvements. Current hands-on ability to inspect data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty. Principled, flexible thinking: frame the underlying customer problem, test assumptions, and change direction when evidence warrants it. Experience establishing shared standards and resolving cross-team disagreements while preserving clear accountability and delivery momentum. Evidence of coaching and mentoring colleagues without relying on reporting authority, and the ability to deliver independently in a fast-moving environment. Clear communication with customers, technical teams, and senior leaders, including an honest account of what is known, uncertain, or still unproven. Benefits Time off programs Medical, dental, vision Mental health support Paid parental leave Life and disability insurance 401(k) Employee stock purchasing program Job Data by YubHub .
More jobs like this
Recruiter, CommunicationsAnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listingResearch Scientist, Discovery (Engineering & Applied Sciences)AnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listingResearch Engineer, Cybersecurity RLAnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listingLegal Specialist, Law EnforcementAnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listing
Flieva