PhD opportunity in Montréal — Human-Guided Evaluation of Generative AI Systems

id="offer-description" class="ecl-u-type-heading-2 ecl-u-mt-none ecl-u-mb-l">Offer Description 📣 PhD opportunity in Montréal — Human-Guided Evaluation of Generative AI Systems . How can we evaluate AI systems in realistic situations—and decide which tests or expert judgments will provide the most valuable evidence about their risks? . Together with Jackie Cheung, I am seeking a PhD candidate within REGARD to explore these questions through probabilistic modelling, adaptive testing, simulated users, and targeted human feedback. The research will connect mathematical foundations with experiments on language models, focusing on reliability, uncertainty, and the efficient use of human expertise. 📍 Montréal, with research activities at ILLS and Mila . 📅 Intended start — January 2027 . 🎓 Possibility of a cotutelle between Université Paris-Saclay and McGill University . 💰 Competitive funding . 📩 Rolling applications until the position is filled . We welcome applicants from computer science, mathematics, statistics, engineering, and related disciplines who enjoy combining theory with experimentation. Full description and application details . https://pablo-piantanida.org/openings/phd-ai-evaluation/ . Please share with students who may be interested!. Where to apply E-mail [email protected]. Requirements Research Field Computer science » Informatics Education Level Master Degree or equivalent . Skills/Qualifications. A master’s degree or equivalent in computer scienc