Passer au contenu de la page principale

Jackie Chit Kit Cheung

McGill University
Participe à 2 sessions

Jackie Chi Kit Cheung is associate professor, McGill University's School of Computer Science, where he co-directs the Reasoning and Learning Lab. He is a Canada CIFAR AI Chair and an Associate Scientific Co-Director at the Mila Quebec AI Institute. His research focuses on topics in natural language generation such as automatic summarization, and on integrating diverse knowledge sources into NLP systems for pragmatic and common-sense reasoning. He also works on applications of NLP to domains such as education, health, and language revitalization. He is motivated in particular by how the structure of the world can be reflected in the structure of language processing systems.
 

Talk

Benchmarking and Evaluation in NLP: How Do We Know What LLMs Can Do? | June 12

Sessions auxquelles Jackie Chit Kit Cheung participe

Mercredi 12 Juin, 2024

Fuseau horaire: (GMT-05:00) Eastern Time (US & Canada)
11:00 AM
11:00 AM EDT - 12:30 PM EDT | 1 heure 30 minutes
Large Language Models: Applications, Ethics & Risks

Conflicting claims about how large language models (LLMs) “can do X”, “have property Y”, or even “know Z” have been made in recent literature in natural language processing (NLP) and related fields, as well as in popular media. However, unclear and often inconsistent standards for how to infer these conclusions from experimental results bring the the validity of such claims into question. In this lecture, I focus on the crucial role that benchmarking and evaluation methodology in NLP plays in...