Skip to main page content

Jackie Chit Kit Cheung

McGill University
Participates in 2 items

Jackie Chi Kit Cheung is associate professor, McGill University's School of Computer Science, where he co-directs the Reasoning and Learning Lab. He is a Canada CIFAR AI Chair and an Associate Scientific Co-Director at the Mila Quebec AI Institute. His research focuses on topics in natural language generation such as automatic summarization, and on integrating diverse knowledge sources into NLP systems for pragmatic and common-sense reasoning. He also works on applications of NLP to domains such as education, health, and language revitalization. He is motivated in particular by how the structure of the world can be reflected in the structure of language processing systems.
 

Talk

Benchmarking and Evaluation in NLP: How Do We Know What LLMs Can Do? | June 12

Sessions in which Jackie Chit Kit Cheung participates

Wednesday 12 June, 2024

Time Zone: (GMT-05:00) Eastern Time (US & Canada)
11:00 AM
11:00 AM EDT - 12:30 PM EDT | 1 hour 30 minutes
Large Language Models: Applications, Ethics & Risks

Conflicting claims about how large language models (LLMs) “can do X”, “have property Y”, or even “know Z” have been made in recent literature in natural language processing (NLP) and related fields, as well as in popular media. However, unclear and often inconsistent standards for how to infer these conclusions from experimental results bring the the validity of such claims into question. In this lecture, I focus on the crucial role that benchmarking and evaluation methodology in NLP plays in...