I am a postdoctoral researcher in Natural Language Processing at RALI-DIRO, Université de Montréal, working with Jian-Yun Nie in the framework of the CLIQ-ai consortium.
I completed my PhD in NLP at Aix-Marseille Université, in the TALEP team at the Laboratoire d'Informatique et des Systèmes (LIS), under the supervision of Frédéric Béchet (LIS) and Philippe Langlais (DIRO, UdeM).
My research focuses on the assessment of language models, by which I mean understanding what they actually do and where their limits lie, rather than only measuring aggregate performance. I have explored this through several directions during my PhD: linguistically-motivated evaluation of reading comprehension, the analysis of routing patterns in Mixture-of-Experts architectures, and, within the Archival project, user-centered evaluation and explainable document linking for digital humanities collections.
Publications
2026
- Evaluation and Assessment as Complementary Frameworks 1st Symposium on Natural Language Generation Evaluations, June 2026, pages 16–23
2025
- Part-Of-Speech Sensitivity of Routers in Mixture of Experts Models COLING 2025, Abu Dhabi, pages 6467–6474
2024
- A linguistically-motivated evaluation methodology for unraveling model's abilities in reading comprehension tasks EMNLP 2024, Miami, pages 18376–18392
- Extrinsic evaluation of question generation methods with user journey logs HumEval @ LREC-COLING 2024, Torino, pages 63–70
2023
- Exploring social sciences archives with explainable document linkage through question generation 7th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature
2022
- Question Generation and Answering for exploring Digital Humanities collections LREC 2022, Marseille, pages 4561–4568
- Génération de question à partir d'analyse sémantique pour l'adaptation non supervisée de modèles de compréhension de documents TALN 2022, pages 104–115
Teaching
Instructor
- Database, Polytech Marseille, 3rd year (2024), with Alice Delbosc, based on Benoit Favre's course
Teaching Assistant
- Introduction to Natural Language Processing, Aix-Marseille Université, 1st year Master's (2024)
- Imperative Programming in C, Polytech Marseille, 3rd year (2023)
- Database, Polytech Marseille, 3rd year (2022–2023)
Contact
The best way to reach me is by email, at elie.antoine [at] umontreal.ca.