Profile Picture
Gabriele Prato
I am a PhD Candidate at Mila, Université de Montréal, working on knowledge consolidation in Large Language Models (LLMs). My long-term research goal is to advance current state-of-the-art models towards Artificial General Intelligence (AGI). I am looking to collaborate with some of the most talented researchers in the world on this challenge.
Publications
EpiK-Eval: Evaluation for Language Models as Epistemic Models
EMNLP 2023
PatchBlender: A Motion Prior for Video Transformers
NeurIPS 2022 Workshop, Vision Transformers: Theory and Applications
Scaling Laws for the Few-Shot Adaptation of Pre-trained Image Classifiers
ICML 2021 Workshop, Uncertainty & Robustness in Deep Learning
Fully Quantized Transformer for Machine Translation
Findings of EMNLP 2020
Towards Lossless Encoding of Sentences
ACL 2019
Blog Posts
EpiK-Eval and the Role of Knowledge Consolidation in Language Models
December 22, 2023