Publications

Capture the Flag: Uncovering Data Insights with Large Language Models
Issam Hadj Laradji
Perouz Taslakian
Sai Rajeswar
Valentina Zantedeschi
Alexandre Lacoste
Nicolas Chapados
David Vazquez
Chris Pal
Alexandre Drouin
2023-11-07
NeurIPS.cc/2023/Workshop/FMDM (publié)
doi.org
openreview.net
Multi-resolution Time-Series Transformer for Long-term Forecasting
Yitian Zhang
Liheng Ma
Soumyasundar Pal
Yingxue Zhang
Mark Coates
2023-11-07
ArXiv (prépublication)
doi.org
arxiv.org
The Unsolved Challenges of LLMs as Generalist Web Agents: A Case Study
Rim Assouel
Tom Marty
Massimo Caccia
Issam Hadj Laradji
Alexandre Drouin
Sai Rajeswar
Hector Palacios
Quentin Cappart
David Vazquez
Nicolas Chapados
Maxime Gasse
Alexandre Lacoste
2023-11-07
NeurIPS.cc/2023/Workshop/FMDM (publié)
openreview.net
openreview.net
30×30 biodiversity gains rely on national coordination
Isaac Eckert
Andrea Brown
Dominique Caron
Federico Riva
Laura J. Pollock
2023-11-06
Nature Communications (publié)
doi.org
Knowledge by omission: the significance of omissions in the 5-choice serial reaction time task
Caroline Vouillac-Mendoza
Audrey Durand
Serge H. Ahmed
Karine Guillem
The 5-choice serial reaction time task (5-CSRTT) is commonly used to assess attention in rodents. Manipulation of this task by decreasing th… (voir plus)e light stimulus duration is often used to probe attentional capacity and causes a decrease in accuracy and an increase in omissions. However, although a decrease in response accuracy is commonly interpreted as a decrease in attention, it is more difficult to interpret an increase in omissions in terms of attentional performance. Here we present a series of experiments in rats that seeks to investigate the origins of these key behavioral measures of attention in the 5-CSRTT. After an initial training in the 5-CSRTT, rats were tested in a variable stimulus duration procedure to increase task difficulty and probe visual attentional capacity under several specific controlled conditions. We found that response accuracy reflects visuospatial sustained attentional processing, as commonly interpreted, while response omission reflects rats’ ignorance about the stimulus location, presumably due to failure to pay attention to the curved wall during its presentation. Moreover, when rats lack of relevant information, they choose not to respond instead of responding randomly. Overall, our results indicate that response accuracy and response omission thus correspond to two distinct attentional states.
2023-11-06
bioRxiv (prépublication)
doi.org
Coordination among leaf and fine root traits across a strong natural soil fertility gradient
Xavier Guilbeault-Mayers
Hans Lambers
Étienne Laliberté
2023-11-05
bioRxiv (prépublication)
doi.org
Player-Guided AI outperforms standard AI in Sequence Alignment Puzzles
Renata Mutalova
Roman Sarrazin-Gendron
Parham Ghasemloo Gheidari
Eddie Cai
Gabriel Richard
Sébastien Caisse
Rob Knight
Mathieu Blanchette
Attila Szantner
Jérôme Waldispühl
2023-11-05
International Conference on Climate Informatics (publié)
doi.org
The feature landscape of visual cortex
Rudi Tong
Ronan da Silva
Dongyan Lin
Arna Ghosh
James Wilsenach
Erica Cianfarano
Pouya Bashivan
Blake Richards
Stuart Trenholm
Understanding computations in the visual system requires a characterization of the distinct feature preferences of neurons in different visu… (voir plus)al cortical areas. However, we know little about how feature preferences of neurons within a given area relate to that area’s role within the global organization of visual cortex. To address this, we recorded from thousands of neurons across six visual cortical areas in mouse and leveraged generative AI methods combined with closed-loop neuronal recordings to identify each neuron’s visual feature preference. First, we discovered that the mouse’s visual system is globally organized to encode features in a manner invariant to the types of image transformations induced by self-motion. Second, we found differences in the visual feature preferences of each area and that these differences generalized across animals. Finally, we observed that a given area’s collection of preferred stimuli (‘own-stimuli’) drive neurons from the same area more effectively through their dynamic range compared to preferred stimuli from other areas (‘other-stimuli’). As a result, feature preferences of neurons within an area are organized to maximally encode differences among own-stimuli while remaining insensitive to differences among other-stimuli. These results reveal how visual areas work together to efficiently encode information about the external world.
2023-11-05
bioRxiv (prépublication)
doi.org
Score-Based Likelihood Characterization for Inverse Problems in the Presence of Non-Gaussian Noise
Ronan Legin
Alexandre Adam
Yashar Hezaveh
Laurence Perreault-Levasseur
Likelihood analysis is typically limited to normally distributed noise due to the difficulty of determining the probability density function… (voir plus) of complex, high-dimensional, non-Gaussian, and anisotropic noise. This work presents Score-based LIkelihood Characterization (SLIC), a framework that resolves this issue by building a data-driven noise model using a set of noise realizations from observations. We show that the approach produces unbiased and precise likelihoods even in the presence of highly non-Gaussian correlated and spatially varying noise. We use diffusion generative models to estimate the gradient of the probability density of noise with respect to data elements. In combination with the Jacobian of the physical model of the signal, we use Langevin sampling to produce independent samples from the unbiased likelihood. We demonstrate the effectiveness of the method using real data from the Hubble Space Telescope and James Webb Space Telescope.
2023-11-03
NeurIPS.cc/2023/Workshop/Deep_Inverse (poster)
openreview.net
openreview.net
Empowering Clinicians with MeDT: A Framework for Sepsis Treatment
Aamer Abdul Rahman
Pranav Agarwal
Vincent Michalski
Rita Noumeir
Samira Ebrahimi Kahou
2023-11-02
NeurIPS.cc/2023/Workshop/GCRL (publié)
openreview.net
openreview.net
Goal Misgeneralization as Implicit Goal Conditioning
Diego Dorn
Neel Alex
David Scott Krueger
2023-11-02
NeurIPS.cc/2023/Workshop/GCRL (publié)
openreview.net
openreview.net
How does fine-tuning affect your model? Mechanistic analysis on procedural tasks
Samyak Jain
Robert Kirk
Ekdeep Singh Lubana
Robert P. Dick
Hidenori Tanaka
Tim Rocktäschel
Edward Grefenstette
David Scott Krueger
Fine-tuning large pre-trained models has become the *de facto* strategy for developing models that are safe to deploy. However, there has be… (voir plus)en little work that explains how fine-tuning alters the underlying capabilities learnt by a model during pretraining: does fine-tuning yield entirely novel capabilities or does it just modulate existing ones? We address this question empirically in *synthetic* settings with mechanistic interpretability tools (e.g., network pruning and probing) to understand how the model's underlying capabilities are changing. Our extensive analysis of the effects of fine-tuning shows: (i) fine-tuning rarely alters the underlying model capabilities; (ii) a minimal transformation, which we call a 'wrapper', is typically learned on top of the underlying model capabilities; and (iii) further fine-tuning on a task where such wrapped capabilities are relevant leads to sample-efficient "revival'' of the capability, i.e., the model begins reusing this capability in a few gradient steps. *This indicates practitioners can unintentionally remove a model's safety wrapper by merely fine-tuning it on a superficially unrelated task.* We additionally perform analysis on language models trained on the TinyStories dataset to support our claims in a more realistic setup.
2023-11-02
NeurIPS.cc/2023/Workshop/UniReps (poster)
openreview.net
openreview.net