Portrait of Pravish Sainath

Pravish Sainath

PhD - Université de Montréal
Supervisor
Co-supervisor
Research Topics
Computational Neuroscience
Deep Learning
Recurrent Neural Networks
Representation Learning

Publications

Current gaps in downstream applications of fMRI foundation models: lessons learned from BrainLM & BrainHarmonix on Prevent-AD
Hao-Ting Wang
Alexa Pichet Binette
Nicolas Farrugia
Sylvia Villeneuve
Pierre Bellec
Abstract Foundation models have driven major advancements in the language and vision domains, as seen in the popularity of Artificial Intell… (see more)igence (AI) tools, and a growing number of studies are bringing the approach to human brain imaging. Whether these models are ready for independent researchers to use on clinical datasets has yet to be examined. We evaluated two recent fMRI foundation models, BrainLM and BrainHarmonix, on PreventAD, a dataset on adults with a family history of Alzheimer’s disease. We compared features from frozen and fine-tuned models against two baselines: functional connectivity and a dummy classifier that always predicts the most common class. The sample includes 343 subjects who passed quality control, with a subset of 218 who had amyloid PET imaging. We tested four prediction targets: sex, age, progression to mild cognitive impairment (MCI), and β-amyloid burden. Both models required substantial changes to the released code. BrainLM’s own data preparation workflow did not produce stable fine-tuning, which we achieved only after switching to a standard workflow implemented with the library Nilearn. BrainHarmonix’s documentation did not specify how to normalize new data, so we resolved this by testing different alternatives. For sex, functional connectivity outperformed all foundation model features. For age group, the best foundation model feature, taken from BrainHarmonix’s structural (T1-weighted) encoder, slightly exceeded functional connectivity, but the difference was not significant. For MCI and β-amyloid, no feature exceeded the dummy classifier in accuracy, and the area under the curve (AUC) stayed near chance for all features. For both clinical targets, the most precise feature came from fine-tuned BrainLM, meaning a larger share of its positive predictions were correct than for functional connectivity, but neither difference reached statistical significance. These results suggested that the strong transfer to new tasks seen in large language models cannot yet be assumed for fMRI foundation models, and that both models required code adaptation that would preclude their streamlined adoption by independent groups. We recommend that future studies provide standardized data workflows and always report functional connectivity and dummy classifier baselines. For clinical targets with strong class imbalance, studies should report several metrics, including precision.
Behavioral Imitation with Artificial Neural Networks Leads to Personalized Models of Brain Dynamics During Videogame Play
Anirudha Kemtur
Basile Pinsard
Julie Boyle
Pierre Bellec
Videogames provide a promising framework to understand brain activity in a rich, engaging, and active environment, in contrast to mostly pas… (see more)sive tasks currently dominating the field, such as image viewing. Analyzing videogames neuroimaging data is however challenging, and relies on time-intensive manual annotations of game events, based on somewhat arbitrary rules. Here, we introduce an innovative approach using Artificial Neural networks (ANN) and brain encoding techniques to generate activation maps associated with videogame behaviour using functional magnetic resonance imaging (fMRI). As individual behavior is highly variable across subjects in complex environments, we hypothesized that ANNs need to account for subject-specific behavior to properly capture brain dynamics. In this study, we used data collected while subjects played Shinobi III: Return of the Ninja Master (Sega, 1993), an action-platformer videogame. Using imitation learning, we trained an ANN to play the game while closely replicating the unique gameplay style of individual participants. We found that hidden layers of our imitation learning model successfully encoded task-relevant neural representations, and predicted individual brain dynamics with higher accuracy than models trained on other subjects’ gameplay. Individual-specific models also outperformed a number of baselines to predict brain activity, such as pixel inputs, or button presses. The highest correlations between layer activations and brain signals were observed in biologically plausible brain areas, i.e. somatosensory, attention, and visual networks. Our results demonstrate that training subject-specific ANNs can successfully uncover brain correlates of complex behaviour. This new method combining imitation learning, brain imaging, and videogames opens new research avenues to study decision-making and psychomotor task solving in naturalistic and complex environments.
AI-based modeling of brain and behavior: Combining neuroimaging, imitation learning and video games
Anirudha Kemtur
Basile Pinsard
Yann Harel
Julie Boyle
Pierre Bellec