Mila > Team > Guillaume Lajoie

Guillaume Lajoie

Core Academic Member
Assistant Professor, Université de Montréal, Canada CIFAR AI Chair

Guillaume Lajoie is an assistant professor in the Department of Mathematics and Statistics (DMS) at the Université de Montréal and a Core Academic Member at Mila. He is also a FRQS Research Scholar.  Before that, he was a postdoctoral fellow at the Max Planck Institute for Dynamics and Self-Organization and at the University of Washington Institute for Neuroengineering. He obtained his PhD from the Department of Applied Mathematics at the University of Washington, in Seattle.

His research is rooted at the intersection of AI and neuroscience where he pursues questions surrounding neural network dynamics and computations, with some applications to neuroengineering. Recent work include the development of architectural inductive biases for information propagation in recurrent networks, as well as the development of algorithms and models for bidirectional brain-machine interface optimization.

Publications

2021-12

Gradient Starvation: A Learning Proclivity in Neural Networks
Mohammad Pezeshki, Oumar Kaba, Yoshua Bengio, Aaron C. Courville, Doina Precup and Guillaume Lajoie
NEURIPS 2021
(2021-12-06)
papers.nips.ccPDF

2021-10

Compositional Attention: Disentangling Search and Retrieval
Sarthak Mittal, Sharath Chandra Raparthy, Irina Rish, Yoshua Bengio and Guillaume Lajoie
arXiv preprint arXiv:2110.09419
(2021-10-18)
dblp.uni-trier.dePDF

2021-09

Optimizing Neuroprosthetic Therapies via Autonomous Learning Agents
Marco Bonizzato, Sandrine L. Côté, Elena Massai, Rose Guay-Hottin, Samuel Laferrière, Stephan Quessy, Guillaume Lajoie, Marina Martinez and Numa Dancause
Social Science Research Network
(2021-09-16)
papers.ssrn.com
Learning function from structure in neuromorphic networks
Laura E. Suárez, Blake A. Richards, Guillaume Lajoie and Bratislav Misic
Nature Machine Intelligence
(2021-09-01)
europepmc.org[Also on bioRxiv (2020-11-11)]

2021-07

Embedding Signals on Knowledge Graphs with Unbalanced Diffusion Earth Mover's Distance.
Alexander Tong, Guillaume Huguet, Dennis L. Shung, Amine Natik, Manik Kuchroo, Guillaume Lajoie, Guy Wolf and Smita Krishnaswamy
arXiv preprint arXiv:2107.12334
(2021-07-26)
ui.adsabs.harvard.eduPDF
Learning Brain Dynamics With Coupled Low-Dimensional Nonlinear Oscillators and Deep Recurrent Networks.
German Abrevaya, Guillaume Dumas, Aleksandr Y. Aravkin, Peng Zheng, Jean-Christophe Gagnon-Audet, James R. Kozloski, Pablo Polosecki, Guillaume Lajoie, David D. Cox, Silvina Ponce Dawson, Guillermo A. Cecchi and Irina Rish
Neural Computation
(2021-07-26)
direct.mit.edu
Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning
Nan Rosemary Ke, Aniket Didolkar, Sarthak Mittal, Anirudh Goyal, Guillaume Lajoie, Stefan Bauer, Danilo Rezende, Yoshua Bengio, Michael Mozer and Christopher Pal
arXiv preprint arXiv:2107.00848
(2021-07-02)
arxiv.orgPDF

2021-05

Efficient and robust multi-task learning in the brain with modular task primitives.
Christian David Marton, Guillaume Lajoie and Kanaka Rajan
arXiv preprint arXiv:2105.14108
(2021-05-28)
ui.adsabs.harvard.eduPDF
Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning
Nan Rosemary Ke, Aniket Rajiv Didolkar, Sarthak Mittal, Anirudh Goyal, Guillaume Lajoie, Stefan Bauer, Danilo Jimenez Rezende, Michael Curtis Mozer, Yoshua Bengio and Christopher Pal
NEURIPS 2021
(2021-05-04)
www.acemap.infoPDF
PNS-GAN: Conditional Generation of Peripheral Nerve Signals in the Wavelet Domain via Adversarial Networks
Olivier Tessier-Lariviere, Luke Y. Prince, Pascal Fortier-Poisson, Lorenz Wernisch, Oliver Armitage, Emil Hewage, Guillaume Lajoie and Blake A. Richards
NER 2021
(2021-05-04)
ieeexplore.ieee.org

2021-03

Implicit Regularization via Neural Feature Alignment
Aristide Baratin, Thomas George, César Laurent, R Devon Hjelm, Guillaume Lajoie, Pascal Vincent and Simon Lacoste-Julien
Predictive learning as a network mechanism for extracting low-dimensional latent space representations.
Stefano Recanatesi, Matthew Farrell, Guillaume Lajoie, Sophie Deneve, Mattia Rigotti and Eric Shea-Brown
Nature Communications
(2021-03-03)
europepmc.org[Also on bioRxiv (2020-09-17)]

2020-11

Gradient Starvation: A Learning Proclivity in Neural Networks
Mohammad Pezeshki, Sékou-Oumar Kaba, Yoshua Bengio, Aaron Courville, Doina Precup and Guillaume Lajoie
arXiv preprint arXiv:2011.09468
(2020-11-18)
ui.adsabs.harvard.eduPDF

2020-10

LEAD: Least-Action Dynamics for Min-Max Optimization
Reyhane Askari Hemmat, Amartya Mitra, Guillaume Lajoie and Ioannis Mitliagkas
arXiv preprint arXiv:2010.13846
(2020-10-26)
onikle.comPDF

2020-08

Implicit Regularization in Deep Learning: A View from Function Space.
Aristide Baratin, Thomas George, César Laurent, R. Devon Hjelm, Guillaume Lajoie, Pascal Vincent and Simon Lacoste-Julien
(venue unknown)
(2020-08-03)
www.microsoft.com

2020-07

Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules
Sarthak Mittal, Alex Lamb, Anirudh Goyal, Vikram Voleti, Murray Shanahan, Guillaume Lajoie, Michael Mozer and Yoshua Bengio

2020-06

On Lyapunov Exponents for RNNs: Understanding Information Propagation Using Dynamical Systems Tools
Ryan Vogt, Maximilian Puelma Touzel, Eli Shlizerman and Guillaume Lajoie
arXiv preprint arXiv:2006.14123
(2020-06-25)
ui.adsabs.harvard.eduPDF
Advantages of biologically-inspired adaptive neural activation in RNNs during learning.
Victor Geadah, Giancarlo Kerg, Stefan Horoi, Guy Wolf and Guillaume Lajoie
arXiv preprint arXiv:2006.12253
(2020-06-22)
ui.adsabs.harvard.eduPDF
Untangling tradeoffs between recurrence and self-attention in neural networks
Giancarlo Kerg, Bhargav Kanuparthi, Anirudh Goyal, Kyle Goyette, Yoshua Bengio and Guillaume Lajoie
arXiv preprint arXiv:2006.09471
(2020-06-16)
ui.adsabs.harvard.eduPDF

2020-05

Low-Dimensional Dynamics of Encoding and Learning in Recurrent Neural Networks
Stefan Horoi, Victor Geadah, Guy Wolf and Guillaume Lajoie
AI 2020
(2020-05-13)
link.springer.com

2020-04

Hierarchical Bayesian Optimization of Spatiotemporal Neurostimulations for Targeted Motor Outputs
Samuel Laferriere, Marco Bonizzato, Sandrine L. Cote, Numa Dancause and Guillaume Lajoie
EMBC 2020
(2020-04-13)
ieeexplore.ieee.org

2020-01

Internal representation dynamics and geometry in recurrent neural networks.
Stefan Horoi, Guillaume Lajoie and Guy Wolf
arXiv: Learning
(2020-01-09)
ui.adsabs.harvard.eduPDF
Untangling tradeoffs between recurrence and self-attention in artificial neural networks
Giancarlo Kerg, Bhargav Kanuparthi, Anirudh Goyal Alias Parth Goyal, Kyle Goyette, Yoshua Bengio and Guillaume Lajoie
NEURIPS 2020
(2020-01-01)
papers.nips.ccPDF

2019-09

Recurrent neural networks learn robust representations by dynamically balancing compression and expansion
Matthew Farrell, Stefano Recanatesi, Guillaume Lajoie and Eric Shea-Brown
bioRxiv
(2019-09-11)
openreview.netPDF
Modelling Working Memory using Deep Recurrent Reinforcement Learning
Pravish Sainath, Pierre Bellec and Guillaume Lajoie
(venue unknown)
(2019-09-11)
openreview.netPDF

2019-07

Predictive learning extracts latent space representations from sensory observations
Stefano Recanatesi, Matthew Farrell, Guillaume Lajoie, Sophie Deneve, Mattia Rigotti and Eric Shea-Brown
bioRxiv
(2019-07-13)
www.biorxiv.orgPDF

2019-06

Learning to evoke complex motor outputs with spatiotemporal neurostimulation using a hierarchical and adaptive optimization algorithm
Samuel Laferriere, Marco Bonizzato, Numa Dancause and Guillaume Lajoie
bioRxiv
(2019-06-11)
www.biorxiv.orgPDF
Dimensionality compression and expansion in Deep Neural Networks.
Stefano Recanatesi, Matthew Farrell, Madhu Advani, Timothy Moore, Guillaume Lajoie and Eric Shea-Brown
arXiv: Learning
(2019-06-02)
ui.adsabs.harvard.eduPDF

2019-03

Dynamic compression and expansion in a classifying recurrent network
Matthew Farrell, Stefano Recanatesi, Guillaume Lajoie and Eric Shea-Brown
bioRxiv
(2019-03-01)
www.biorxiv.orgPDF

2019-01

Cortical network mechanisms of anodal and cathodal transcranial direct current stimulation in awake primates
Andrew R. Bogaard, Guillaume Lajoie, Hayley Boyd, Andrew Morse, Stavros Zanos and Eberhard E. Fetz
bioRxiv
(2019-01-09)
www.biorxiv.orgPDF
Learning to evoke complex motor outputs with spatiotemporal neurostimulation using a hierarchical and adaptive optimization algorithm.
Samuel Laferriere, Guillaume Lajoie, Numa Dancause and Marco Bonizzato
2019 Conference on Cognitive Computational Neuroscience
(2019-01-01)
dx.doi.org
Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics
Giancarlo Kerg, Kyle Goyette, Maximilian Puelma Touzel, Gauthier Gidel, Eugene Vorontsov, Yoshua Bengio and Guillaume Lajoie

2018-11

Signatures and mechanisms of low-dimensional neural predictive manifolds
Stefano Recanatesi, Matthew Farrell, Guillaume Lajoie, Sophie Deneve, Mattia Rigotti and Eric Shea-Brown
bioRxiv
(2018-11-17)
www.biorxiv.orgPDF

Publications collected and formatted using Paperoni