Guillaume Lajoie

Back to directory
Core Academic Member
Guillaume Lajoie
Assistant Professor, Université de Montréal
Guillaume Lajoie
Deep Learning
Dynamical Systems
Medical Machine Learning (ML)
Neuroscience
Recurrent Neural Networks
https://dms.umontreal.ca/~lajoie/
514-343-5620

Guillaume Lajoie is an assistant professor in the Department of Mathematics and Statistics (DMS) at the Université de Montréal and a Core Academic Member at Mila. He is also a FRQS Research Scholar.  Before that, he was a postdoctoral fellow at the Max Planck Institute for Dynamics and Self-Organization and at the University of Washington Institute for Neuroengineering. He obtained his PhD from the Department of Applied Mathematics at the University of Washington, in Seattle.

His research is rooted at the intersection of AI and neuroscience where he pursues questions surrounding neural network dynamics and computations, with some applications to neuroengineering. Recent work include the development of architectural inductive biases for information propagation in recurrent networks, as well as the development of algorithms and models for bidirectional brain-machine interface optimization.

Publications

2020-11

Gradient Starvation: A Learning Proclivity in Neural Networks
Mohammad Pezeshki, Sékou-Oumar Kaba, Yoshua Bengio, Aaron Courville, Doina Precup and Guillaume Lajoie
arXiv preprint arXiv:2011.09468
(2020-11-18)
arxiv.orgPDF
Learning function from structure in neuromorphic networks
Laura E Suarez, Blake A Richards, Guillaume Lajoie and Bratislav Misic
bioRxiv
(2020-11-11)
www.biorxiv.orgPDF

2020-10

LEAD: Least-Action Dynamics for Min-Max Optimization
Reyhane Askari Hemmat, Amartya Mitra, Guillaume Lajoie and Ioannis Mitliagkas
arXiv preprint arXiv:2010.13846
(2020-10-26)
arxiv.orgPDF

2020-09

Predictive learning as a network mechanism for extracting low-dimensional latent space representations
Stefano Recanatesi, Matthew Farrell, Guillaume Lajoie, Sophie Deneve, Mattia Rigotti and Eric Shea-Brown
bioRxiv
(2020-09-17)
www.biorxiv.orgPDF

2020-08

Implicit Regularization via Neural Feature Alignment.
Aristide Baratin, Thomas George, César Laurent, R Devon Hjelm, Guillaume Lajoie, Pascal Vincent and Simon Lacoste-Julien
arXiv: Learning
(2020-08-03)
arxiv.orgPDF
Implicit Regularization in Deep Learning: A View from Function Space
Aristide Baratin, Thomas George, César Laurent, R Devon Hjelm, Guillaume Lajoie, Pascal Vincent and Simon Lacoste-Julien
arXiv preprint arXiv:2008.00938
(2020-08-03)
www.microsoft.comPDF

2020-07

Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules
Sarthak Mittal, Alex Lamb, Anirudh Goyal, Vikram Voleti, Murray Shanahan, Guillaume Lajoie, Michael Mozer and Yoshua Bengio
ICML 2020
(2020-07-12)
icml.cc[Also on arXiv preprint arXiv:2006.16981 (2020-06-30)]

2020-06

On Lyapunov Exponents for RNNs: Understanding Information Propagation Using Dynamical Systems Tools
Ryan Vogt, Maximilian Puelma Touzel, Eli Shlizerman and Guillaume Lajoie
arXiv: Learning
(2020-06-25)
ui.adsabs.harvard.eduPDF
Advantages of biologically-inspired adaptive neural activation in RNNs during learning.
Victor Geadah, Giancarlo Kerg, Stefan Horoi, Guy Wolf and Guillaume Lajoie
arXiv preprint arXiv:2006.12253
(2020-06-22)
dblp.uni-trier.dePDF
Untangling tradeoffs between recurrence and self-attention in neural networks
Giancarlo Kerg, Bhargav Kanuparthi, Anirudh Goyal, Kyle Goyette, Yoshua Bengio and Guillaume Lajoie
arXiv preprint arXiv:2006.09471
(2020-06-16)
dblp.uni-trier.dePDF

2020-05

Low-Dimensional Dynamics of Encoding and Learning in Recurrent Neural Networks
Stefan Horoi, Victor Geadah, Guy Wolf and Guillaume Lajoie
Canadian Conference on AI
(2020-05-13)
link.springer.com

2020-04

Hierarchical Bayesian Optimization of Spatiotemporal Neurostimulations for Targeted Motor Outputs
Samuel Laferriere, Marco Bonizzato, Sandrine L. Cote, Numa Dancause and Guillaume Lajoie
IEEE Transactions on Neural Systems and Rehabilitation Engineering
(2020-04-13)
ieeexplore.ieee.org

2020-01

Internal representation dynamics and geometry in recurrent neural networks.
Stefan Horoi, Guillaume Lajoie and Guy Wolf
arXiv preprint arXiv:2001.03255
(2020-01-09)
dblp.uni-trier.dePDF
Untangling tradeoffs between recurrence and self-attention in artificial neural networks
Giancarlo Kerg, Bhargav Kanuparthi, Anirudh Goyal Alias Parth Goyal, Kyle Goyette, Yoshua Bengio and Guillaume Lajoie
NEURIPS 2020
(2020-01-01)
papers.nips.cc

2019-12

Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics
Giancarlo Kerg, Kyle Goyette, Maximilian Puelma Touzel, Gauthier Gidel, Eugene Vorontsov, Yoshua Bengio and Guillaume Lajoie
NEURIPS 2019
(2019-12-08)
papers.nips.ccPDF[Also on arXiv preprint arXiv:1905.12080 (2019-05-28)]

2019-09

Recurrent neural networks learn robust representations by dynamically balancing compression and expansion
Matthew Farrell, Stefano Recanatesi, Guillaume Lajoie and Eric Shea-Brown
bioRxiv
(2019-09-11)
openreview.netPDF
Modelling Working Memory using Deep Recurrent Reinforcement Learning
Pravish Sainath, Pierre Bellec and Guillaume Lajoie
(venue unknown)
(2019-09-11)
openreview.netPDF
Recurrent neural networks learn robust representations by dynamically balancing compression and expansion
Matthew Farrell, Stefano Recanatesi, Guillaume Lajoie and Eric Shea-Brown
bioRxiv
(2019-09-11)
openreview.netPDF

2019-07

Predictive learning extracts latent space representations from sensory observations
Stefano Recanatesi, Matthew Farrell, Guillaume Lajoie, Sophie Deneve, Mattia Rigotti and Eric Shea-Brown
bioRxiv
(2019-07-13)
www.biorxiv.orgPDF

2019-06

Learning to evoke complex motor outputs with spatiotemporal neurostimulation using a hierarchical and adaptive optimization algorithm
Samuel Laferriere, Marco Bonizzato, Numa Dancause and Guillaume Lajoie
bioRxiv
(2019-06-11)
www.biorxiv.orgPDF
Dimensionality compression and expansion in Deep Neural Networks
Stefano Recanatesi, Matthew Farrell, Madhu Advani, Timothy Moore, Guillaume Lajoie and Eric Shea-Brown
arXiv preprint arXiv:1906.00443
(2019-06-02)
ui.adsabs.harvard.eduPDF

2019-01

Cortical network mechanisms of anodal and cathodal transcranial direct current stimulation in awake primates
Andrew R. Bogaard, Guillaume Lajoie, Hayley Boyd, Andrew Morse, Stavros Zanos and Eberhard E. Fetz
bioRxiv
(2019-01-09)
www.biorxiv.orgPDF
Learning to evoke complex motor outputs with spatiotemporal neurostimulation using a hierarchical and adaptive optimization algorithm.
Samuel Laferriere, Guillaume Lajoie, Numa Dancause and Marco Bonizzato
2019 Conference on Cognitive Computational Neuroscience
(2019-01-01)
dx.doi.org

2018-11

Signatures and mechanisms of low-dimensional neural predictive manifolds
Stefano Recanatesi, Matthew Farrell, Guillaume Lajoie, Sophie Deneve, Mattia Rigotti and Eric Shea-Brown
bioRxiv
(2018-11-17)
www.biorxiv.orgPDF

Publications collected and formatted using Paperoni

array(1) { ["wp-wpml_current_language"]=> string(2) "en" }