Mila > Team > Marc G. Bellemare

Marc G. Bellemare

Core Industry Member
Adjunct Professor, Assistant Professor, McGill University, Université de Montréal, Reliant AI, Canada CIFAR AI Chair

I am the Chief Scientific Officer at Reliant AI. Previously, I was a research scientist at Google Brain in Montréal, Canada focusing on the reinforcement learning effort there. From 2013 to 2017, I was at DeepMind in the UK. I received my Ph.D. from the University of Alberta working with Michael Bowling and Joel Veness.

My research lies at the intersection of reinforcement learning and probabilistic prediction. I’m also interested in deep learning, generative modelling, online learning, and information theory.

Publications

2021-08

Deep Reinforcement Learning at the Edge of the Statistical Precipice
Rishabh Agarwal, Max Schwarzer, Pablo Samuel Castro, Aaron C. Courville and Marc G. Bellemare

2021-05

Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning
Rishabh Agarwal, Marlos C. Machado, Pablo Samuel Castro and Marc G Bellemare
The Importance of Pessimism in Fixed-Dataset Policy Optimization
Jacob Buckman, Carles Gelada and Marc G Bellemare

2021-02

Metrics and continuity in reinforcement learning
Charline Le Lan, Marc G. Bellemare and Pablo Samuel Castro

2020-12

Autonomous navigation of stratospheric balloons using reinforcement learning.
Marc G. Bellemare, Salvatore Candido, Pablo Samuel Castro, Jun Gong, Marlos C. Machado, Subhodeep Moitra, Sameera S. Ponda and Ziyu Wang

2020-07

Representations for Stable Off-Policy Reinforcement Learning
Dibya Ghosh and Marc Bellemare

2020-06

The Value-Improvement Path: Towards Better Representations for Reinforcement Learning
Will Dabney, André Barreto, Mark Rowland, Robert Dadashi, John Quan, Marc G. Bellemare and David Silver
A Distributional Analysis of Sampling-Based Reinforcement Learning Algorithms.

2020-04

On Bonus Based Exploration Methods In The Arcade Learning Environment
Adrien Ali Taiga, William Fedus, Marlos C. Machado, Aaron Courville and Marc G. Bellemare
Count-Based Exploration with the Successor Representation
Marlos C. Machado, Marc G. Bellemare and Michael Bowling
AAAI 2020
(2020-04-03)
aaai.orgPDF
Algorithmic Improvements for Deep Reinforcement Learning Applied to Interactive Fiction.
Vishal Jain, William Fedus, Hugo Larochelle, Doina Precup and Marc G. Bellemare

2020-03

Zooming for Efficient Model-Free Reinforcement Learning in Metric Spaces
Ahmed Touati, Adrien Ali Taiga and Marc G. Bellemare
arXiv preprint arXiv:2003.04069
(2020-03-09)
ui.adsabs.harvard.eduPDF
The Hanabi Challenge: A New Frontier for AI Research
Nolan Bard, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, Iain Dunning, Shibl Mourad, Hugo Larochelle, Marc G. Bellemare and Michael Bowling
Artificial Intelligence
(2020-03-01)
www.sciencedirect.comPDF

2020-01

Shaping the Narrative Arc: Information-Theoretic Collaborative DialoguePaper type: Technical Paper.
Kory Wallace Mathewson, Pablo Samuel Castro, Colin Cherry, George F. Foster and Marc G. Bellemare
ICCC
(2020-01-01)
dblp.uni-trier.dePDF
Shaping the Narrative Arc: Information-Theoretic Collaborative Dialogue
Kory Mathewson, Pablo Samuel Castro, Colin Cherry, George Foster and Marc G. Bellemare
(venue unknown)
(2020-01-01)
On Catastrophic Interference in Atari 2600 Games
William Fedus, Dibya Ghosh, John D. Martin, Marc G. Bellemare, Yoshua Bengio and Hugo Larochelle
arXiv preprint arXiv:2002.12499
(2020-01-01)
ui.adsabs.harvard.eduPDF

2019-08

Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment
Adrien Ali Taïga, William Fedus, Marlos C. Machado, Aaron C. Courville and Marc G. Bellemare
arXiv preprint arXiv:1908.02388
(2019-08-06)
ui.adsabs.harvard.eduPDF
An Atari Model Zoo for Analyzing, Visualizing, and Comparing Deep Reinforcement Learning Agents.
Felipe Petroski Such, Vashisht Madhavan, Rosanne Liu, Rui Wang, Pablo Samuel Castro, Yulun Li, Jiale Zhi, Ludwig Schubert, Marc G. Bellemare, Jeff Clune and Joel Lehman

2019-07

Off-Policy Deep Reinforcement Learning by Bootstrapping the Covariate Shift
Carles Gelada and Marc G. Bellemare
A Comparative Analysis of Expected and Distributional Reinforcement Learning
Clare Lyle, Marc G. Bellemare and Pablo Samuel Castro
AAAI 2019
(2019-07-17)
aaai.orgPDF

2019-06

DeepMDP: Learning Continuous Latent Space Models with Theoretical Guarantees
Carles Gelada, Saurabh Kumar, Jacob Buckman, Ofir Nachum and Marc Bellemare
ICML 2019
(2019-06-09)
icml.cc

2019-05

Statistics and Samples in Distributional Reinforcement Learning.
Mark Rowland, Robert Dadashi, Saurabh Kumar, Remi Munos, Marc G. Bellemare and Will Dabney
DeepMDP: Learning Continuous Latent Space Models for Representation Learning
Carles Gelada, Saurabh Kumar, Jacob Buckman, Ofir Nachum and Marc G. Bellemare
The Value Function Polytope in Reinforcement Learning
Robert Dadashi, Adrien Ali Taiga, Nicolas Le Roux, Dale Schuurmans and Marc G. Bellemare
Task-Agnostic Reinforcement Learning (TARL)
Danijar Hafner, Deepak Pathak, Frederik Ebert, Marc G Bellemare, Raia Hadsell, Rowan McAllister, Amy Zhang, Joelle Pineau, Ahmed Touati and Roberto Calandra
ICLR 2019
(2019-05-06)
iclr.cc

2019-04

Distributional reinforcement learning with linear function approximation
Marc G. Bellemare, Nicolas Le Roux, Pablo Samuel Castro and Subhodeep Moitra

2019-03

An Introduction to Deep Reinforcement Learning
Vincent François-Lavet, Peter Henderson, Riashat Islam, Marc G. Bellemare and Joelle Pineau

2019-02

Hyperbolic Discounting and Learning over Multiple Horizons
William Fedus, Carles Gelada, Yoshua Bengio, Marc G. Bellemare and Hugo Larochelle
arXiv preprint arXiv:1902.06865
(2019-02-19)
ui.adsabs.harvard.eduPDF

2019-01

Shaping the Narrative Arc: An Information-Theoretic Approach to Collaborative Dialogue.
Kory Wallace Mathewson, Pablo Samuel Castro, Colin Cherry, George F. Foster and Marc G. Bellemare
arXiv preprint arXiv:1901.11528
(2019-01-31)
ui.adsabs.harvard.eduPDF
A Geometric Perspective on Optimal Representations for Reinforcement Learning
Marc G. Bellemare, Will Dabney, Robert Dadashi, Adrien Ali Taïga, Pablo Samuel Castro, Nicolas Le Roux, Dale Schuurmans, Tor Lattimore and Clare Lyle
A Comparative Analysis of Expected and Distributional Reinforcement Learning
Clare Lyle, Pablo Samuel Castro and Marc G. Bellemare
arXiv preprint arXiv:1901.11084
(2019-01-30)
ui.adsabs.harvard.eduPDF
Temporally Extended Metrics for Markov Decision Processes.
AAAI 2019
(2019-01-01)
dblp.uni-trier.dePDF

2018-12

An Introduction to Deep Reinforcement Learning
Vincent François-Lavet, Peter Henderson, Riashat Islam, Marc G. Bellemare and Joelle Pineau
(venue unknown)
(2018-12-20)
nowpublishers.comPDF

2018-11

The Barbados 2018 List of Open Issues in Continual Learning.
Tom Schaul, Hado van Hasselt, Joseph Modayil, Martha White, Adam White, Pierre-Luc Bacon, Jean Harb, Shibl Mourad, Marc G. Bellemare and Doina Precup
arXiv preprint arXiv:1811.07004
(2018-11-16)
ui.adsabs.harvard.eduPDF

2018-08

Approximate Exploration through State Abstraction.
Adrien Ali Taïga, Aaron C. Courville and Marc G. Bellemare
arXiv preprint arXiv:1808.09819
(2018-08-29)
dblp.uni-trier.dePDF

Publications collected and formatted using Paperoni