Portrait de Emmanuel Bengio

Emmanuel Bengio

Membre industriel associé
Scientifique en apprentissage automatique, Recursion
Sujets de recherche
Apprentissage par renforcement
Apprentissage profond
GFlowNets
Modèles génératifs
Modélisation moléculaire

Biographie

Emmanuel Bengio est chercheur en ML à Valence Labs/Recursion, où il travaille sur l'intersection des GFlowNets et de la découverte de médicaments. Il a fait son doctorat sous la direction de Joelle Pineau et Doina Precup à McGill/Mila - Institut québécois d'intelligence artificielle, en se concentrant sur la compréhension de la généralisation dans la RL profonde.

Publications

GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates in an active learning context, w… (voir plus)ith a training objective that makes them approximately sample in proportion to a given reward function. In this paper, we show a number of additional theoretical properties of GFlowNets. They can be used to estimate joint probability distributions and the corresponding marginal distributions where some variables are unspecified and, of particular interest, can represent distributions over composite objects like sets and graphs. GFlowNets amortize the work typically done by computationally expensive MCMC methods in a single but trained generative pass. They could also be used to estimate partition functions and free energies, conditional probabilities of supersets (supergraphs) given a subset (subgraph), as well as marginal distributions over all supersets (supergraphs) of a given set (graph). We introduce variations enabling the estimation of entropy and mutual information, sampling from a Pareto frontier, connections to reward-maximizing policies, and extensions to stochastic environments, continuous actions and modular energy functions.
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates in an active learning context, w… (voir plus)ith a training objective that makes them approximately sample in proportion to a given reward function. In this paper, we show a number of additional theoretical properties of GFlowNets. They can be used to estimate joint probability distributions and the corresponding marginal distributions where some variables are unspecified and, of particular interest, can represent distributions over composite objects like sets and graphs. GFlowNets amortize the work typically done by computationally expensive MCMC methods in a single but trained generative pass. They could also be used to estimate partition functions and free energies, conditional probabilities of supersets (supergraphs) given a subset (subgraph), as well as marginal distributions over all supersets (supergraphs) of a given set (graph). We introduce variations enabling the estimation of entropy and mutual information, sampling from a Pareto frontier, connections to reward-maximizing policies, and extensions to stochastic environments, continuous actions and modular energy functions.
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates in an active learning context, w… (voir plus)ith a training objective that makes them approximately sample in proportion to a given reward function. In this paper, we show a number of additional theoretical properties of GFlowNets. They can be used to estimate joint probability distributions and the corresponding marginal distributions where some variables are unspecified and, of particular interest, can represent distributions over composite objects like sets and graphs. GFlowNets amortize the work typically done by computationally expensive MCMC methods in a single but trained generative pass. They could also be used to estimate partition functions and free energies, conditional probabilities of supersets (supergraphs) given a subset (subgraph), as well as marginal distributions over all supersets (supergraphs) of a given set (graph). We introduce variations enabling the estimation of entropy and mutual information, sampling from a Pareto frontier, connections to reward-maximizing policies, and extensions to stochastic environments, continuous actions and modular energy functions.
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates in an active learning context, w… (voir plus)ith a training objective that makes them approximately sample in proportion to a given reward function. In this paper, we show a number of additional theoretical properties of GFlowNets. They can be used to estimate joint probability distributions and the corresponding marginal distributions where some variables are unspecified and, of particular interest, can represent distributions over composite objects like sets and graphs. GFlowNets amortize the work typically done by computationally expensive MCMC methods in a single but trained generative pass. They could also be used to estimate partition functions and free energies, conditional probabilities of supersets (supergraphs) given a subset (subgraph), as well as marginal distributions over all supersets (supergraphs) of a given set (graph). We introduce variations enabling the estimation of entropy and mutual information, sampling from a Pareto frontier, connections to reward-maximizing policies, and extensions to stochastic environments, continuous actions and modular energy functions.
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
GFlowNet Foundations
Yoshua Bengio
Tristan Deleu
Edward J Hu
Salem Lahlou
Mo Tiwari
Emmanuel Bengio
2021-11-17
ArXiv (prépublication)
arxiv.org
arxiv.org
Correcting Momentum in Temporal Difference Learning
Emmanuel Bengio
Joelle Pineau
Doina Precup
A common optimization tool used in deep reinforcement learning is momentum, which consists in accumulating and discounting past gradients, r… (voir plus)eapplying them at each iteration. We argue that, unlike in supervised learning, momentum in Temporal Difference (TD) learning accumulates gradients that become doubly stale: not only does the gradient of the loss change due to parameter updates, the loss itself changes due to bootstrapping. We first show that this phenomenon exists, and then propose a first-order correction term to momentum. We show that this correction term improves sample efficiency in policy evaluation by correcting target value drift. An important insight of this work is that deep RL methods are not always best served by directly importing techniques from the supervised setting.
2021-06-07
ArXiv (prépublication)
openreview.net
openreview.net