Portrait de Michael Noukhovitch

Michael Noukhovitch

Doctorat - UdeM
Superviseur⋅e principal⋅e
Aaron Courville
Sujets de recherche
Alignement de l'IA
Apprentissage de représentations
Apprentissage par renforcement
Apprentissage profond
Traitement du langage naturel
Site web
Google Scholar
GitHub

Publications

Pretraining Representations for Data-Efficient Reinforcement Learning
Max Schwarzer
Nitarshan Rajkumar
Michael Noukhovitch
Ankesh Anand
Laurent Charlin
(Rex) Devon Hjelm
Philip Bachman
Aaron Courville
Data efficiency is a key challenge for deep reinforcement learning. We address this problem by using unlabeled data to pretrain an encoder w… (voir plus)hich is then finetuned on a small amount of task-specific data. To encourage learning representations which capture diverse aspects of the underlying MDP, we employ a combination of latent dynamics modelling and unsupervised goal-conditioned RL. When limited to 100k steps of interaction on Atari games (equivalent to two hours of human experience), our approach significantly surpasses prior work combining offline representation pretraining with task-specific finetuning, and compares favourably with other pretraining methods that require orders of magnitude more data. Our approach shows particular promise when combined with larger models as well as more diverse, task-aligned observational data -- approaching human-level performance and data-efficiency on Atari in our best setting.
openreview.net
Systematic Generalization: What Is Required and Can It Be Learned?
Dzmitry Bahdanau*
Shikhar Murty*
Michael Noukhovitch
Thien Huu Nguyen
Harm de Vries
Aaron Courville
2019-01-01
ICLR.cc/2019/Conference (poster)
openreview.net
openreview.net
Commonsense mining as knowledge base completion? A study on the impact of novelty
Stanisław Jastrzębski
Dzmitry Bahdanau
Seyedarian Hosseini
Michael Noukhovitch
Yoshua Bengio
Jackie Cheung
Commonsense knowledge bases such as ConceptNet represent knowledge in the form of relational triples. Inspired by recent work by Li et al., … (voir plus)we analyse if knowledge base completion models can be used to mine commonsense knowledge from raw text. We propose novelty of predicted triples with respect to the training set as an important factor in interpreting results. We critically analyse the difficulty of mining novel commonsense knowledge, and show that a simple baseline method that outperforms the previous state of the art on predicting more novel triples.
2018-06-01
Proceedings of the Workshop on Generalization in the Age of Deep Learning (publié)
doi.org
arxiv.org