Hugo Larochelle

Core Industry Member

Canada CIFAR AI Chair

Adjunct professor, Université de Montréal, Depatment of Computer Science and Operations Research

Research Scientist, Google DeepMind

Research Topics

Deep Learning

Google Scholar

Biography

I am a researcher in the Google DeepMind (previously Google Brain) team in Montréal, an adjunct professor at Université de Montréal, and a Canada CIFAR AI Chair. My research focuses on the study and development of deep learning algorithms.

Current Students

Sangnie Bhardwaj

PhD - Université de Montréal

Principal supervisor :

Guillaume Lajoie

Mélisande Astrid Crystal Teng

PhD - Université de Montréal

Principal supervisor :

Yoshua Bengio

Website

Github

Hattie Zhou

PhD - Université de Montréal

Co-supervisor :

Aaron Courville

Publications

Movie Description

Anna Rohrbach

Atousa Torabi

Marcus Rohrbach

Niket Tandon

Chris Pal

Hugo Larochelle

Aaron Courville

Bernt Schiele

2017-01-25

International Journal of Computer Vision (published)

doi.org

arxiv.org

Modulating early visual processing by language

Harm de Vries

Florian Strub

Jérémie Mary

Hugo Larochelle

Olivier Pietquin

Aaron Courville

It is commonly assumed that language refers to high-level visual concepts while leaving low-level visual processing unaffected. This view do… (see more)minates the current literature in computational models for language-vision tasks, where visual and linguistic input are mostly processed independently before being fused into a single representation. In this paper, we deviate from this classic pipeline and propose to modulate the \emph{entire visual processing} by linguistic input. Specifically, we condition the batch normalization parameters of a pretrained residual network (ResNet) on a language embedding. This approach, which we call MOdulated RESnet (\MRN), significantly improves strong baselines on two visual question answering tasks. Our ablation study shows that modulating from the early stages of the visual processing is beneficial.

arxiv.org

Movie Description

Anna Rohrbach

Atousa Torabi

Marcus Rohrbach

Niket Tandon

Chris Pal

Hugo Larochelle

Aaron Courville

Bernt Schiele

2016-05-12

ArXiv (preprint)