David Rolnick

Membre académique principal

drolnick@mila.quebec

Chaire en IA Canada-CIFAR

Professeur adjoint, McGill University, École d'informatique

Professeur associé, Université de Montréal, Département d'informatique et de recherche opérationnelle

Site web

Google Scholar

Biographie

David Rolnick est professeur adjoint et titulaire d’une chaire en IA Canada-CIFAR à l'École d'informatique de l'Université McGill et membre académique principal de Mila – Institut québécois d’intelligence artificielle. Ses travaux portent sur les applications de l'apprentissage automatique dans la lutte contre le changement climatique. Il est cofondateur et président de Climate Change AI et codirecteur scientifique de Sustainability in the Digital Age. David Rolnick a obtenu un doctorat en mathématiques appliquées du Massachusetts Institute of Technology (MIT). Il a été chercheur postdoctoral en sciences mathématiques à la National Science Foundation (NSF), chercheur diplômé à la NSF et boursier Fulbright. Il a figuré sur la liste des « 35 innovateurs de moins de 35 ans » de la MIT Technology Review en 2021.

Étudiants actuels

Alex Hernandez-Garcia

Postdoctorat - Université de Montréal

Superviseur⋅e principal⋅e :

Collaborateur·rice de recherche - Université Paris-Saclay

Co-superviseur⋅e :

Yoshua Bengio

alexandre.duval@mila.quebec

Site web

Ali Ramlaoui

Collaborateur·rice de recherche

ali.ramlaoui@mila.quebec

Github

Amna El-Mustafa

Collaborateur·rice de recherche

amna.elmustafa@mila.quebec

Anna Viklund

Collaborateur·rice de recherche

anna.viklund@mila.quebec

Github

Arthur Ouaknine

Postdoctorat - McGill University

arthur.ouaknine@mila.quebec

Collaborateur·rice de recherche

ayush.prasad@mila.quebec

Basile Terver

Collaborateur·rice de recherche

Co-superviseur⋅e :

Yoshua Bengio

basile.terver@mila.quebec

Benjamin Akera Binen

Maîtrise recherche - McGill University

Doctorat - McGill University

catherine.villeneuve@mila.quebec

Github

Chandni Nagda

Collaborateur·rice de recherche

chandni.nagda@mila.quebec

Christina Winkler

Collaborateur·rice de recherche

christina.winkler@mila.quebec

Stagiaire de recherche - Johannes Kepler University

christina.humer@mila.quebec

Site web

Github

Google Scholar

David Alexandre Mickisch

Collaborateur·rice de recherche

david.mickisch@mila.quebec

Github

Devin Kwok

Doctorat - McGill University

devin.kwok@mila.quebec

Postdoctorat - Université de Montréal

Superviseur⋅e principal⋅e :

Yoshua Bengio

donna.vakalis@mila.quebec

Github

Google Scholar

Eya Cherif

Stagiaire de recherche

eya.cherif@mila.quebec

Felix Andreas Nahrstedt

Stagiaire de recherche - Université de Montréal

felix-andreas.nahrstedt@mila.quebec

Site web

Fagner Cunha

Collaborateur·rice alumni

fagner.cunha@mila.quebec

Doctorat - McGill University

gabriel.tseng@mila.quebec

Site web

Github

Gaurav Iyer

Maîtrise recherche - McGill University

gaurav.iyer@mila.quebec

Google Scholar

Gül Sena Altıntaş

Stagiaire de recherche - Université de Montréal

gul-sena.altintas@mila.quebec

Collaborateur·rice de recherche - Karlsruhe Institute of Technology

ilija.trajkovic@mila.quebec

Github

Juan Sebastián Cañas

Collaborateur·rice de recherche

juan-sebastian.canas-silva@mila.quebec

Doctorat - McGill University

julia.kaltenborn@mila.quebec

Collaborateur·rice de recherche

julien.boussard@mila.quebec

Marlena Reil

Stagiaire de recherche - Osnabrueck university

marlena.reil@mila.quebec

Github

Mehrab Hamidi

Maîtrise recherche - McGill University

mehrab.hamidi@mila.quebec

Github

Google Scholar

Michael Bunsen

Collaborateur·rice de recherche - McGill University

michael.bunsen@mila.quebec

Site web

Github

Mohit Anand

Collaborateur·rice de recherche - The University of Dresden, Helmholtz Centre for Environmental Research Leipzig

mohit.anand@mila.quebec

Github

Nikolaos Ioannis Bountos

Collaborateur·rice de recherche - National Observatory of Athens

nikolaos.bountos@mila.quebec

Collaborateur·rice de recherche

paula.harder@mila.quebec

Collaborateur·rice de recherche

pratinav.seth@learner.manipal.edu

Site web

Github

Google Scholar

Qidong Yang

Collaborateur·rice de recherche

qidong.yang@mila.quebec

Raesetje Sefala

Doctorat - McGill University

raesetje.sefala@mila.quebec

Site web

Ruben Cartuyvels

Collaborateur·rice de recherche - KU Leuven

ruben.cartuyvels@mila.quebec

Sebastian Hickman

Stagiaire de recherche - Cambridge University

sebastian.hickman@mila.quebec

Theo Saulus

Collaborateur·rice de recherche

Co-superviseur⋅e :

Yoshua Bengio

theo.saulus@mila.quebec

Tiffany Vlaar

Postdoctorat - McGill University

tiffany.vlaar@mila.quebec

Google Scholar

Venkatesh Ramesh

Doctorat - Université de Montréal

venkatesh.ramesh@mila.quebec

Todosijevic Viktor Todosijevic

Collaborateur·rice de recherche - RWTH Aachen University (Rheinisch-Westfälische Technische Hochschule Aachen)

Co-superviseur⋅e :

Yoshua Bengio

viktor.todosijevic@mila.quebec

Github

Yuyan Chen

Maîtrise recherche - McGill University

yuyan.chen@mila.quebec

Site web

Github

Publications

On the importance of catalyst-adsorbate 3D interactions for relaxed energy predictions

Alvaro Carbonero

Alexandre AGM Duval

Victor Schmidt

Santiago Miret

Alex Hernandez-Garcia

Yoshua Bengio

David Rolnick

The use of machine learning for material property prediction and discovery has traditionally centered on graph neural networks that incorpor… (voir plus)ate the geometric configuration of all atoms. However, in practice not all this information may be readily available, e.g.~when evaluating the potentially unknown binding of adsorbates to catalyst. In this paper, we investigate whether it is possible to predict a system's relaxed energy in the OC20 dataset while ignoring the relative position of the adsorbate with respect to the electro-catalyst. We consider SchNet, DimeNet++ and FAENet as base architectures and measure the impact of four modifications on model performance: removing edges in the input graph, pooling independent representations, not sharing the backbone weights and using an attention mechanism to propagate non-geometric relative information. We find that while removing binding site information impairs accuracy as expected, modified models are able to predict relaxed energies with remarkably decent MAE. Our work suggests future research directions in accelerated materials discovery where information on reactant configurations can be reduced or altogether omitted.

2023-10-27

NeurIPS.cc/2023/Workshop/AI4Mat (poster)

doi.org

openreview.net

ClimateSet: A Large-Scale Climate Model Dataset for Machine Learning

Julia Kaltenborn

Charlotte Emilie Elektra Lange

Venkatesh Ramesh

Philippe Brouillard

Yaniv Gurwicz

Chandni Nagda

Jakob Runge

Peer Nowack

David Rolnick

Climate models have been key for assessing the impact of climate change and simulating future climate scenarios. The machine learning (ML) c… (voir plus)ommunity has taken an increased interest in supporting climate scientists’ efforts on various tasks such as climate model emulation, downscaling, and prediction tasks. Many of those tasks have been addressed on datasets created with single climate models. However, both the climate science and ML communities have suggested that to address those tasks at scale, we need large, consistent, and ML-ready climate model datasets. Here, we introduce ClimateSet, a dataset containing the inputs and outputs of 36 climate models from the Input4MIPs and CMIP6 archives. In addition, we provide a modular dataset pipeline for retrieving and preprocessing additional climate models and scenarios. We showcase the potential of our dataset by using it as a benchmark for ML-based climate model emulation. We gain new insights about the performance and generalization capabilities of the different ML models by analyzing their performance across different climate models. Furthermore, the dataset can be used to train an ML emulator on several climate models instead of just one. Such a “super-emulator” can quickly project new climate change scenarios, complementing existing scenarios already provided to policymakers. We believe ClimateSet will create the basis needed for the ML community to tackle climate-related tasks at scale.

openreview.net

SatBird: a Dataset for Bird Species Distribution Modeling using Remote Sensing and Citizen Science Data

Mélisande Teng

Amna Elmustafa

Benjamin Akera

Hager Radi

Multi-variable Hard Physical Constraints for Climate Model Downscaling

Jose Gonz'alez-Abad

'Alex Hern'andez-Garc'ia

Paula Harder

David Rolnick

Jos'e Manuel Guti'errez

2023-08-02

ArXiv (prépublication)

doi.org

arxiv.org

FAENet: Frame Averaging Equivariant GNN for Materials Modeling

Alexandre AGM Duval

Victor Schmidt

Alex Hernandez-Garcia

Santiago Miret

Fragkiskos D. Malliaros

Yoshua Bengio

David Rolnick

Applications of machine learning techniques for materials modeling typically involve functions known to be equivariant or invariant to speci… (voir plus)fic symmetries. While graph neural networks (GNNs) have proven successful in such tasks, they enforce symmetries via the model architecture, which often reduces their expressivity, scalability and comprehensibility. In this paper, we introduce (1) a flexible framework relying on stochastic frame-averaging (SFA) to make any model E(3)-equivariant or invariant through data transformations. (2) FAENet: a simple, fast and expressive GNN, optimized for SFA, that processes geometric information without any symmetrypreserving design constraints. We prove the validity of our method theoretically and empirically demonstrate its superior accuracy and computational scalability in materials modeling on the OC20 dataset (S2EF, IS2RE) as well as common molecular modeling tasks (QM9, QM7-X). A package implementation is available at https://faenet.readthedocs.io.

2023-07-03

Proceedings of the 40th International Conference on Machine Learning (publié)

doi.org

openreview.net

Hidden Symmetries of ReLU Networks

J. Grigsby

Elisenda Grigsby

Kathryn Lindsey

David Rolnick

2023-07-03

Proceedings of the 40th International Conference on Machine Learning (publié)

doi.org

openreview.net

Maximal Initial Learning Rates in Deep ReLU Networks

Gaurav Iyer

Boris Hanin

David Rolnick

2023-07-03

Proceedings of the 40th International Conference on Machine Learning (publié)

doi.org

openreview.net

Fourier Neural Operators for Arbitrary Resolution Climate Data Downscaling

Qidong Yang

Alex Hernandez-Garcia

Paula Harder

Venkatesh Ramesh

Prasanna Sattegeri

D. Szwarcman

C. Watson

David Rolnick

Climate simulations are essential in guiding our understanding of climate change and responding to its effects. However, it is computational… (voir plus)ly expensive to resolve complex climate processes at high spatial resolution. As one way to speed up climate simulations, neural networks have been used to downscale climate variables from fast-running low-resolution simulations, but high-resolution training data are often unobtainable or scarce, greatly limiting accuracy. In this work, we propose a downscaling method based on the Fourier neural operator. It trains with data of a small upsampling factor and then can zero-shot downscale its input to arbitrary unseen high resolution. Evaluated both on ERA5 climate model data and on the Navier-Stokes equation solution data, our downscaling model significantly outperforms state-of-the-art convolutional and generative adversarial downscaling models, both in standard single-resolution downscaling and in zero-shot generalization to higher upsampling factors. Furthermore, we show that our method also outperforms state-of-the-art data-driven partial differential equation solvers on Navier-Stokes equations. Overall, our work bridges the gap between simulation of a physical process and interpolation of low-resolution output, showing that it is possible to combine both approaches and significantly improve upon each other.

2023-05-23

ArXiv (prépublication)

doi.org

arxiv.org

Bird Distribution Modelling using Remote Sensing and Citizen Science data

Mélisande Teng

Amna Elmustafa

Benjamin Akera

Hugo Larochelle

David Rolnick

2023-05-01

ArXiv (prépublication)

doi.org

arxiv.org

Lightweight, Pre-trained Transformers for Remote Sensing Timeseries

Gabriel Tseng

Ruben Cartuyvels

Ivan Zvonkov

Mirali Purohit

David Rolnick

Hannah Kerner

Machine learning methods for satellite data have a range of societally relevant applications, but labels used to train models can be difficu… (voir plus)lt or impossible to acquire. Self-supervision is a natural solution in settings with limited labeled data, but current self-supervised models for satellite data fail to take advantage of the characteristics of that data, including the temporal dimension (which is critical for many applications, such as monitoring crop growth) and availability of data from many complementary sensors (which can significantly improve a model's predictive performance). We present Presto (the Pretrained Remote Sensing Transformer), a model pre-trained on remote sensing pixel-timeseries data. By designing Presto specifically for remote sensing data, we can create a significantly smaller but performant model. Presto excels at a wide variety of globally distributed remote sensing tasks and performs competitively with much larger models while requiring far less compute. Presto can be used for transfer learning or as a feature extractor for simple models, enabling efficient deployment at scale.

2023-04-27

ArXiv (preprint)

doi.org

openreview.net

Maximal Initial Learning Rates in Deep ReLU Networks

Gaurav Iyer

Boris Hanin

David Rolnick

Training a neural network requires choosing a suitable learning rate, which involves a trade-off between speed and effectiveness of converge… (voir plus)nce. While there has been considerable theoretical and empirical analysis of how large the learning rate can be, most prior work focuses only on late-stage training. In this work, we introduce the maximal initial learning rate

2023-04-24

ICML.cc/2023/Conference (poster)

doi.org

openreview.net

Semi-Supervised Object Detection for Agriculture

Gabriel Tseng

Krisztina Sinkovics

Tom Watsham

David Rolnick

Thomas C. Walters

2023-01-26

AAAI.org/2023/Workshop/AIAFS (poster)

openreview.net

La recherche en IA au service du monde réel

Boussole des politiques en IA

Vie étudiante et ressources

David Rolnick

Biographie

Étudiants actuels

Publications

La recherche en IA au service du monde réel

Boussole des politiques en IA

Vie étudiante et ressources

Mots-clés populaires:

David Rolnick

Biographie

Étudiants actuels

Publications