David Rolnick

Biographie

David Rolnick est professeur adjoint et titulaire d’une chaire en IA Canada-CIFAR à l'École d'informatique de l'Université McGill et membre académique principal de Mila – Institut québécois d’intelligence artificielle. Ses travaux portent sur les applications de l'apprentissage automatique dans la lutte contre le changement climatique. Il est cofondateur et président de Climate Change AI et codirecteur scientifique de Sustainability in the Digital Age. David Rolnick a obtenu un doctorat en mathématiques appliquées du Massachusetts Institute of Technology (MIT). Il a été chercheur postdoctoral en sciences mathématiques à la National Science Foundation (NSF), chercheur diplômé à la NSF et boursier Fulbright. Il a figuré sur la liste des « 35 innovateurs de moins de 35 ans » de la MIT Technology Review en 2021.

Étudiants actuels

Benjamin Akera Binen

Collaborateur·rice alumni - McGill

Collaborateur·rice alumni - UdeM

Collaborateur·rice de recherche - Cambridge University

Co-superviseur⋅e :

Mohit Anand

Collaborateur·rice de recherche - The University of Dresden, Helmholtz Centre for Environmental Research Leipzig

Ayush Ayush Prasad

Collaborateur·rice de recherche

Nikolaos Ioannis Bountos

Collaborateur·rice de recherche - National Observatory of Athens

Postdoctorat - McGill

Michael Bunsen

Collaborateur·rice de recherche - McGill

Juan Sebastián Cañas

Collaborateur·rice de recherche

Collaborateur·rice de recherche - N/A

Co-superviseur⋅e :

Yoshua Bengio

Yuyan Chen

Maîtrise recherche - McGill

Eya Cherif

Stagiaire de recherche - Leipzig University

Amna El-Mustafa

Collaborateur·rice de recherche

Mohamed Elabbas

Collaborateur·rice de recherche

Paula Harder

Visiteur de recherche indépendant

Collaborateur·rice de recherche - UdeM

Christina Humer

Collaborateur·rice de recherche - Johannes Kepler University

Christina Isaicu Isaicu

Collaborateur·rice de recherche - University of Amsterdam

Gaurav Iyer

Maîtrise recherche - McGill

Doctorat - McGill

Devin Kwok

Doctorat - McGill

Collaborateur·rice de recherche

Vanessa Mac

Collaborateur·rice de recherche - University of Waterloo

David Mickisch

Collaborateur·rice de recherche

Felix Andreas Nahrstedt

Stagiaire de recherche - UdeM

Arthur Ouaknine

Postdoctorat - McGill

Co-superviseur⋅e :

Lena Podina

Doctorat - University of Waterloo

Co-superviseur⋅e :

Doctorat - UdeM

Maîtrise recherche - McGill

luca.schmidt@uni-tuebingen.de

Luca Marie Schmidt

Collaborateur·rice de recherche - University of Tübingen

Collaborateur·rice de recherche

seth.pratinav@gmail.com

Collaborateur·rice de recherche - RWTH Aachen University (Rheinisch-Westfälische Technische Hochschule Aachen)

Co-superviseur⋅e :

Yoshua Bengio

Ilija Trajković

Collaborateur·rice de recherche - Karlsruhe Institute of Technology

Doctorat - McGill

Postdoctorat - UdeM

Superviseur⋅e principal⋅e :

Collaborateur·rice de recherche

anna.viklund@mila.quebec

Doctorat - McGill

Collaborateur·rice alumni - McGill

Publications

Improving Molecular Modeling with Geometric GNNs: an Empirical Study

Ali Ramlaoui

Théo Saulus

Basile Terver

Victor Schmidt

Fragkiskos D. Malliaros

Alexandre AGM Duval

2024-06-17

ICML.cc/2024/Workshop/ML4LMS (poster)

Gintare Karolina Dziugaite

Linear Weight Interpolation Leads to Transient Performance Gains

Gaurav Iyer

2024-06-16

ICML.cc/2024/Workshop/HiLD (poster)

The Butterfly Effect: Tiny Perturbations Cause Neural Network Training to Diverge

Gül Sena Altıntaş

Devin Kwok

Neural network training begins with a chaotic phase in which the network is sensitive to small perturbations, such as those caused by stocha… (voir plus)stic gradient descent (SGD). This sensitivity can cause identically initialized networks to diverge both in parameter space and functional similarity. However, the exact degree to which networks are sensitive to perturbation, and the sensitivity of networks as they transition out of the chaotic phase, is unclear. To address this uncertainty, we apply a controlled perturbation at a single point in training time and measure its effect on otherwise identical training trajectories. We find that both the

2024-06-16

ICML.cc/2024/Workshop/HiLD (poster)

A machine learning pipeline for automated insect monitoring

Aditya Jain

Fagner Cunha

M. J. Bunsen

L. Pasi

Anna Viklund

Maxim Larrivée

Climate change and other anthropogenic factors have led to a catastrophic decline in insects, endangering both biodiversity and the ecosyste… (voir plus)m services on which human society depends. Data on insect abundance, however, remains woefully inadequate. Camera traps, conventionally used for monitoring terrestrial vertebrates, are now being modified for insects, especially moths. We describe a complete, open-source machine learning-based software pipeline for automated monitoring of moths via camera traps, including object detection, moth/non-moth classification, fine-grained identification of moth species, and tracking individuals. We believe that our tools, which are already in use across three continents, represent the future of massively scalable data collection in entomology.

2024-06-01

arXiv (publié)

Climate Variable Downscaling with Conditional Normalizing Flows

Christina Winkler

Paula Harder

Predictions of global climate models typically operate on coarse spatial scales due to the large computational costs of climate simulations.… (voir plus) This has led to a considerable interest in methods for statistical downscaling, a similar process to super-resolution in the computer vision context, to provide more local and regional climate information. In this work, we apply conditional normalizing flows to the task of climate variable downscaling. We showcase its successful performance on an ERA5 water content dataset for different upsampling factors. Additionally, we show that the method allows us to assess the predictive uncertainty in terms of standard deviation from the fitted conditional distribution mean.

2024-05-31

ArXiv (prépublication)

Position: Application-Driven Innovation in Machine Learning

Alan Aspuru-Guzik

Sara Beery

Bistra Dilkina

Priya L. Donti

Marzyeh Ghassemi

Hannah Kerner

Claire Monteleoni

Esther Rolf

Milind Tambe

Adam White

2024-05-01

ICML.cc/2024/Conference (poster)

proceedings.mlr.press

Application-Driven Innovation in Machine Learning

Alan Aspuru-Guzik

Sara Beery

Bistra Dilkina

Priya L. Donti

Marzyeh Ghassemi

Hannah Kerner

Claire Monteleoni

Esther Rolf

Milind Tambe

Adam White

As applications of machine learning proliferate, innovative algorithms inspired by specific real-world challenges have become increasingly i… (voir plus)mportant. Such work offers the potential for significant impact not merely in domains of application but also in machine learning itself. In this paper, we describe the paradigm of application-driven research in machine learning, contrasting it with the more standard paradigm of methods-driven research. We illustrate the benefits of application-driven machine learning and how this approach can productively synergize with methods-driven work. Despite these benefits, we find that reviewing, hiring, and teaching practices in machine learning often hold back application-driven innovation. We outline how these processes may be improved.

2024-03-26

ArXiv (prépublication)

Predicting Species Occurrence Patterns from Partial Observations

Hager Radi

Mélisande Teng

To address the interlinked biodiversity and climate crises, we need an understanding of where species occur and how these patterns are chang… (voir plus)ing. However, observational data on most species remains very limited, and the amount of data available varies greatly between taxonomic groups. We introduce the problem of predicting species occurrence patterns given (a) satellite imagery, and (b) known information on the occurrence of other species. To evaluate algorithms on this task, we introduce SatButterfly, a dataset of satellite images, environmental data and observational data for butterflies, which is designed to pair with the existing SatBird dataset of bird observational data. To address this task, we propose a general model, R-Tran, for predicting species occurrence patterns that enables the use of partial observational data wherever found. We find that R-Tran outperforms other methods in predicting species encounter rates with partial information both within a taxon (birds) and across taxa (birds and butterflies). Our approach opens new perspectives to leveraging insights from species with abundant data to other species with scarce data, by modelling the ecosystems in which they co-occur.

2024-03-26

ArXiv (prépublication)

Stealing Part of a Production Language Model

Nicholas Carlini

Daniel Paleka

Krishnamurthy Dj Dvijotham

Thomas Steinke

Jonathan Hayase

A. Feder Cooper

Katherine Lee

Matthew Jagielski

Milad Nasr

Arthur Conmy

Eric Wallace

Florian Tramèr

We introduce the first model-stealing attack that extracts precise, nontrivial information from black-box production language models like Op… (voir plus)enAI's ChatGPT or Google's PaLM-2. Specifically, our attack recovers the embedding projection layer (up to symmetries) of a transformer model, given typical API access. For under \

2024-03-11

ArXiv (prépublication)

Stealing Part of a Production Language Model

Nicholas Carlini

Daniel Paleka

Krishnamurthy Dj Dvijotham

Thomas Steinke

Jonathan Hayase

A. Feder Cooper

Katherine Lee

Matthew Jagielski

Milad Nasr

Arthur Conmy

Eric Wallace

Florian Tramèr

2024-03-11

ArXiv (prépublication)

Stealing Part of a Production Language Model

Nicholas Carlini

Daniel Paleka

Krishnamurthy Dvijotham

Thomas Steinke

Jonathan Hayase

A. Feder Cooper

Katherine Lee

Matthew Jagielski

Milad Nasr

Arthur Conmy

Eric Wallace

Florian Tramèr

2024-03-11

ArXiv (prépublication)

Tackling Climate Change with Machine Learning: Fostering the Maturity of ML Applications for Climate Change

Shiva Madadkhani

Olivia Mendivil Ramos

Millie Chapman

Jesse Dunietz

Arthur Ouaknine

Yoshua Bengio

2024-03-08

ICLR.cc/2024/Workshop_Proposals (publié)