Elvis Dohmatob

Membre académique associé

Professeur agrégé, Concordia University, Département d'informatique et de génie logiciel

Chercheur, Meta Facebook AI Research (FAIR)

Sujets de recherche

Équité algorithmique

Optimisation

Robustesse antagoniste

Théorie de l'apprentissage automatique

Site web

Google Scholar

Publications

Individual Brain Charting dataset extension, third release for movie watching and retinotopy data

Ana Lúısa Pinho

Hugo Richard

Ana Fernanda Ponce

Michael Eickenberg

Alexis Amadon

Elvis Dohmatob

Isabelle Denghien

Juan Jesús Torre

Swetha Shankar

Himanshu Aggarwal

Alexis Thual

Thomas Chapalain

Chantal Ginisty

Séverine Becuwe-Desmidt

Séverine Roger

Yann Lecomte

Valérie Berland

Laurence Laurier

Véronique Joly-Testault

Gaëlle Médiouni-Cloarec … (voir 6 de plus)

Christine Doublé

Bernadette Martins

Gael Varoquaux

Stanislas Dehaene

Lucie Hertz-Pannier

Bertrand Thirion

2024-06-05

Scientific Data (publié)

doi.org

Model Collapse Demystified: The Case of Regression

Elvis Dohmatob

Yunzhen Feng

Julia Kempe

In the era of proliferation of large language and image generation models, the phenomenon of "model collapse" refers to the situation whereb… (voir plus)y as a model is trained recursively on data generated from previous generations of itself over time, its performance degrades until the model eventually becomes completely useless, i.e the model collapses. In this work, we study this phenomenon in the setting of high-dimensional regression and obtain analytic formulae which quantitatively outline this phenomenon in a broad range of regimes. In the special case of polynomial decaying spectral and source conditions, we obtain modified scaling laws which exhibit new crossover phenomena from fast to slow rates. We also propose a simple strategy based on adaptive regularization to mitigate model collapse. Our theoretical results are validated with experiments.

2024-02-01

arXiv (publié)

doi.org

arxiv.org

Precise Accuracy / Robustness Tradeoffs in Regression: Case of General Norms

Elvis Dohmatob

Meyer Scetbon

2024-01-01

International Conference on Machine Learning (publié)

proceedings.mlr.press

Dark control: The default mode network as a reinforcement learning agent

Elvis Dohmatob