Tal Arbel

Biographie

Tal Arbel est professeure titulaire au Département de génie électrique et informatique de l’Université McGill, où elle dirige le groupe de vision probabiliste et le laboratoire d'imagerie médicale du Centre sur les machines intelligentes.

Elle est titulaire d'une chaire en IA Canada-CIFAR et membre associée de Mila – Institut québécois d’intelligence artificielle ainsi que du Centre de recherche sur le cancer Goodman. Les recherches de la professeure Arbel portent sur le développement de méthodes probabilistes d'apprentissage profond dans les domaines de la vision par ordinateur et de l’analyse d'imagerie médicale pour un large éventail d'applications dans le monde réel, avec un accent particulier sur les maladies neurologiques.

Elle a remporté le prix de la recherche Christophe Pierre 2019 de McGill Engineering et est Fellow à l'Académie canadienne d'ingénierie. Elle fait régulièrement partie de l'équipe organisatrice de grandes conférences internationales sur la vision par ordinateur et l'analyse d'imagerie médicale (par exemple celles de la Medical Image Computing and Computer-Assisted Intervention Society/MICCAI et de Medical Imaging with Deep Learning/MIDL, l’International Conference on Computer Vision/ICCV ou encore la Conference on Computer Vision and Pattern Recognition/CVPR). Elle est rédactrice en chef et cofondatrice de la revue Machine Learning for Biomedical Imaging (MELBA).

Étudiants actuels

Cornelius Crijnen

Doctorat - McGill

Elizabeth Laura Janes

Maîtrise recherche - McGill

Emily Kaczmarek

Doctorat - McGill

Toky Raharison Ralambomihanta

Baccalauréat - McGill

Ryan Rezai

Maîtrise recherche - McGill

Parham Saremi

Maîtrise recherche - McGill

Xing Shen

Maîtrise recherche - McGill

Maîtrise recherche - McGill

Minh To

Collaborateur·rice de recherche - UBC

PRISM : Un modèle d'IA générative explicable pour l'imagerie médicale

Billets de blogue

Image of an Xray and the DDIM process to generate counterfactual version of Xrays

1 juillet 2025

par

Amar Kumar

Anita Kriz

Mohammed Havaei

Tal Arbel

Lire l'article

Publications

RL4Med-DDPO: Reinforcement Learning for Controlled Guidance Towards Diverse Medical Image Generation using Vision-Language Foundation Models

Parham Saremi

Mohammed Mohammed

Zahra Tehrani Nasab

2025-02-28

arXiv (publié)

AURA: A Multi-modal Medical Agent for Understanding, Reasoning and Annotation

Nima Fathi

2024-12-31

Agentic AI/CREATE/Clinical MLLMs@MICCAI (publié)

Improving Robustness and Reliability in Medical Image Classification with Latent-Guided Diffusion and Nested-Ensembles

Xing Shen

Hengguan Huang

Once deployed, medical image analysis methods are often faced with unexpected image corruptions and noise perturbations. These unknown covar… (voir plus)iate shifts present significant challenges to deep learning based methods trained on "clean" images. This often results in unreliable predictions and poorly calibrated confidence, hence hindering clinical applicability. While recent methods have been developed to address specific issues such as confidence calibration or adversarial robustness, no single framework effectively tackles all these challenges simultaneously. To bridge this gap, we propose LaDiNE, a novel ensemble learning method combining the robustness of Vision Transformers with diffusion-based generative models for improved reliability in medical image classification. Specifically, transformer encoder blocks are used as hierarchical feature extractors that learn invariant features from images for each ensemble member, resulting in features that are robust to input perturbations. In addition, diffusion models are used as flexible density estimators to estimate member densities conditioned on the invariant features, leading to improved modeling of complex data distributions while retaining properly calibrated confidence. Extensive experiments on tuberculosis chest X-rays and melanoma skin cancer datasets demonstrate that LaDiNE achieves superior performance compared to a wide range of state-of-the-art methods by simultaneously improving prediction accuracy and confidence calibration under unseen noise, adversarial perturbations, and resolution degradation.

2024-12-31

IEEE Transactions on Medical Imaging (inconnu)

Leveraging Vision-Language Foundation Models to Reveal Hidden Image-Attribute Relationships in Medical Imaging

Anita Kriz

Barak Pertzov

2024-12-31

CVPR Workshops (publié)

Pixels Under Pressure: Exploring Fine-Tuning Paradigms for Foundation Models in High-Resolution Medical Imaging

Zahra Tehrani Nasab

Advancements in diffusion-based foundation models have improved text-to-image generation, yet most efforts have been limited to low-resoluti… (voir plus)on settings. As high-resolution image synthesis becomes increasingly essential for various applications, particularly in medical imaging domains, fine-tuning emerges as a crucial mechanism for adapting these powerful pre-trained models to task-specific requirements and data distributions. In this work, we present a systematic study, examining the impact of various fine-tuning techniques on image generation quality when scaling to high resolution 512x512 pixels. We benchmark a diverse set of fine-tuning methods, including full fine-tuning strategies and parameter-efficient fine-tuning (PEFT). We dissect how different fine-tuning methods influence key quality metrics, including Fr\'echet Inception Distance (FID), Vendi score, and prompt-image alignment. We also evaluate the utility of generated images in a downstream classification task under data-scarce conditions, demonstrating that specific fine-tuning strategies improve both generation fidelity and downstream performance when synthetic images are used for classifier training and evaluation on real images. Our code is accessible through the project website - https://tehraninasab.github.io/PixelUPressure/.

2024-12-31

ELAMI@MICCAI (publié)

The role of AI for MRI-analysis in multiple sclerosis—A brief overview

Jean-Pierre R. Falet

Steven Nobile

Aliya Szpindel

Berardino Barile

Joshua D. Durso-Finley

Douglas Arnold

2024-12-31

Frontiers Artif. Intell. (publié)

Exploring Compound Loss Functions for Brain Tumor Segmentation

Anita Kriz

Raghav Mehta

2024-12-27

Lecture Notes in Computer Science (publié)

Probabilistic Temporal Prediction of Continuous Disease Trajectories and Treatment Effects Using Neural SDEs

Joshua D. Durso-Finley

Berardino Barile

Jean-Pierre R. Falet

Douglas Arnold

Nick Pawlowski

Personalized medicine based on medical images, including predicting future individualized clinical disease progression and treatment respons… (voir plus)e, would have an enormous impact on healthcare and drug development, particularly for diseases (e.g. multiple sclerosis (MS)) with long term, complex, heterogeneous evolutions and no cure. In this work, we present the first stochastic causal temporal framework to model the continuous temporal evolution of disease progression via Neural Stochastic Differential Equations (NSDE). The proposed causal inference model takes as input the patient's high dimensional images (MRI) and tabular data, and predicts both factual and counterfactual progression trajectories on different treatments in latent space. The NSDE permits the estimation of high-confidence personalized trajectories and treatment effects. Extensive experiments were performed on a large, multi-centre, proprietary dataset of patient 3D MRI and clinical data acquired during several randomized clinical trials for MS treatments. Our results present the first successful uncertainty-based causal Deep Learning (DL) model to: (a) accurately predict future patient MS disability evolution (e.g. EDSS) and treatment effects leveraging baseline MRI, and (b) permit the discovery of subgroups of patients for which the model has high confidence in their response to treatment even in clinical trials which did not reach their clinical endpoints.

2024-10-02

Lecture Notes in Computer Science (publié)

Metrics reloaded: recommendations for image analysis validation.

Lena Maier-Hein

Annika Reinke

Evangelia Christodoulou

Ben Glocker

PATRICK GODAU

Fabian Isensee

Jens Kleesiek

Michal Kozubek

Mauricio Reyes

MICHAEL A. RIEGLER

Manuel Wiesenfarth

Michael Baumgartner

Matthias Eisenmann

DOREEN HECKMANN-NÖTZEL

A. EMRE KAVUR

TIM RÄDSCH

Minu Dietlinde Tizabi

Laura Acion

Michela Antonelli

Tal Arbel … (voir 47 de plus)

Spyridon Bakas

Peter Bankhead

Allison Benis

M. Jorge Cardoso

Veronika Cheplygina

BETH A. CIMINI

Gary S. Collins

Keyvan Farahani

Bram van Ginneken

Daniel A. Hashimoto

Michael M. Hoffman

Merel Huisman

Pierre Jannin

CHARLES E. KAHN

Alexandros Karargyris

Alan Karthikesalingam

H. Kenngott

Annette Kopp-Schneider

Anna Kreshuk

Tahsin Kurc

Bennett Landman

GEERT LITJENS

Amin Madani

Klaus Maier-Hein

Anne L. Martel

Peter Mattson

Erik Meijering

Bjoern Menze

David Moher

Karel G.M. Moons

Henning Müller

Felix Nickel

Jens Petersen

Nasir Rajpoot

Nicola Rieke

Julio Saez-Rodriguez

Clarisa S'anchez Guti'errez

Shravya Shetty

M. Smeden

Carole H. Sudre

Ronald M. Summers

Abdel Aziz Taha

Sotirios A. Tsaftaris

Ben Van Calster

Gael Varoquaux

PAUL F. JÄGER

2024-02-11

Nature Methods (publié)

Understanding metric-related pitfalls in image analysis validation

Annika Reinke

Minu D. Tizabi

Michael Baumgartner

Matthias Eisenmann

DOREEN HECKMANN-NÖTZEL

A. EMRE KAVUR

TIM RÄDSCH

Carole H. Sudre

Laura Acion

Michela Antonelli

Spyridon Bakas

Arriel Benis

Matthew B. Blaschko

Florian Buettner

M. Jorge Cardoso

Veronika Cheplygina

Jianxu Chen

Evangelia Christodoulou … (voir 59 de plus)

BETH A. CIMINI

Keyvan Farahani

LUCIANA FERRER

Gary S. Collins

Adrian Galdran

Bram van Ginneken

Ben Glocker

PATRICK GODAU

Daniel A. Hashimoto

Michael M. Hoffman

Robert Haase

Merel Huisman

Fabian Isensee

Pierre Jannin

CHARLES E. KAHN

Dagmar Kainmueller

BERNHARD KAINZ

Alexandros Karargyris

Jens Kleesiek

Florian Kofler

Thijs Kooi

Annette Kopp-Schneider

Alan Karthikesalingam

Hannes Kenngott

Michal Kozubek

Anna Kreshuk

Tahsin Kurc

Bennett A. Landman

GEERT LITJENS

Amin Madani

Klaus Maier-Hein

Anne L. Martel

Erik Meijering

Bjoern Menze

Karel G.M. Moons

Henning Müller

Felix Nickel

Peter Mattson

Jens Petersen

Susanne M. Rafelski

Nasir Rajpoot

Mauricio Reyes

MICHAEL A. RIEGLER

Nicola Rieke

Julio Saez-Rodriguez

Clara I. Sánchez

Shravya Shetty

Ronald M. Summers

Abdel A. Taha

Aleksei Tiulpin

Sotirios A. Tsaftaris

Ben Van Calster

Gael Varoquaux

Amin Madani

Ziv R. Yaniv

PAUL F. JÄGER

Lena Maier-Hein

Anne L. Martel

Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligen… (voir plus)ce (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately in relation to the underlying research problem. This could be attributed to a lack of accessibility of metric-related knowledge: While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Focusing on biomedical image analysis but with the potential of transfer to other fields, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. To facilitate comprehension, illustrations and specific examples accompany each pitfall. As a structured body of information accessible to researchers of all levels of expertise, this work enhances global comprehension of a key topic in image analysis validation.

2024-01-31

Nature Methods (publié)

DeCoDEx: Confounder Detector Guidance for Improved Diffusion-based Counterfactual Explanations

Deep learning classifiers are prone to latching onto dominant confounders present in a dataset rather than on the causal markers associated … (voir plus)with the target class, leading to poor generalization and biased predictions. Although explainability via counterfactual image generation has been successful at exposing the problem, bias mitigation strategies that permit accurate explainability in the presence of dominant and diverse artifacts remain unsolved. In this work, we propose the DeCoDEx framework and show how an external, pre-trained binary artifact detector can be leveraged during inference to guide a diffusion-based counterfactual image generator towards accurate explainability. Experiments on the CheXpert dataset, using both synthetic artifacts and real visual artifacts (support devices), show that the proposed method successfully synthesizes the counterfactual images that change the causal pathology markers associated with Pleural Effusion while preserving or ignoring the visual artifacts. Augmentation of ERM and Group-DRO classifiers with the DeCoDEx generated images substantially improves the results across underrepresented groups that are out of distribution for each class. The code is made publicly available at https://github.com/NimaFathi/DeCoDEx.

2023-12-31

MIDL (publié)

openreview.net

HyperFusion: A Hypernetwork Approach to Multimodal Integration of Tabular and Medical Imaging Data for Predictive Modeling

Daniel Duenias

Tammy Riklin Raviv

The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Recor… (voir plus)ds (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can provide a comprehensive understanding of the clinical condition of a patient, improving diagnosis and treatment decision. Deep Neural Networks (DNNs) consistently demonstrate outstanding performance in a wide range of multimodal tasks in the medical domain. However, the complex endeavor of effectively merging medical imaging with clinical, demographic and genetic information represented as numerical tabular data remains a highly active and ongoing research pursuit. We present a novel framework based on hypernetworks to fuse clinical imaging and tabular data by conditioning the image processing on the EHR's values and measurements. This approach aims to leverage the complementary information present in these modalities to enhance the accuracy of various medical applications. We demonstrate the strength and generality of our method on two different brain Magnetic Resonance Imaging (MRI) analysis tasks, namely, brain age prediction conditioned by subject's sex and multi-class Alzheimer's Disease (AD) classification conditioned by tabular data. We show that our framework outperforms both single-modality models and state-of-the-art MRI tabular data fusion methods. A link to our code can be found at https://github.com/daniel4725/HyperFusion

2023-12-31

arXiv (prépublication)