PRISM: High-Resolution&Precise Counterfactual Medical Image Generation using Language-guided Stable Diffusion
Amar Kumar
Anita Kriz
Mohammad Havaei
Developing reliable and generalizable deep learning systems for medical imaging faces significant obstacles due to spurious correlations, da… (voir plus)ta imbalances, and limited text annotations in datasets. Addressing these challenges requires architectures robust to the unique complexities posed by medical imaging data. The rapid advancements in vision-language foundation models within the natural image domain prompt the question of how they can be adapted for medical imaging tasks. In this work, we present PRISM, a framework that leverages foundation models to generate high-resolution, language-guided medical image counterfactuals using Stable Diffusion. Our approach demonstrates unprecedented precision in selectively modifying spurious correlations (the medical devices) and disease features, enabling the removal and addition of specific attributes while preserving other image characteristics. Through extensive evaluation, we show how PRISM advances counterfactual generation and enables the development of more robust downstream classifiers for clinically deployable solutions. To facilitate broader adoption and research, we make our code publicly available at https://github.com/Amarkr1/PRISM.
StarFlow: Generating Structured Workflow Outputs From Sketch Images
Patrice Bechard
Chao Wang
Amirhossein Abaskohi
Juan A. Rodriguez
David Vazquez
Spandana Gella
Sai Rajeswar
Perouz Taslakian
StarFlow: Generating Structured Workflow Outputs From Sketch Images
Patrice Bechard
Chao Wang
Amirhossein Abaskohi
Juan A. Rodriguez
David Vazquez
Spandana Gella
Sai Rajeswar
Perouz Taslakian
A Text-guided Protein Design Framework
Shengchao Liu
Yanjing Li
Zhuoxinran Li
Anthony Gitter
Yutao Zhu
Jiarui Lu
Zhao Xu
Weili Nie
Arvind Ramanathan
Chaowei Xiao
Hongyu Guo
Animashree Anandkumar
Assessing SAM for Tree Crown Instance Segmentation from Drone Imagery
Mélisande Teng
Arthur Ouaknine
Etienne Lalibert'e
Assessing SAM for Tree Crown Instance Segmentation from Drone Imagery
Mélisande Teng
Arthur Ouaknine
Etienne Lalibert'e
A data-driven approach to model spatial dose characteristics for catheter placement of high dose-rate brachytherapy for prostate cancer.
Björn Morén
Hossein Jafarzadeh
Disentangled Source-Free Personalization for Facial Expression Recognition with Neutral Target Data
Masoumeh Sharafi
Emma Ollivier
Muhammad Osama Zeeshan
Soufiane Belharbi
Alessandro Lameiras Koerich
Simon Bacon
Eric Granger
Disentangled Source-Free Personalization for Facial Expression Recognition with Neutral Target Data
Masoumeh Sharafi
Emma Ollivier
Muhammad Osama Zeeshan
Soufiane Belharbi
Alessandro Lameiras Koerich
Simon Bacon
Eric Granger
Perspectives on optimizing transport systems with supply-dependent demand
Mike Hewitt
Representation Improvement in Latent Space for Search-Based Testing of Autonomous Robotic Systems
Dmytro Humeniuk
Representation Improvement in Latent Space for Search-Based Testing of Autonomous Robotic Systems
Dmytro Humeniuk