Portrait of Faruk Ahmed is unavailable

Faruk Ahmed

faruk.ahmed@mila.quebec
PhD - Université de Montréal
Supervisor
Aaron Courville
Github
Google Scholar

Publications

Online black-box adaptation to label-shift in the presence of conditional-shift
Faruk Ahmed
Aaron Courville
We consider an out-of-distribution setting where trained predictive models are deployed online in new locations (inducing conditional-shift)… (see more), such that these locations are also associated with differently skewed target distributions (label-shift). While approaches for online adaptation to label-shift have recently been discussed by Wu et al. (2021), the potential presence of concurrent conditional-shift has not been considered in the literature, although one might anticipate such distributional shifts in realistic deployments. In this paper, we empirically explore the effectiveness of online adaptation methods in such situations on three synthetic and two realistic datasets, comprising both classification and regression problems. We show that it is possible to improve performance in these settings by learning additional hyper-parameters to account for the presence of conditional-shift by using appropriate validation sets.
2023-02-01
ICLR.cc/2023/Conference (rejected)
openreview.net
openreview.net