Robust Contrastive Learning against Noisy Views
Ching-Yao Chuang
Vibhav Vineet
Neel Joshi
Antonio Torralba
Stefanie Jegelka
Ya-heng Song
Contrastive learning relies on an assumption that positive pairs contain related views that share certain underlying information about an in… (see more)stance, e.g., patches of an image or co-occurring multimodal signals of a video. What if this assumption is violated? The literature suggests that contrastive learning produces suboptimal representations in the presence of noisy views, e.g., false positive pairs with no apparent shared information. In this work, we pro-pose a new contrastive loss function that is robust against noisy views. We provide rigorous theoretical justifications by showing connections to robust symmetric losses for noisy binary classification and by establishing a new contrastive bound for mutual information maximization based on the Wasserstein distance measure. The proposed loss is completely modality-agnostic and a simple drop-in replacement for the InfoNCE loss, which makes it easy to apply to ex-isting contrastive frameworks. We show that our approach provides consistent improvements over the state-of-the-art on image, video, and graph contrastive learning bench-marks that exhibit a variety of real-world noise patterns.
Magnetoencephalography resting-state correlates of executive and language components of verbal fluency
Victor Oswald
Younes Zerouali
Aubrée Boulet-Craig
Maja Krajinovic
Caroline Laverdière
Daniel Sinnett
Pierre Jolicoeur
Sarah Lippé
Philippe Robaey
Automated, interactive, and traceable domain modelling empowered by artificial intelligence
Rijul Saini
Gunter Mussbacher
Jörg Kienzle
Attention Option-Critic
Raviteja Chunduru
Attention Option-Critic
Raviteja Chunduru
Attention Option-Critic
Raviteja Chunduru
FIXME: synchronize with database! An empirical study of data access self-admitted technical debt
Biruk Asmare Muse
Csaba Zoltán Nagy
Anthony Cleve
Giuliano Antoniol
Age differences in the functional architecture of the human brain
Roni Setton
Laetitia Mwilambwe-Tshilobo
Manesh Girn
Amber W. Lockrow
Giulia Baracchini
Colleen Hughes
Alexander J. Lowe
Benjamin N. Cassidy
Jian Li
Wen-Ming Luh
Richard M. Leahy
Tian Ge
Daniel S. Margulies
Bratislav Mišić
Boris C Bernhardt
W. Dale Stevens
Felipe De Brigard
Prantik Kundu
Gary R. Turner … (see 1 more)
R. Nathan Spreng
The intrinsic functional organization of the brain changes into older adulthood. Age differences are observed at multiple spatial scales, fr… (see more)om global reductions in modularity and segregation of distributed brain systems, to network-specific patterns of dedifferentiation. Whether dedifferentiation reflects an inevitable, global shift in brain function with age, circumscribed, experience dependent changes, or both, is uncertain. We employed a multi-method strategy to interrogate dedifferentiation at multiple spatial scales. Multi-echo (ME) resting-state fMRI was collected in younger (n=181) and older (n=120) healthy adults. Cortical parcellation sensitive to individual variation was implemented for precision functional mapping of each participant, while preserving group-level parcel and network labels. ME-fMRI processing and gradient mapping identified global and macroscale network differences. Multivariate functional connectivity methods tested for microscale, edge-level differences. Older adults had lower BOLD signal dimensionality, consistent with global network dedifferentiation. Gradients were largely age-invariant. Edge-level analyses revealed discrete, network-specific dedifferentiation patterns in older adults. Visual and somatosensory regions were more integrated within the functional connectome; default and frontoparietal control network regions showed greater connectivity; and the dorsal attention network was more integrated with heteromodal regions. These findings highlight the importance of multi-scale, multi-method approaches to characterize the architecture of functional brain aging.
A Generalized Bootstrap Target for Value-Learning, Efficiently Combining Value and Feature Predictions
Estimating value functions is a core component of reinforcement learning algorithms. Temporal difference (TD) learning algorithms use bootst… (see more)rapping, i.e. they update the value function toward a learning target using value estimates at subsequent time-steps. Alternatively, the value function can be updated toward a learning target constructed by separately predicting successor features (SF)—a policy-dependent model—and linearly combining them with instantaneous rewards. We focus on bootstrapping targets used when estimating value functions, and propose a new backup target, the ?-return mixture, which implicitly combines value-predictive knowledge (used by TD methods) with (successor) feature-predictive knowledge—with a parameter ? capturing how much to rely on each. We illustrate that incorporating predictive knowledge through an ??-discounted SF model makes more efficient use of sampled experience, compared to either extreme, i.e. bootstrapping entirely on the value function estimate, or bootstrapping on the product of separately estimated successor features and instantaneous reward models. We empirically show this approach leads to faster policy evaluation and better control performance, for tabular and nonlinear function approximations, indicating scalability and generality.
Global variation in event-based surveillance for disease outbreak detection: A time series analysis (Preprint)
Iris Ganser
R. Thiébaut
BACKGROUND Robust and flexible infectious disease surveillance is crucial for public health. Event-based surveillance (EBS) was developed t… (see more)o allow timely detection of infectious disease outbreaks using mostly web-based data. Despite its widespread use, EBS has not been evaluated systematically on a global scale in terms of outbreak detection performance. OBJECTIVE To assess the variation in timing and frequency of EBS reports compared to true outbreaks and to identify the determinants of variability, using the example of seasonal influenza epidemics in 24 countries. METHODS We obtained influenza-related reports from two EBS systems, HealthMap and the WHO Epidemic Intelligence from Open Sources (EIOS), and weekly virologic influenza counts from FluNet as a gold standard. Epidemic influenza periods were detected based on report frequency using Bayesian change point analysis. Timely sensitivity, i.e., outbreak detection within the first two weeks before or after an outbreak onset, was calculated along with sensitivity, specificity, positive predictive value, and timeliness of detection. Linear regressions were performed to assess the influence of country-specific factors on EBS performance. RESULTS Overall, monitoring the frequency of EBS reports detected 73.5% of outbreaks, but only 9.2% within two weeks of onset; in the best case, monitoring the frequency of health-related reports identified 29% of outbreaks within two weeks of onset. We observed a large degree of variability in all evaluation metrics across countries. The number of EBS reports available within a country, the human development index, and the country’s geographical location partially explained this variability. CONCLUSIONS Monitoring the frequency of EBS reports allowed just under 10% of seasonal influenza outbreaks to be detected in a timely manner in a worldwide analysis, with a large variability in detection capabilities. This article documents the global variation of EBS performance and demonstrates that monitoring report frequency alone in EBS may be insufficient for timely detection of outbreaks. Moreover, factors such as human development index and geographical location of a country may influence the performance of EBS and should be considered in future evaluations.
Global variation in event-based surveillance for disease outbreak detection: A time series analysis (Preprint)
Iris Ganser
Rodolphe Thiébaut
BACKGROUND Robust and flexible infectious disease surveillance is crucial for public health. Event-based surveillance (EBS) was developed t… (see more)o allow timely detection of infectious disease outbreaks using mostly web-based data. Despite its widespread use, EBS has not been evaluated systematically on a global scale in terms of outbreak detection performance. OBJECTIVE To assess the variation in timing and frequency of EBS reports compared to true outbreaks and to identify the determinants of variability, using the example of seasonal influenza epidemics in 24 countries. METHODS We obtained influenza-related reports from two EBS systems, HealthMap and the WHO Epidemic Intelligence from Open Sources (EIOS), and weekly virologic influenza counts from FluNet as a gold standard. Epidemic influenza periods were detected based on report frequency using Bayesian change point analysis. Timely sensitivity, i.e., outbreak detection within the first two weeks before or after an outbreak onset, was calculated along with sensitivity, specificity, positive predictive value, and timeliness of detection. Linear regressions were performed to assess the influence of country-specific factors on EBS performance. RESULTS Overall, monitoring the frequency of EBS reports detected 73.5% of outbreaks, but only 9.2% within two weeks of onset; in the best case, monitoring the frequency of health-related reports identified 29% of outbreaks within two weeks of onset. We observed a large degree of variability in all evaluation metrics across countries. The number of EBS reports available within a country, the human development index, and the country’s geographical location partially explained this variability. CONCLUSIONS Monitoring the frequency of EBS reports allowed just under 10% of seasonal influenza outbreaks to be detected in a timely manner in a worldwide analysis, with a large variability in detection capabilities. This article documents the global variation of EBS performance and demonstrates that monitoring report frequency alone in EBS may be insufficient for timely detection of outbreaks. Moreover, factors such as human development index and geographical location of a country may influence the performance of EBS and should be considered in future evaluations.
Global Variations in Event-Based Surveillance for Disease Outbreak Detection: Time Series Analysis
Iris Ganser
Rodolphe Thiébaut