Publications

A modified Thompson sampling-based learning algorithm for unknown linear systems
Yi. Ouyang
Mukul Gagrani
Rahul Jain
We revisit the Thompson sampling-based learning algorithm for controlling an unknown linear system with quadratic cost proposed in [1]. This… (see more) algorithm operates in episodes of dynamic length and it is shown to have a regret bound of
2021-08-19
ArXiv (preprint)
doi.org
arxiv.org
Toward Optimal Solution for the Context-Attentive Bandit Problem
Djallel Bouneffouf
Raphael Feraud
Sohini Upadhyay
Irina Rish
Yasaman Khazaeni
2021-08-19
Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (published)
doi.org
Scalable Regret for Learning to Control Network-Coupled Subsystems With Unknown Dynamics
Sagar Sudhakara
Aditya Mahajan
Ashutosh Nayyar
Yi. Ouyang
In this article, we consider the problem of controlling an unknown linear quadratic Gaussian (LQG) system consisting of multiple subsystems … (see more)connected over a network. Our goal is to minimize and quantify the regret (i.e., loss in performance) of our learning and control strategy with respect to an oracle who knows the system model. Upfront viewing the interconnected subsystems globally and directly using existing LQG learning algorithms for the global system results in a regret that increases super-linearly with the number of subsystems. Instead, we propose a new Thompson sampling-based learning algorithm which exploits the structure of the underlying network. We show that the expected regret of the proposed algorithm is bounded by
2021-08-18
ArXiv (preprint)
doi.org
arxiv.org
Generic acquisition protocol for quantitative MRI of the spinal cord
Julien Cohen-Adad
Eva Alonso‐Ortiz
Mihael Abramovic
Carina Arneitz
Nicole Atcheson
Laura Barlow
Robert L. Barry
Markus Barth
Marco Battiston
Christian Büchel
Matthew D. Budde
Virginie Callot
Anna J. E. Combes
Benjamin De Leener
Maxime Descoteaux
Paulo Loureiro de Sousa
Marek Dostál
Julien Doyon
Adam Dvorak
Falk Eippert … (see 71 more)
Karla R. Epperson
Kevin S. Epperson
Patrick Freund
Jürgen Finsterbusch
Alexandru Foias
Michela Fratini
Issei Fukunaga
Claudia A. M. Gandini Wheeler-Kingshott
Giancarlo Germani
Guillaume Gilbert
Federico Giove
Charley Gros
Francesco Grussu
Akifumi Hagiwara
Pierre-Gilles Henry
Tomáš Horák
Masaaki Hori
James Joers
Kouhei Kamiya
Haleh Karbasforoushan
Miloš Keřkovský
Ali Khatibi
Joo‐Won Kim
Nawal Kinany
Hagen H. Kitzler
Shannon Kolind
Yazhuo Kong
Petr Kudlička
Paul Kuntke
Nyoman D. Kurniawan
Slawomir Kusmia
René Labounek
Maria Marcella Lagana
Cornelia Laule
Christine S. Law
Christophe Lenglet
Tobias Leutritz
Yaou Liu
Sara Llufriu
Sean Mackey
Eloy Martinez-Heras
Loan Mattera
Igor Nestrašil
Kristin P. O’Grady
Nico Papinutto
Daniel Papp
Deborah Pareto
Todd B. Parrish
Anna Pichiecchio
Ferran Prados
Àlex Rovira
Marc J. Ruitenberg
Rebecca S. Samson
Giovanni Savini
Maryam Seif
Alan C. Seifert
Alex K. Smith
Seth A. Smith
Zachary A. Smith
Elisabeth Solana
Yuichi Suzuki
George Tackley
Alexandra Tinnermann
Jan Valosek
Dimitri Van De Ville
Marios C. Yiannakas
K. Weber
Nikolaus Weiskopf
Richard G. Wise
Patrik O. Wyss
Junqian Xu
2021-08-16
Nature Protocols (published)
doi.org
Open-access quantitative MRI data of the spinal cord and reproducibility across participants, sites and manufacturers
Julien Cohen-Adad
Eva Alonso‐Ortiz
Mihael Abramovic
Carina Arneitz
Nicole Atcheson
Laura Barlow
Robert L. Barry
Markus Barth
Marco Battiston
Christian Büchel
Matthew D. Budde
Virginie Callot
Anna J. E. Combes
Benjamin De Leener
Maxime Descoteaux
Paulo Loureiro de Sousa
Marek Dostál
Julien Doyon
Adam Dvorak
Falk Eippert … (see 71 more)
Karla R. Epperson
Kevin S. Epperson
Patrick Freund
Jürgen Finsterbusch
Alexandru Foias
Michela Fratini
Issei Fukunaga
Claudia A. M. Gandini Wheeler-Kingshott
Giancarlo Germani
Guillaume Gilbert
Federico Giove
Charley Gros
Francesco Grussu
Akifumi Hagiwara
Pierre-Gilles Henry
Tomáš Horák
Masaaki Hori
James Joers
Kouhei Kamiya
Haleh Karbasforoushan
Miloš Keřkovský
Ali Khatibi
Joo‐Won Kim
Nawal Kinany
Hagen H. Kitzler
Shannon Kolind
Yazhuo Kong
Petr Kudlička
Paul Kuntke
Nyoman D. Kurniawan
Slawomir Kusmia
René Labounek
Maria Marcella Lagana
Cornelia Laule
Christine S. Law
Christophe Lenglet
Tobias Leutritz
Yaou Liu
Sara Llufriu
Sean Mackey
Eloy Martinez-Heras
Loan Mattera
Igor Nestrašil
Kristin P. O’Grady
Nico Papinutto
Daniel Papp
Deborah Pareto
Todd B. Parrish
Anna Pichiecchio
Ferran Prados
Àlex Rovira
Marc J. Ruitenberg
Rebecca S. Samson
Giovanni Savini
Maryam Seif
Alan C. Seifert
Alex K. Smith
Seth A. Smith
Zachary A. Smith
Elisabeth Solana
Y. Suzuki
George Tackley
Alexandra Tinnermann
Jan Valosek
Dimitri Van De Ville
Marios C. Yiannakas
Kenneth A. Weber
Nikolaus Weiskopf
Richard G. Wise
Patrik O. Wyss
Junqian Xu
2021-08-16
Scientific Data (published)
doi.org
Forgetting Enhances Episodic Control With Structured Memories
Annik Yalnizyan-Carson
Blake Richards
Forgetting is a normal process in healthy brains, and evidence suggests that the mammalian brain forgets more than is required based on limi… (see more)tations of mnemonic capacity. Episodic memories, in particular, are liable to be forgotten over time. Researchers have hypothesized that it may be beneficial for decision making to forget episodic memories over time. Reinforcement learning offers a normative framework in which to test such hypotheses. Here, we show that a reinforcement learning agent that uses an episodic memory cache to find rewards in maze environments can forget a large percentage of older memories without any performance impairments, if they utilize mnemonic representations that contain structural information about space. Moreover, we show that some forgetting can actually provide a benefit in performance compared to agents with unbounded memories. Our analyses of the agents show that forgetting reduces the influence of outdated information and states which are not frequently visited on the policies produced by the episodic control system. These results support the hypothesis that some degree of forgetting can be beneficial for decision making, which can help to explain why the brain forgets more than is required by capacity limitations.
2021-08-12
bioRxiv (preprint)
doi.org
Hybrid Harmony: A Multi-Person Neurofeedback Application for Interpersonal Synchrony
Phoebe Chen
Sophie Hendrikse
Kaia Sargent
Michele Romani
Matthias Oostrik
Tom F. Wilderjans
Sander Koole
Guillaume Dumas
David Medine
Suzanne Dikker
Recent years have seen a dramatic increase in studies measuring brain activity, physiological responses, and/or movement data from multiple … (see more)individuals during social interaction. For example, so-called “hyperscanning” research has demonstrated that brain activity may become synchronized across people as a function of a range of factors. Such findings not only underscore the potential of hyperscanning techniques to capture meaningful aspects of naturalistic interactions, but also raise the possibility that hyperscanning can be leveraged as a tool to help improve such naturalistic interactions. Building on our previous work showing that exposing dyads to real-time inter-brain synchrony neurofeedback may help boost their interpersonal connectedness, we describe the biofeedback application Hybrid Harmony, a Brain-Computer Interface (BCI) that supports the simultaneous recording of multiple neurophysiological datastreams and the real-time visualization and sonification of inter-subject synchrony. We report results from 236 dyads experiencing synchrony neurofeedback during naturalistic face-to-face interactions, and show that pairs' social closeness and affective personality traits can be reliably captured with the inter-brain synchrony neurofeedback protocol, which incorporates several different online inter-subject connectivity analyses that can be applied interchangeably. Hybrid Harmony can be used by researchers who wish to study the effects of synchrony biofeedback, and by biofeedback artists and serious game developers who wish to incorporate multiplayer situations into their practice.
2021-08-12
Frontiers in Neuroergonomics (published)
doi.org
Effectiveness of regional diffusion MRI measures in distinguishing multiple sclerosis abnormalities within the cervical spinal cord
Haykel Snoussi
Julien Cohen-Adad
Olivier Commowick
Benoit Combes
Elise Bannier
Slimane Tounekti
Anne Sophie Kerbrat
Christian Barillot
Emmanuel Caruyer
Multiple sclerosis (MS) is an inflammatory disorder of the central nervous system. Although conventional magnetic resonance imaging (MRI) is… (see more) widely used for MS diagnosis and clinical follow‐up, quantitative MRI has the potential to provide valuable intrinsic values of tissue properties that can enhance accuracy. In this study, we investigate the efficacy of diffusion MRI in distinguishing MS lesions within the cervical spinal cord, using a combination of metrics extracted from diffusion tensor imaging and Ball‐and‐Stick models.
2021-08-09
ArXiv (preprint)
doi.org
arxiv.org
Evaluation of distortion correction methods in diffusion MRI of the spinal cord
Haykel Snoussi
Emmanuel Caruyer
Julien Cohen-Adad
Olivier Commowick
Benoit Combes
Elise Bannier
Anne Kerbrat
Christian Barillot
2021-08-09
ArXiv (preprint)
arxiv.org
arxiv.org
Learning function from structure in neuromorphic networks
Laura E. Suárez
Blake Richards
Guillaume Lajoie
Bratislav Mišić
2021-08-09
Nature Machine Intelligence (published)
doi.org
Neocortical inhibitory interneuron subtypes are differentially attuned to synchrony- and rate-coded information
Luke Y. Prince
Matthew M. Tran
Dorian Grey
Lydia Saad
Helen Chasiotis
Jeehyun Kwag
Michael M Kohl
Blake Richards
2021-08-05
Communications Biology (published)
doi.org
Barriers and facilitators to patient engagement in patient safety from patients and healthcare professionals' perspectives: A systematic review and meta-synthesis.
Zahra Chegini
Morteza Arab‐Zozani
Sheikh Mohammed Shariful Islam
Georgia Tobiano
Samira Abbasgholizadeh-Rahimi
AIMS To explore patients' and healthcare professionals' (HCPs) perceived barriers and facilitators to patient engagement in patient safety. … (see more) METHODS We conducted a systematic review and meta-synthesis from five computerized databases, including PubMed/MEDLINE, Embase, Web of Science, Scopus and PsycINFO, as well as grey literature and reference lists of included studies. Data were last searched in December 2019 with no limitation on the year of publication. Qualitative and Mix-methods studies that explored HCPs' and patients' perceptions of barriers and facilitators to patient engagement in patient safety were included. Two authors independently screened the titles and the abstracts of studies. Next, the full texts of the screened studies were reviewed by two authors. Potential discrepancies were resolved by consensus with a third author. The Mixed Methods Appraisal Tool was used for quality appraisal. Thematic analysis was used to synthesize results. RESULTS Nineteen studies out of 2616 were included in this systematic review. Themes related to barriers included: patient unwillingness, HCPs' unwillingness, and inadequate infrastructures. Themes related to facilitators were: encouraging patients, sharing information with patients, establishing trustful relationship, establishing patient-centred care and improving organizational resources. CONCLUSION Patients have an active role in improving their safety. Strategies are required to address barriers that hinder or prevent patient engagement and create capacity and facilitate action.
2021-08-02
Nursing Forum (published)
doi.org