Publications

Symptom network analysis of the sleep disorders diagnostic criteria based on the clinical text of the ICSD‐3
Christophe Gauld
Régis Lopez
Charles Morin
Pierre A. GEOFFROY
Julien Maquet
Pierre Desvergnes
Aileen McGonigal
Yves Dauvilliers
Pierre Philip
Guillaume Dumas
Jean‐Arthur Micoulaud‐Franchi
2021-07-15
Journal of Sleep Research (publié)
doi.org
Trips and neurotransmitters: Discovering principled patterns across 6850 hallucinogenic experiences
Galen Ballentine
Samuel Freesun Friedman
Danilo Bzdok
Psychedelics probably alter states of consciousness by disrupting how the higher association cortex governs bottom-up sensory signals. Indiv… (voir plus)idual hallucinogenic drugs are usually studied in participants in controlled laboratory settings. Here, we have explored word usage in 6850 free-form testimonials about 27 drugs through the prism of 40 neurotransmitter receptor subtypes, which were then mapped to three-dimensional coordinates in the brain via their gene transcription levels from invasive tissue probes. Despite high interindividual variability, our pattern-learning approach delineated how drug-induced changes of conscious awareness are linked to cortex-wide anatomical distributions of receptor density proxies. Each discovered receptor-experience factor spanned between a higher-level association pole and a sensory input pole, which may relate to the previously reported collapse of hierarchical order among large-scale networks. Coanalyzing many psychoactive molecules and thousands of natural language descriptions of drug experiences, our analytical framework finds the underlying semantic structure and maps it directly to the brain.
2021-07-13
bioRxiv (prépublication)
doi.org
Design of Hesitation Gestures for Nonverbal Human-Robot Negotiation of Conflicts
AJung Moon
Maneezhay Hashmi
H. F. Machiel Van Der Loos
Elizabeth A. Croft
Aude Billard
When the question of who should get access to a communal resource first is uncertain, people often negotiate via nonverbal communication to … (voir plus)resolve the conflict. What should a robot be programmed to do when such conflicts arise in Human-Robot Interaction? The answer to this question varies depending on the context of the situation. Learning from how humans use hesitation gestures to negotiate a solution in such conflict situations, we present a human-inspired design of nonverbal hesitation gestures that can be used for Human-Robot Negotiation. We extracted characteristic features of such negotiative hesitations humans use, and subsequently designed a trajectory generator (Negotiative Hesitation Generator) that can re-create the features in robot responses to conflicts. Our human-subjects experiment demonstrates the efficacy of the designed robot behaviour against non-negotiative stopping behaviour of a robot. With positive results from our human-robot interaction experiment, we provide a validated trajectory generator with which one can explore the dynamics of human-robot nonverbal negotiation of resource conflicts.
2021-07-10
ACM Transactions on Human-Robot Interaction (publié)
doi.org
TIE: A Framework for Embedding-based Incremental Temporal Knowledge Graph Completion
Jiapeng Wu
Yishi Xu
Yingxue Zhang
Chen Ma
Mark J. Coates
Jackie CK Cheung
Reasoning in a temporal knowledge graph (TKG) is a critical task for information retrieval and semantic search. It is particularly challengi… (voir plus)ng when the TKG is updated frequently. The model has to adapt to changes in the TKG for efficient training and inference while preserving its performance on historical knowledge. Recent work approaches TKG completion (TKGC) by augmenting the encoder-decoder framework with a time-aware encoding function. However, naively fine-tuning the model at every time step using these methods does not address the problems of 1) catastrophic forgetting, 2) the model's inability to identify the change of facts (e.g., the change of the political affiliation and end of a marriage), and 3) the lack of training efficiency. To address these challenges, we present the Time-aware Incremental Embedding (TIE) framework, which combines TKG representation learning, experience replay, and temporal regularization. We introduce a set of metrics that characterizes the intransigence of the model and propose a constraint that associates the deleted facts with negative labels. Experimental results on Wikidata12k and YAGO11k datasets demonstrate that the proposed TIE framework reduces training time by about ten times and improves on the proposed metrics compared to vanilla full-batch training. It comes without a significant loss in performance for any traditional measures. Extensive ablation studies reveal performance trade-offs among different evaluation metrics, which is essential for decision-making around real-world TKG applications.
2021-07-10
Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (publié)
doi.org
arxiv.org
Parallel and recurrent cascade models as a unifying force for understanding sub-cellular computation
Emerson F. Harkin
Peter R. Shen
Anish Goel
Blake A. Richards
Richard Naud
Neurons are very complicated computational devices, incorporating numerous non-linear processes, particularly in their dendrites. Biophysica… (voir plus)l models capture these processes directly by explicitly modelling physiological variables, such as ion channels, current flow, membrane capacitance, etc. However, another option for capturing the complexities of real neural computation is to use cascade models, which treat individual neurons as a cascade of linear and non-linear operations, akin to a multi-layer artificial neural network. Recent research has shown that cascade models can capture single-cell computation well, but there are still a number of sub-cellular, regenerative dendritic phenomena that they cannot capture, such as the interaction between sodium, calcium, and NMDA spikes in different compartments. Here, we propose that it is possible to capture these additional phenomena using parallel, recurrent cascade models, wherein an individual neuron is modelled as a cascade of parallel linear and non-linear operations that can be connected recurrently, akin to a multi-layer, recurrent, artificial neural network. Given their tractable mathematical structure, we show that neuron models expressed in terms of parallel recurrent cascades can themselves be integrated into multi-layered artificial neural networks and trained to perform complex tasks. We go on to discuss potential implications and uses of these models for artificial intelligence. Overall, we argue that parallel, recurrent cascade models provide an important, unifying tool for capturing single-cell computation and exploring the algorithmic implications of physiological phenomena.
2021-07-04
Neuroscience (publié)
doi.org
The default mode network in cognition: a topographical perspective
Jonathan Smallwood
Boris C Bernhardt
Robert Leech
Danilo Bzdok
Elizabeth Jefferies
Daniel S. Margulies
2021-07-04
Nature Reviews Neuroscience (publié)
doi.org
Meeting and Missing Minds: Children and Adults Use Alignment of Intuitions to Solve Pure Coordination Games
Daniel Perez-Zapata
Xavia McKenzie-Smart
Ian Charest
Ian Apperly
In pure coordination games players seek to coordinate responses with one another without communicating. Without a logically correct response… (voir plus), success depends upon players intuiting a response that is mutually obvious. Previous work suggests that such coordination requires a distinctive form of “group” thinking and sufficient mutual knowledge, but reveals little about the basis for the intuitive judgements themselves. Here, that question was addressed for the first time by examining the basis of coordination performance of groups whose intuitions might plausibly differ: children versus adults. Twenty-five 5-year-olds, 30 7-year-olds, and 25 adults undertook four types of coordination game, and novel metrics allowed “intuitive alignment” in responses to be evaluated within- and between-groups. All groups performed above chance, and adults showed higher levels of alignment than children, but adults and children showed different patterns in their intuitions. Implications for intergenerational understanding and mis-understanding are discussed.
2021-07-02
Journal of Cognitive Psychology (publié)
doi.org
Fixed-Points for Quantitative Equational Logics
Radu Mardare
Prakash Panangaden
Gordon Plotkin
We develop a fixed-point extension of quantitative equational logic and give semantics in one-bounded complete quantitative algebras. Unlike… (voir plus) previous related work about fixed-points in metric spaces, we are working with the notion of approximate equality rather than exact equality. The result is a novel theory of fixed points which can not only provide solutions to the traditional fixed-point equations but we can also define the rate of convergence to the fixed point. We show that such a theory is the quantitative analogue of a Conway theory and also of an iteration theory; and it reflects the metric coinduction principle. We study the Bellman equation for a Markov decision process as an illustrative example.
2021-07-01
2021 36th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS) (publié)
doi.org
arxiv.org
Universal Semantics for the Stochastic λ-Calculus
Pedro H. Azevedo de Amorim
Dexter Kozen
Radu Mardare
Prakash Panangaden
Michael Roberts
We define sound and adequate denotational and operational semantics for the stochastic lambda calculus. These two semantic approaches build … (voir plus)on previous work that used an explicit source of randomness to reason about higher-order probabilistic programs.
2021-07-01
2021 36th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS) (publié)
doi.org
arxiv.org
Beyond Variance Reduction: Understanding the True Impact of Baselines on Policy Optimization
Wesley Chung
Valentin Thomas
Marlos C. Machado
Nicolas Le Roux
Bandit and reinforcement learning (RL) problems can often be framed as optimization problems where the goal is to maximize average performan… (voir plus)ce while having access only to stochastic estimates of the true gradient. Traditionally, stochastic optimization theory predicts that learning dynamics are governed by the curvature of the loss function and the noise of the gradient estimates. In this paper we demonstrate that this is not the case for bandit and RL problems. To allow our analysis to be interpreted in light of multi-step MDPs, we focus on techniques derived from stochastic optimization principles (e.g., natural policy gradient and EXP3) and we show that some standard assumptions from optimization theory are violated in these problems. We present theoretical results showing that, at least for bandit problems, curvature and noise are not sufficient to explain the learning dynamics and that seemingly innocuous choices like the baseline can determine whether an algorithm converges. These theoretical findings match our empirical evaluation, which we extend to multi-state MDPs.
2021-06-30
Proceedings of the 38th International Conference on Machine Learning (publié)
doi.org
proceedings.mlr.press
A Brief Study on the Effects of Training Generative Dialogue Models with a Semantic loss
Prasanna Parthasarathi
Mohamed Abdelsalam
Joelle Pineau
Sarath Chandar
Neural models trained for next utterance generation in dialogue task learn to mimic the n-gram sequences in the training set with training o… (voir plus)bjectives like negative log-likelihood (NLL) or cross-entropy. Such commonly used training objectives do not foster generating alternate responses to a context. But, the effects of minimizing an alternate training objective that fosters a model to generate alternate response and score it on semantic similarity has not been well studied. We hypothesize that a language generation model can improve on its diversity by learning to generate alternate text during training and minimizing a semantic loss as an auxiliary objective. We explore this idea on two different sized data sets on the task of next utterance generation in goal oriented dialogues. We make two observations (1) minimizing a semantic objective improved diversity in responses in the smaller data set (Frames) but only as-good-as minimizing the NLL in the larger data set (MultiWoZ) (2) large language model embeddings can be more useful as a semantic loss objective than as initialization for token embeddings.
2021-06-30
Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue (publié)
doi.org
arxiv.org
Continuous Coordination As a Realistic Scenario for Lifelong Learning
Hadi Nekoei
Akilesh Badrinaaraayanan
Aaron Courville
Sarath Chandar
Current deep reinforcement learning (RL) algorithms are still highly task-specific and lack the ability to generalize to new environments. L… (voir plus)ifelong learning (LLL), however, aims at solving multiple tasks sequentially by efficiently transferring and using knowledge between tasks. Despite a surge of interest in lifelong RL in recent years, the lack of a realistic testbed makes robust evaluation of LLL algorithms difficult. Multi-agent RL (MARL), on the other hand, can be seen as a natural scenario for lifelong RL due to its inherent non-stationarity, since the agents' policies change over time. In this work, we introduce a multi-agent lifelong learning testbed that supports both zero-shot and few-shot settings. Our setup is based on Hanabi -- a partially-observable, fully cooperative multi-agent game that has been shown to be challenging for zero-shot coordination. Its large strategy space makes it a desirable environment for lifelong RL tasks. We evaluate several recent MARL methods, and benchmark state-of-the-art LLL algorithms in limited memory and computation regimes to shed light on their strengths and weaknesses. This continual learning paradigm also provides us with a pragmatic way of going beyond centralized training which is the most commonly used training protocol in MARL. We empirically show that the agents trained in our setup are able to coordinate well with unseen agents, without any additional assumptions made by previous works. The code and all pre-trained models are available at https://github.com/chandar-lab/Lifelong-Hanabi.
2021-06-30
Proceedings of the 38th International Conference on Machine Learning (publié)
doi.org
proceedings.mlr.press