Publications

Automated Data-Driven Generation of Personalized Pedagogical Interventions in Intelligent Tutoring Systems
Ekaterina Kochmar
Dung D. Vu
Robert Belfer
Varun Gupta
Iulian V. Serban
Joelle Pineau
2021-07-26
International Journal of Artificial Intelligence in Education (published)
doi.org
Embedding Signals on Graphs with Unbalanced Diffusion Earth Mover's Distance
Alexander Tong
Guillaume Huguet
Dennis Shung
Amine Natik
Manik Kuchroo
Guillaume Lajoie
Guy Wolf
Smita Krishnaswamy
In modern relational machine learning it is common to encounter large graphs that arise via interactions or similarities between observation… (see more)s in many domains. Further, in many cases the target entities for analysis are actually signals on such graphs. We propose to compare and organize such datasets of graph signals by using an earth mover's distance (EMD) with a geodesic cost over the underlying graph. Typically, EMD is computed by optimizing over the cost of transporting one probability distribution to another over an underlying metric space. However, this is inefficient when computing the EMD between many signals. Here, we propose an unbalanced graph EMD that efficiently embeds the unbalanced EMD on an underlying graph into an
2021-07-25
arXiv (preprint)
doi.org
arxiv.org
Modelling Latent Translations for Cross-Lingual Transfer
Edoardo Ponti
Julia Kreutzer
Ivan Vulić
Siva Reddy
2021-07-22
ArXiv (preprint)
arxiv.org
arxiv.org
Automatic multiclass intramedullary spinal cord tumor segmentation on MRI with deep learning
Andréanne Lemay
Charley Gros
Zhizheng Zhuo
Jie Zhang
Yunyun Duan
Julien Cohen-Adad
Yaou Liu
2021-07-21
NeuroImage : Clinical (published)
doi.org
Exploration-Driven Representation Learning in Reinforcement Learning
Akram Erraqabi
Harry Zhao
Mingde Zhao
Marlos C. Machado
Yoshua Bengio
Sainbayar Sukhbaatar
Ludovic Denoyer
Alessandro Lazaric
Learning reward-agnostic representations is an emerging paradigm in reinforcement learning. These representations can be leveraged for sever… (see more)al purposes ranging from reward shaping to skill discovery. Nevertheless, in order to learn such representations, existing methods often rely on assuming uniform access to the state space. With such a privilege, the agent’s coverage of the environment can be limited which hurts the quality of the learned representations. In this work, we introduce a method that explicitly couples representation learning with exploration when the agent is not provided with a uniform prior over the state space. Our method learns representations that constantly drive exploration while the data generated by the agent’s exploratory behavior drives the learning of better representations. We empirically validate our approach in goal-achieving tasks, demonstrating that the learned representation captures the dynamics of the environment, leads to more accurate value estimation, and to faster credit assignment, both when used for control and for reward shaping. Finally, the exploratory policy that emerges from our approach proves to be successful at continuous navigation tasks with sparse rewards.
2021-07-21
ICML.cc/2021/Workshop/URL (poster)
openreview.net
openreview.net
Diffusion magnetic resonance imaging reveals tract‐specific microstructural correlates of electrophysiological impairments in non‐myelopathic and myelopathic spinal cord compression
Jan Valosek
René Labounek
Tomáš Horák
Magda Horáková
Petr Bednařík
Miloš Keřkovský
Jan Kočica
Tomáš Rohan
Christophe Lenglet
Julien Cohen‐Adad
Petr Hluštı́k
Eva Vlčková
Zdeněk Kadaňka
Josef Bednařík
Alena Svátková
Non‐myelopathic degenerative cervical spinal cord compression (NMDC) frequently occurs throughout aging and may progress to potentially ir… (see more)reversible degenerative cervical myelopathy (DCM). Whereas standard clinical magnetic resonance imaging (MRI) and electrophysiological measures assess compression severity and neurological dysfunction, respectively, underlying microstructural deficits still have to be established in NMDC and DCM patients. The study aims to establish tract‐specific diffusion MRI markers of electrophysiological deficits to predict the progression of asymptomatic NMDC to symptomatic DCM.
2021-07-20
European Journal of Neurology (published)
doi.org
An End-to-End Framework for Molecular Conformation Generation via Bilevel Programming
Minkai Xu
Wujie Wang
Shitong Luo
Chence Shi
Yoshua Bengio
Rafael Gomez-Bombarelli
Jian Tang
Predicting molecular conformations (or 3D structures) from molecular graphs is a fundamental problem in many applications. Most existing app… (see more)roaches are usually divided into two steps by first predicting the distances between atoms and then generating a 3D structure through optimizing a distance geometry problem. However, the distances predicted with such two-stage approaches may not be able to consistently preserve the geometry of local atomic neighborhoods, making the generated structures unsatisfying. In this paper, we propose an end-to-end solution for molecular conformation prediction called ConfVAE based on the conditional variational autoencoder framework. Specifically, the molecular graph is first encoded in a latent space, and then the 3D structures are generated by solving a principled bilevel optimization program. Extensive experiments on several benchmark data sets prove the effectiveness of our proposed approach over existing state-of-the-art approaches. Code is available at https://github.com/MinkaiXu/ConfVAE-ICML21
2021-07-19
International Conference on Machine Learning (Spotlight)
doi.org
proceedings.mlr.press
Combating False Negatives in Adversarial Imitation Learning
Konrad Żołna
Chitwan Saharia
Léonard Boussioux
David Y. T. Hui
Maxime Chevalier-Boisvert
Dzmitry Bahdanau
Yoshua Bengio
In adversarial imitation learning, a discriminator is trained to differentiate agent episodes from expert demonstrations representing the de… (see more)sired behavior. However, as the trained policy learns to be more successful, the negative examples (the ones produced by the agent) become increasingly similar to expert ones. Despite the fact that the task is successfully accomplished in some of the agent's trajectories, the discriminator is trained to output low values for them. We hypothesize that this inconsistent training signal for the discriminator can impede its learning, and consequently leads to worse overall performance of the agent. We show experimental evidence for this hypothesis and that the ‘False Negatives’ (i.e. successful agent episodes) significantly hinder adversarial imitation learning, which is the first contribution of this paper. Then, we propose a method to alleviate the impact of false negatives and test it on the BabyAI environment. This method consistently improves sample efficiency over the baselines by at least an order of magnitude.
2021-07-17
2021 International Joint Conference on Neural Networks (IJCNN) (published)
doi.org
arxiv.org
VirtualGAN: Reducing Mode Collapse in Generative Adversarial Networks Using Virtual Mapping
Adel Abusitta
Omar Abdel Wahab
Benjamin C. M. Fung
This paper introduces a new framework for reducing mode collapse in Generative adversarial networks (GANs). The problem occurs when the gene… (see more)rator learns to map several various input values (z) to the same output value, which makes the generator fail to capture all modes of the true data distribution. As a result, the diversity of synthetically produced data is lower than that of the real data. To address this problem, we propose a new and simple framework for training GANs based on the concept of virtual mapping. Our framework integrates two processes into GANs: merge and split. The merge process merges multiple data points (samples) into one before training the discriminator. In this way, the generator would be trained to capture the merged-data distribution rather than the (unmerged) data distribution. After the training, the split process is applied to the generator's output in order to split its contents and produce diverse modes. The proposed framework increases the chance of capturing diverse modes through enabling an indirect or virtual mapping between an input z value and multiple data points. This, in turn, enhances the chance of generating more diverse modes. Our results show the effectiveness of our framework compared to the existing approaches in terms of reducing the mode collapse problem.
2021-07-17
IEEE International Joint Conference on Neural Network (published)
doi.org
Symptom network analysis of the sleep disorders diagnostic criteria based on the clinical text of the ICSD‐3
Christophe Gauld
Régis Lopez
Charles Morin
Pierre A. GEOFFROY
Julien Maquet
Pierre Desvergnes
Aileen McGonigal
Yves Dauvilliers
Pierre Philip
Guillaume Dumas
Jean‐Arthur Micoulaud‐Franchi
2021-07-15
Journal of Sleep Research (published)
doi.org
Trips and neurotransmitters: Discovering principled patterns across 6850 hallucinogenic experiences
Galen Ballentine
Samuel Freesun Friedman
Danilo Bzdok
Psychedelics probably alter states of consciousness by disrupting how the higher association cortex governs bottom-up sensory signals. Indiv… (see more)idual hallucinogenic drugs are usually studied in participants in controlled laboratory settings. Here, we have explored word usage in 6850 free-form testimonials about 27 drugs through the prism of 40 neurotransmitter receptor subtypes, which were then mapped to three-dimensional coordinates in the brain via their gene transcription levels from invasive tissue probes. Despite high interindividual variability, our pattern-learning approach delineated how drug-induced changes of conscious awareness are linked to cortex-wide anatomical distributions of receptor density proxies. Each discovered receptor-experience factor spanned between a higher-level association pole and a sensory input pole, which may relate to the previously reported collapse of hierarchical order among large-scale networks. Coanalyzing many psychoactive molecules and thousands of natural language descriptions of drug experiences, our analytical framework finds the underlying semantic structure and maps it directly to the brain.
2021-07-13
bioRxiv (preprint)
doi.org
Design of Hesitation Gestures for Nonverbal Human-Robot Negotiation of Conflicts
AJung Moon
Maneezhay Hashmi
H. F. Machiel Van Der Loos
Elizabeth A. Croft
Aude Billard
When the question of who should get access to a communal resource first is uncertain, people often negotiate via nonverbal communication to … (see more)resolve the conflict. What should a robot be programmed to do when such conflicts arise in Human-Robot Interaction? The answer to this question varies depending on the context of the situation. Learning from how humans use hesitation gestures to negotiate a solution in such conflict situations, we present a human-inspired design of nonverbal hesitation gestures that can be used for Human-Robot Negotiation. We extracted characteristic features of such negotiative hesitations humans use, and subsequently designed a trajectory generator (Negotiative Hesitation Generator) that can re-create the features in robot responses to conflicts. Our human-subjects experiment demonstrates the efficacy of the designed robot behaviour against non-negotiative stopping behaviour of a robot. With positive results from our human-robot interaction experiment, we provide a validated trajectory generator with which one can explore the dynamics of human-robot nonverbal negotiation of resource conflicts.
2021-07-10
ACM Transactions on Human-Robot Interaction (published)
doi.org