Portrait of Mirco Ravanelli

Mirco Ravanelli

Associate Academic Member
Assistant Professor, Concordia University, Gina Cody School of Engineering and Computer Science
Adjunct Professor, Université de Montréal, Department of Computer Science and Operations Research
Research Topics
Deep Learning
Website
Google Scholar
LinkedIn
X

Biography

Mirco Ravanelli is an assistant professor at Concordia University, adjunct professor at Université de Montréal and associate member of Mila – Quebec Artificial Intelligence Institute.

Ravanelli is an expert in deep learning and conversational AI, publishing over sixty papers in these fields. His contributions were honoured with a 2022 Amazon Research Award.

His research focuses primarily on novel deep learning algorithms, including self-supervised, continual, multimodal, cooperative and energy-efficient learning.

Formerly a postdoctoral fellow at Mila under Yoshua Bengio, he founded and now leads SpeechBrain, one of the most extensively used open-source toolkits in the field of speech processing and conversational AI.

Current Students

Hiba Akhaddar
Master's Research - Concordia University
Allan Allan
Undergraduate - Concordia University
Github
Dehestani Amirali
Research Intern - Concordia University University
Github
Seina Assadian
Collaborating researcher - Concordia University University
Github
Cordelle Briac
Collaborating researcher - Concordia University University
Github
Leo Brodeur Brodeur
Research Intern - Concordia University
leobrod44@gmail.com
Github
Gallegati Caterina
Research Intern - Concordia University
Github
Victor Cruz
Master's Research - Concordia University
Luca Della Libera
PhD - Concordia University
Co-supervisor :
Cem Subakan
Github
Wagner Drew
Master's Research - Concordia University
Co-supervisor :
Irina Rish
Github
Gianfranco Dumoulin Bertucci
Master's Research - Concordia University
Website
Github
Nadine El-Mufti
Master's Research - Concordia University
nadine.el-mufti@mila.quebec
Website
Github
Google Scholar
Maab Elrashid Ahmed Mohamed
PhD - Concordia University
Co-supervisor :
Cem Subakan
Github
Bonzi Francesco
PhD - Concordia University
Github
Alessio Giuseppe Alessio
Collaborating researcher - International School for Advanced Studies (Trieste, Italy)
Salman Sami Hussain Ali
Collaborating researcher - Concordia University University
Github
Haoyu Li
Research Intern - Concordia University Univesity
Github
Eleonora Mancini
Collaborating Alumni - Université de Montréal
Principal supervisor :
Cem Subakan
Github
Google Scholar
Jama Mohamud
PhD - Université de Montréal
Co-supervisor :
Yoshua Bengio
Website
Github
Google Scholar
Pooneh Mousavi
PhD - Concordia University
Website
Github
Google Scholar
Fırat Öncel
PhD - Concordia University
Co-supervisor :
Laurent Charlin
Website
Github
Google Scholar
Peter Peter
Postdoctorate - McGill University
Website
Github
Google Scholar
Artem Ploujnikov
PhD - Université de Montréal
Francesco Verdini
Research Intern - Sapienza University of Rome

Publications

Interpretable Convolutional Filters with SincNet
Mirco Ravanelli
Yoshua Bengio
Deep learning is currently playing a crucial role toward higher levels of artificial intelligence. This paradigm allows neural networks to l… (see more)earn complex and abstract representations, that are progressively obtained by combining simpler ones. Nevertheless, the internal "black-box" representations automatically discovered by current neural architectures often suffer from a lack of interpretability, making of primary interest the study of explainable machine learning techniques. This paper summarizes our recent efforts to develop a more interpretable neural model for directly processing speech from the raw waveform. In particular, we propose SincNet, a novel Convolutional Neural Network (CNN) that encourages the first layer to discover more meaningful filters by exploiting parametrized sinc functions. In contrast to standard CNNs, which learn all the elements of each filter, only low and high cutoff frequencies of band-pass filters are directly learned from data. This inductive bias offers a very compact way to derive a customized filter-bank front-end, that only depends on some parameters with a clear physical meaning. Our experiments, conducted on both speaker and speech recognition, show that the proposed architecture converges faster, performs better, and is more interpretable than standard CNNs.
2018-11-23
ArXiv (preprint)
arxiv.org
arxiv.org
Twin Regularization for online speech recognition
Mirco Ravanelli
Dmitriy Serdyuk
Yoshua Bengio
Online speech recognition is crucial for developing natural human-machine interfaces. This modality, however, is significantly more challeng… (see more)ing than off-line ASR, since real-time/low-latency constraints inevitably hinder the use of future information, that is known to be very helpful to perform robust predictions. A popular solution to mitigate this issue consists of feeding neural acoustic models with context windows that gather some future frames. This introduces a latency which depends on the number of employed look-ahead features. This paper explores a different approach, based on estimating the future rather than waiting for it. Our technique encourages the hidden representations of a unidirectional recurrent network to embed some useful information about the future. Inspired by a recently proposed technique called Twin Networks, we add a regularization term that forces forward hidden states to be as close as possible to cotemporal backward ones, computed by a "twin" neural network running backwards in time. The experiments, conducted on a number of datasets, recurrent architectures, input features, and acoustic conditions, have shown the effectiveness of this approach. One important advantage is that our method does not introduce any additional computation at test time if compared to standard unidirectional recurrent networks.
2018-09-02
Interspeech 2018 (published)
doi.org
arxiv.org
Light Gated Recurrent Units for Speech Recognition
Mirco Ravanelli
Philemon Brakel
Maurizio Omologo
Yoshua Bengio
A field that has directly benefited from the recent advances in deep learning is automatic speech recognition (ASR). Despite the great achie… (see more)vements of the past decades, however, a natural and robust human–machine speech interaction still appears to be out of reach, especially in challenging environments characterized by significant noise and reverberation. To improve robustness, modern speech recognizers often employ acoustic models based on recurrent neural networks (RNNs) that are naturally able to exploit large time contexts and long-term speech modulations. It is thus of great interest to continue the study of proper techniques for improving the effectiveness of RNNs in processing speech signals. In this paper, we revise one of the most popular RNN models, namely, gated recurrent units (GRUs), and propose a simplified architecture that turned out to be very effective for ASR. The contribution of this work is twofold: First, we analyze the role played by the reset gate, showing that a significant redundancy with the update gate occurs. As a result, we propose to remove the former from the GRU design, leading to a more efficient and compact single-gate model. Second, we propose to replace hyperbolic tangent with rectified linear unit activations. This variation couples well with batch normalization and could help the model learn long-term dependencies without numerical issues. Results show that the proposed architecture, called light GRU, not only reduces the per-epoch training time by more than 30% over a standard GRU, but also consistently improves the recognition accuracy across different tasks, input features, noisy conditions, as well as across different ASR paradigms, ranging from standard DNN-HMM speech recognizers to end-to-end connectionist temporal classification models.
2018-04-01
IEEE Transactions on Emerging Topics in Computational Intelligence (published)
doi.org
arxiv.org