Publications

Beyond performance: the role of task demand, effort, and individual differences in ab initio pilots
Mohammad-Javad Darvishi-Bayazi
Andrew Law
Sergio Mejia Romero
Sion Jennings
Jocelyn Faubert
Aviation safety depends on the skill and expertise of pilots to meet the task demands of flying an aircraft in an effective and efficient ma… (see more)nner. During flight training, students may respond differently to imposed task demands based on individual differences in capacity, physiological arousal, and effort. To ensure that pilots achieve a common desired level of expertise, training programs should account for individual differences to optimize pilot performance. This study investigates the relationship between task performance and physiological correlates of effort in ab initio pilots. Twenty-four participants conducted a flight simulator task with three difficulty levels and were asked to rate their perceived demand and effort using the NASA TLX. We recorded heart rate, EEG brain activity, and pupil size to assess changes in the participants’ mental and physiological states across different task demands. We found that, despite group-level correlations between performance error and physiological responses, individual differences in physiological responses to task demands reflected different levels of participant effort and task efficiency. These findings suggest that physiological monitoring of student pilots might provide beneficial insights to flight instructors to optimize pilot training at the individual level.
From Assistive Devices to Manufacturing Cobot Swarms
Monica Li
Bruno Belzile
Ali Imran
Lionel Birglen
David St-Onge
This paper provides an overview of the latest trends in robotics research and development, with a particular focus on applications in manufa… (see more)cturing and industrial settings. We highlight recent advances in robot design, including cutting-edge collaborative robot mechanics and advanced safety features, as well as exciting developments in perception and human-swarm interaction. By examining recent contributions from Kinova, a leading robotics company, we illustrate the differences between industry and academia in their approaches to developing innovative robotic systems and technologies that enhance productivity and safety in the workplace. Ultimately, this paper demonstrates the tremendous potential of robotics to revolutionize manufacturing and industrial operations, and underscores the crucial role of companies like Kinova in driving this transformation forward.
Global fMRI signal topography differs systematically across the lifespan
Jason S. Nomi
Jingwei Li
Taylor Bolt
Catie Chang
Salome Kornfeld
Zachary T. Goodman
B.T. Thomas Yeo
R. Nathan Spreng
Lucina Q. Uddin
The global signal (GS) in resting-state fMRI, known to contain artifacts and non-neuronal physiological signals, also contains important neu… (see more)ral information related to individual state and trait characteristics. Here we show distinct linear and curvilinear lifespan patterns of GS topography in a cross-sectional lifespan sample, demonstrating its importance for consideration in studies of development and aging. Subcortical brain regions such as the thalamus and putamen show linear associations with the GS across the lifespan. The thalamus has stronger coupling in older-age individuals compared with younger-aged individuals, while the putamen has stronger coupling in younger individuals compared with older individuals. The subcortical nucleus basalis shows a u-shaped pattern similar to cortical regions within the lateral frontoparietal network and dorsal attention network, where coupling with the GS is stronger at early and old age, with weaker coupling in middle age. This differentiation in coupling strength between subcortical and cortical brain activity across the lifespan supports a dual-layer model of GS composition, where subcortical aspects of the GS are differentiated from cortical aspects of the GS. We find that these subcortical-cortical contributions to the GS depend strongly on the lifespan stage of individuals. Our findings demonstrate how neurobiological information within the GS differs across development and highlight the need to carefully consider whether or not to remove this signal when investigating age-related functional differences in the brain.
Efficient Epistemic Uncertainty Estimation in Regression Ensemble Models Using Pairwise-Distance Estimators
Lucas Berry
This work introduces an efficient novel approach for epistemic uncertainty estimation for ensemble models for regression tasks using pairwis… (see more)e-distance estimators (PaiDEs). Utilizing the pairwise-distance between model components, these estimators establish bounds on entropy. We leverage this capability to enhance the performance of Bayesian Active Learning by Disagreement (BALD). Notably, unlike sample-based Monte Carlo estimators, PaiDEs exhibit a remarkable capability to estimate epistemic uncertainty at speeds up to 100 times faster while covering a significantly larger number of inputs at once and demonstrating superior performance in higher dimensions. To validate our approach, we conducted a varied series of regression experiments on commonly used benchmarks: 1D sinusoidal data,
A comparison of reinforcement learning frameworks for software testing tasks
Paulina Stevia Nouwou Mindom
Amin Nikanjam
Speech Self-Supervised Representation Benchmarking: Are We Doing it Right?
Youcef Kemiche
Slim Essid
Self-supervised learning (SSL) has recently allowed leveraging large datasets of unlabeled speech signals to reach impressive performance on… (see more) speech tasks using only small amounts of annotated data. The high number of proposed approaches fostered the need and rise of extended benchmarks that evaluate their performance on a set of downstream tasks exploring various aspects of the speech signal. However, and while the number of considered tasks has been growing, most rely upon a single decoding architecture that maps the frozen SSL representations to the downstream labels. This work investigates the robustness of such benchmarking results to changes in the decoder architecture. Interestingly, it appears that varying the architecture of the downstream decoder leads to significant variations in the leaderboards of most tasks. Concerningly, our study reveals that benchmarking using limited decoders may cause a counterproductive increase in the sizes of the developed SSL models.
MARCO: A Memory-Augmented Reinforcement Framework for Combinatorial Optimization
Andoni I. Garmendia
Josu Ceberio
Alexander Mendiburu
Open, Closed, or Small Language Models for Text Classification?
Recent advancements in large language models have demonstrated remarkable capabilities across various NLP tasks. But many questions remain, … (see more)including whether open-source models match closed ones, why these models excel or struggle with certain tasks, and what types of practical procedures can improve performance. We address these questions in the context of classification by evaluating three classes of models using eight datasets across three distinct tasks: named entity recognition, political party prediction, and misinformation detection. While larger LLMs often lead to improved performance, open-source models can rival their closed-source counterparts by fine-tuning. Moreover, supervised smaller models, like RoBERTa, can achieve similar or even greater performance in many datasets compared to generative LLMs. On the other hand, closed models maintain an advantage in hard tasks that demand the most generalizability. This study underscores the importance of model selection based on task requirements
Pontomedullary junction as a reference for spinal cord cross-sectional area: validation across neck positions
Maxime Bouthillier
Spinal cord cross-sectional area (CSA) is an important MRI biomarker to assess spinal cord atrophy in various neurodegenerative and traumati… (see more)c spinal cord diseases. However, the conventional method of computing CSA based on vertebral levels is inherently flawed, as the prediction of spinal levels from vertebral levels lacks reliability, leading to considerable variability in CSA measurements. Computing CSA from an intrinsic neuroanatomical reference, the pontomedullary junction (PMJ), has been proposed in previous work to overcome limitations associated with using a vertebral reference. However, the validation of this alternative approach, along with its variability across and within participants under variable neck extensions, remains unexplored. The goal of this study was to determine if the variability of CSA across neck flexions/extensions is reduced when using the PMJ, compared to vertebral levels. Ten participants underwent a 3T MRI T2w isotropic scan at 0.6 mm3 for 3 neck positions: extension, neutral and flexion. Spinal cord segmentation, vertebral labeling, PMJ labeling, and CSA were computed automatically while spinal segments were labeled manually. Mean coefficient of variation for CSA across neck positions was 3.99 ± 2.96% for the PMJ method vs. 4.02 ± 3.01% for manual spinal segment method vs. 4.46 ± 3.10% for the disc method. These differences were not statistically significant. The PMJ method was slightly more reliable than the disc-based method to compute CSA at specific spinal segments, although the difference was not statistically significant. This suggests that the PMJ can serve as a valuable alternative and reliable method for estimating CSA when a disc-based approach is challenging or not feasible, such as in cases involving fused discs in individuals with spinal cord injuries.
GTM-decon: guided-topic modeling of single-cell transcriptomes enables sub-cell-type and disease-subtype deconvolution of bulk transcriptomes
Lakshmipuram Seshadri Swapna
Michael Huang
Yuemei Li
YORC: Yoruba Reading Comprehension dataset
Aremu Anuoluwapo
Jesujoba Oluwadara Alabi
In this paper, we create YORC: a new multi-choice Yoruba Reading Comprehension dataset that is based on Yoruba high-school reading comprehen… (see more)sion examination. We provide baseline results by performing cross-lingual transfer using existing English RACE dataset based on a pre-trained encoder-only model. Additionally, we provide results by prompting large language models (LLMs) like GPT-4.
Age-related bias and artificial intelligence: a scoping review
Charlene H Chu
Simon Donato-Woodger
Shehroz S Khan
Rune Nyrup
Kathleen Leslie
Alexandra Lyn
Andria Bianchi
S. A. Rahimi
Amanda Grenier