Marco Bonizzato

Associate Academic Member

Assistant Professor, Polytechnique Montréal, Department of Electrical Engineering

Adjunct Professor, Université de Montréal, Department of Neurosciences

Research Topics

Blackbox Optimization

Computational Neuroscience

Dynamical Systems

Google Scholar

Biography

Marco Bonizzato is a control, electrical and life sciences engineer with over ten years’ experience in implantable brain-computer interfaces and neuromodulation technology. He has unique double expertise in (a) neural prostheses, and (b) machine intelligence and optimization.

Bonizzato is an assistant professor of electrical engineering at Polytechnique Montréal and an adjunct professor of neuroscience at Université de Montréal.

He also directs the Polytechnique’s sciNeurotech Lab, whose research goal is to develop the entire translational arc of new neurostimulation therapies aimed at restoring sensorimotor function after neurotrauma—from discovery in rodents to application in human medical technologies tailored and personalized to the user using AI.

Current Students

Davide Burchielli

PhD - Polytechnique Montréal

Google Scholar

Rose Guay Hottin

Master's Research - Polytechnique Montréal

Co-supervisor :

Guillaume Lajoie

Google Scholar

Juan Guerra

Master's Research - Polytechnique Montréal

Co-supervisor :

PhD - Université de Montréal

Github

Leblanc Nicolas

Master's Research - Polytechnique Montréal

Mauricio Rivera

Master's Research - Université de Montréal

mauriv2010@gmail.com

Salamanca-Giron Salamanca-Giron

Postdoctorate - Polytechnique Montréal

Website

Github

Publications

Hallucination Detox: Sensitive Neuron Dropout (SeND) for Large Language Model Training

Shahrad Mohammadzadeh

Juan David Guerra

Marco Bonizzato

Reihaneh Rabbany

Golnoosh Farnadi

As large language models (LLMs) become increasingly deployed across various industries, concerns regarding their reliability, particularly d… (see more)ue to hallucinations-outputs that are factually inaccurate or irrelevant to user input-have grown. Our research investigates the relationship between the training process and the emergence of hallucinations to address a key gap in existing research that focuses primarily on post hoc detection and mitigation strategies. Using models from the Pythia suite (70M-12B parameters) and several hallucination detection metrics, we analyze hallucination trends throughout training and explore LLM internal dynamics. We introduce SEnsitive Neuron Dropout (SeND), a novel training protocol designed to mitigate hallucinations by reducing variance during training. SeND achieves this by deterministically dropping neurons with significant variability on a dataset, referred to as Sensitive Neurons. In addition, we develop an unsupervised hallucination detection metric, Efficient EigenScore (EES), which approximates the traditional EigenScore in 2x speed. This efficient metric is integrated into our protocol, allowing SeND to be both computationally scalable and effective at reducing hallucinations. Our empirical evaluation demonstrates that our approach improves LLM reliability at test time by up to 40% compared to normal training while also providing an efficient method to improve factual accuracy when adapting LLMs to domains such as Wikipedia and Medical datasets.

2024-10-12

NeurIPS.cc/2024/Workshop/SafeGenAi (poster)

doi.org

openreview.net

Gaussian-process-based Bayesian optimization for neurostimulation interventions in rats

Léo Choinière

Rose Guay-Hottin

Rémi Picard

Guillaume Lajoie

Marco Bonizzato

Numa Dancause

2024-02-14