Publications

Unifying Mechanistic Interpretations of Neural Networks Trained on Modular Addition
Gabriela Moisescu-Pareja
Gavin McCracken
Vincent Létourneau
Doina Precup
Jonathan Love
2025-09-21
NeurIPS.cc/2025/Workshop/WiML (published)
openreview.net
openreview.net
Virtual Consistency for Audio Editing
Matthieu Cervera
Francesco Paissan
Mirco Ravanaelli
Yusuf Cem Sübakan
Free-form, text-based audio editing remains a persistent challenge, despite progress in inversion-based neural methods. Current approaches r… (see more)ely on slow inversion procedures, limiting their practicality. We present a virtual-consistency based audio editing system that bypasses inversion by adapting the sampling process of diffusion models. Our pipeline is model-agnostic, requiring no fine-tuning or architectural changes, and achieves substantial speed-ups over recent neural editing baselines. Crucially, it achieves this efficiency without compromising quality, as demonstrated by quantitative benchmarks and a user study involving 16 participants.
2025-09-20
ArXiv (preprint)
doi.org
arxiv.org
Accelerated Inorganic Materials Design with Generative AI Agents
Izumi Takahara
Teruyasu Mizoguchi
Bang Liu
2025-09-19
NeurIPS.cc/2025/Workshop/AI4Mat (poster)
openreview.net
openreview.net
Catalyst GFlowNet for electrocatalyst design: A hydrogen evolution reaction case study
Lena Podina
Alex Hernández-García
Christina Humer
Alexandre Duval
Victor Schmidt
Ali Ramlaoui
Shahana Chatterjee
Yoshua Bengio
David Rolnick
Félix Therrien
Efficient and inexpensive energy storage is essential for accelerating the adoption of renewable energy and ensuring a stable supply, despit… (see more)e fluctuations in sources such as wind and solar. Electrocatalysts play a key role in hydrogen energy storage (HES), allowing the energy to be stored as hydrogen. However, the development of affordable and high-performance catalysts for this process remains a significant challenge. We introduce Catalyst GFlowNet, a generative model that leverages machine learning-based predictors of formation and adsorption energy to design crystal surfaces that act as efficient catalysts. We demonstrate the performance of the model through a proof-of-concept application to the hydrogen evolution reaction, a key reaction in HES, for which we successfully identified platinum as the most efficient known catalyst. In future work, we aim to extend this approach to the oxygen evolution reaction, where current optimal catalysts are expensive metal oxides, and open the search space to discover new materials. This generative modeling framework offers a promising pathway for accelerating the search for novel and efficient catalysts.
2025-09-19
AI4Mat @ Neural Information Processing Systems (poster)
doi.org
openreview.net
Concept-based Steering of Large Language Models for Conditional Molecular Generation
Jeremy Qin
Rushil Gupta
Boris Knyazev
Yang Zhang
Glen Berseth
Bang Liu
Modern LLMs, with their internet-scale pretraining and advanced human-level capabilities across specialized tasks, have demonstrated promisi… (see more)ng performance in molecular discovery using existing text-based molecular representations, such as SMILES and SELFIES. However, generating valid, unique, and high-fidelity molecules while precisely controlling for multiple properties simultaneously remains challenging. While prior works demonstrated success by fine-tuning language models on a novel corpus of molecules with property-conditioned tags, real-world applications require generating molecules from diverse property distributions, previously unseen in the training data. To this end, we present Concept-based Activation STeering (CAST), the first approach to apply activation steering to directly edit a model's internal representation for conditional molecular generation. CAST offers a lightweight, flexible alternative to fine-tuning by computing property-conditioned steering vectors via a concept network that does not require retraining the LLM. Through extensive experiments on datasets such as Therapeutics Data Commons, we show that CAST consistently outperforms existing methods on both in-distribution and out-of-distribution conditional generation tasks. We also conduct comprehensive ablation studies to highlight the extent of control our concept-guided steering provides on the molecules generated by the LLM.
2025-09-19
NeurIPS.cc/2025/Workshop/AI4Mat (poster)
openreview.net
openreview.net
Exposing and Mitigating Calibration Biases and Demographic Unfairness in MLLM Few-Shot In-Context Learning for Medical Image Classification
Xing Shen
Justin Szeto
Mingyang Li
Hengguan Huang
Tal Arbel
2025-09-19
Lecture Notes in Computer Science (published)
doi.org
arxiv.org
The curriculum effect in visual learning: the role of readout dimensionality
Charlotte Volk
Christopher C. Pack
Shahab Bakhtiari
2025-09-19
bioRxiv (preprint)
doi.org
Variational Visible Layers: A Practical Framework for Uncertainty Estimation
Zeinab Abboud
Hervé Lombaert
Samuel Kadoury
2025-09-19
Lecture Notes in Computer Science (published)
doi.org
FocalCodec-Stream: Streaming Low-Bitrate Speech Coding via Causal Distillation
Luca Della Libera
Yusuf Cem Sübakan
Mirco Ravanaelli
Neural audio codecs are a fundamental component of modern generative audio pipelines. Although recent codecs achieve strong low-bitrate reco… (see more)nstruction and provide powerful representations for downstream tasks, most are non-streamable, limiting their use in real-time applications. We present FocalCodec-Stream, a hybrid codec based on focal modulation that compresses speech into a single binary codebook at 0.55 - 0.80 kbps with a theoretical latency of 80 ms. Our approach combines multi-stage causal distillation of WavLM with targeted architectural improvements, including a lightweight refiner module that enhances quality under latency constraints. Experiments show that FocalCodec-Stream outperforms existing streamable codecs at comparable bitrates, while preserving both semantic and acoustic information. The result is a favorable trade-off between reconstruction quality, downstream task performance, latency, and efficiency. Code and checkpoints will be released at https://github.com/lucadellalib/focalcodec.
2025-09-18
ArXiv (preprint)
doi.org
arxiv.org
Spherical Harmonic Exponentials for Efficient Glossy Reflections
Ari Silvennoinen
Peter‐Pike Sloan
Michaƚ Iwanicki
Derek Nowrouzezahrai
Abstract We propose a high‐performance and compact method for computing glossy specular reflections. Commonly‐used prefiltered environme… (see more)nt maps have large storage requirements and high error due to constrained treatment of view‐dependence. We propose a factorized spherical harmonic exponential representation that exploits new observations of the benefits of log‐space reconstruction for reflectance. Our method is compact, properly accounts for view‐dependent reflections, and is more accurate than the state‐of‐the‐industry solutions. We achieve higher quality results with an order of magnitude less memory, all with efficient and alias‐free reconstruction of glossy reflections from environment lights and continuously‐varying material roughness.
2025-09-18
Computer Graphics Forum (published)
doi.org
ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training
Adel Nabli
Louis Fournier
Pierre Erbacher
Louis Serrano
Eugene Belilovsky
Edouard Oyallon
Training LLMs relies on distributed implementations using multiple GPUs to compute gradients in parallel with sharded optimizers. However, s… (see more)ynchronizing gradients in data parallel setups introduces communication overhead that grows with the number of workers, limiting parallelization efficiency. Local optimization algorithms reduce communications but incur high memory costs as they prevent optimizer state sharding, hindering scalability. To address this, we propose \textbf{AC}cumulate while \textbf{CO}mmunicate (ACCO), a memory-efficient optimization algorithm for distributed LLM training. By synchronizing delayed gradients while computing new ones, ACCO reduces GPU idle time and supports heterogeneous hardware. To mitigate the convergence issues caused by delayed updates, we introduce a novel technique ensuring training dynamics align with standard distributed optimization. Compared to ZeRO-1, our approach is significantly faster and scales effectively across heterogeneous hardware.
2025-09-17
NeurIPS.cc/2025/Conference (poster)
doi.org
openreview.net
Amortized Sampling with Transferable Normalizing Flows
Charlie B. Tan
Majdi Hassan
Leon Klein
Saifuddin Syed
Dominique Beaini
Michael M. Bronstein
Alexander Tong
Kirill Neklyudov
Efficient equilibrium sampling of molecular conformations remains a core challenge in computational chemistry and statistical inference. Cla… (see more)ssical approaches such as molecular dynamics or Markov chain Monte Carlo inherently lack amortization; the computational cost of sampling must be paid in full for each system of interest. The widespread success of generative models has inspired interest towards overcoming this limitation through learning sampling algorithms. Despite performing competitively with conventional methods when trained on a single system, learned samplers have so far demonstrated limited ability to transfer across systems. We demonstrate that deep learning enables the design of scalable and transferable samplers by introducing Prose, a 285 million parameter all-atom transferable normalizing flow trained on a corpus of peptide molecular dynamics trajectories up to 8 residues in length. Prose draws zero-shot uncorrelated proposal samples for arbitrary peptide systems, achieving the previously intractable transferability across sequence length, whilst retaining the efficient likelihood evaluation of normalizing flows. Through extensive empirical evaluation we demonstrate the efficacy of Prose as a proposal for a variety of sampling algorithms, finding a simple importance sampling-based finetuning procedure to achieve competitive performance to established methods such as sequential Monte Carlo. We open-source the Prose codebase, model weights, and training dataset, to further stimulate research into amortized sampling methods and finetuning objectives.
2025-09-17
NeurIPS.cc/2025/Conference (poster)
doi.org
openreview.net