Portrait of Clara Lacroce is unavailable

Clara Lacroce

Alumni

Publications

Optimal Approximate Minimization of One-Letter Weighted Finite Automata
Length independent PAC-Bayes bounds for Simple RNNs
Volodimir Mitarchuk
Rémi Eyraud
Rémi Emonet
Amaury Habrard
Simulating weighted automata over sequences and trees with transformers
Simulating Weighted Automata over Sequences and Trees with Transformers
Towards an AAK Theory Approach to Approximate Minimization in the Multi-Letter Case
We study the approximate minimization problem of weighted finite automata (WFAs): given a WFA, we want to compute its optimal approximation … (see more)when restricted to a given size. We reformulate the problem as a rank-minimization task in the spectral norm, and propose a framework to apply Adamyan-Arov-Krein (AAK) theory to the approximation problem. This approach has already been successfully applied to the case of WFAs and language modelling black boxes over one-letter alphabets \citep{AAK-WFA,AAK-RNN}. Extending the result to multi-letter alphabets requires solving the following two steps. First, we need to reformulate the approximation problem in terms of noncommutative Hankel operators and noncommutative functions, in order to apply results from multivariable operator theory. Secondly, to obtain the optimal approximation we need a version of noncommutative AAK theory that is constructive. In this paper, we successfully tackle the first step, while the second challenge remains open.
Extracting Weighted Automata for Approximate Minimization in Language Modelling
Optimal Spectral-Norm Approximate Minimization of Weighted Finite Automata
We address the approximate minimization problem for weighted finite automata (WFAs) with weights in …