Portrait of Chao Yin

Chao Yin

PhD - Polytechnique Montréal
Research Topics
Machine Learning Theory
Optimization
Power Networks

Publications

Convex training of Lipschitz-regularized shallow neural networks
In this work, we introduce a training procedure for shallow neural networks that promotes robustness against adversarial attacks. We solve a… (see more) non-convex Lipschitz-regularized training program by introducing a convex restriction that can be efficiently solved to global optimality. Our approach can be employed as a post-processing step by taking a pre-trained network as an initial solution to then solving the convex program whose optimal network is guaranteed to be no worse than the initial one. We illustrate the improvements of our training procedure with experiments using real world datasets for regression tasks under an adversarial setting. We show numerically that solving our proposed convex program yields networks with lower objective values on the Lipschitz-regularized program compared to existing methods. Additionally, we show that on certain datasets, networks obtained using our convex training program are both more accurate and robust with respect to adversarial attacks.
An Improved Neuro-Symbolic Architecture to Fine-Tune Generative AI Systems
Gilles Pesant