Portrait de Dan Liu n'est pas disponible

Dan Liu

Alumni

Publications

Hyperspherical Quantization: Toward Smaller and More Accurate Models
Dan Liu
X. T. Chen
Chen Ma
Xue (Steve) Liu
Model quantization enables the deployment of deep neural networks under resource-constrained devices. Vector quantization aims at reducing t… (voir plus)he model size by indexing model weights with full-precision embeddings, i.e., codewords, while the index needs to be restored to 32-bit during computation. Binary and other low-precision quantization methods can reduce the model size up to 32×, however, at the cost of a considerable accuracy drop. In this paper, we propose an efficient framework for ternary quantization to produce smaller and more accurate compressed models. By integrating hyperspherical learning, pruning and reinitialization, our proposed Hyperspherical Quantization (HQ) method reduces the cosine distance between the full-precision and ternary weights, thus reducing the bias of the straight-through gradient estimator during ternary quantization. Compared with existing work at similar compression levels (~30×, ~40×), our method significantly improves the test accuracy and reduces the model size.
2023-01-02
2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) (publié)
doi.org
arxiv.org