Квантование после обучения
method
ID: posttrainingquantization
Related Papers
Understanding and Overcoming the Challenges of Efficient Transformer Quantization
AbstractTransformer-based architectures have become the de-facto standard models for a wide range of Natural Language Processing tasks. However, their memory footprint and high latency are prohibitive for efficient deployment and …...