specific method · filed under software implementation
AngelSlim
AngelSlim is a toolkit for compressing large models.1 It bundles compression tools including common quantization algorithms, low-bit quantization, and speculative sampling, aimed at large-scale multimodal models.2
How this definition was written
Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.
a more accessible, comprehensive, and efficient toolkit for large model compression
— tencent/Hy4-preview · Hugging Facesupports a comprehensive suite of compression tools for large-scale multimodal models, including common quantization algorithms, low-bit quantization, and speculative sampling
— tencent/Hy4-preview · Hugging Face
Also called AngelSlim compression toolkit, AngelSlim toolkit.