specific method · filed under software implementation
Hugging Face Transformers
The Transformers framework used for model inference, including native inference and CPU-offloaded quantization workflows.
Also called Transformers, HuggingFace Transformers.
- sources
- 4
- models
- 3
- labs adopt it
- 3
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
Documented in
Further reading
Picked by hand, not extracted: where to read more, not evidence for anything on this page.
- Transformers documentation docs huggingface.co
- huggingface/transformers code github.com
Evidence
4 spans quoted from the sources, strongest treatment first.
We used transformers on a single node with CPU offloading to quantize Ultra layer-by-layer.
Model-Optimizer’s HuggingFace PTQ script uses transformers native inference
We recommend the following inference frameworks to serve the model: Transformers
Transformers (v0.5.12+)
Filed alongside
Other methods under software implementation :: training framework.