Open Models Almanac
Methodsoptimizationtraining precision

general family · filed under optimization

Mixed-precision training

Use of mixed precision in training or rollouts without an evidence-supported specification of the underlying formats or policy.

The sources on this page name it without explaining how it works. The line above is the extraction's one-line gloss. See training precision for the methods filed beside it.

Also called mixed precision, mixed-precision execution, mixed-precision training/rollouts.

sources
2
models
2
labs adopt it
2
strongest
used

Documented in

Toyota Research Institute
Z.ai (Zhipu AI)

Evidence

3 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
used 2unclear 1

VLA Foundry (Foundry-VLA-1.7B)

Toyota Research Instituteadopted1 source

The training loop supports the standard levers for scaling distributed training – FSDP (with optional CPU offloading), mixed precision, gradient checkpointing, torch.compile, and gradient accumulation.

usedoptimizationin VLA FoundryToyota Research Institute
1 more from this model

The loop composes cleanly with the distributed training primitives users expect: FSDP with optional CPU offloading, mixed-precision execution

unclearoptimizationin VLA FoundryToyota Research Institute
↑