Open Models Almanac
Methodsoptimizationtraining stability

single mention · optimization

Simulate large-scale training instability by raising the learning rate

The sources on this page only mention it in passing. See training stability for the methods filed beside it.

Also called raising the learning rate.

Filed under optimization › training stability