Open Models Almanac
Methods

single mention · not yet filed

Overlap teacher forward computation with the trainer's final forward batch

The sources on this page only mention it in passing.