specific method · filed under evaluation
Automatic in-flight checkpoint evaluation scheduling
This method automatically schedules configurable evaluations for each training experiment against in-flight checkpoints.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
used 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
We schedule configurable evaluations automatically for every training experiment, run against in-flight checkpoints which execute on Atlas.
usedevaluation onlyin LAGUNA M.1/XS.2Poolside
Filed alongside
Other methods under evaluation :: evaluation harness.
DeepSeek Harness Minimal modeHarborNeMo Evaluator SDKAtomic binary rubric evaluationBenchmark evaluation frameworkCross-scaffold evaluationInline training evaluatorsIsolated container per rolloutJSON-structured answer-format promptmini-swe-agent harnessNeMo Gym and NeMo Evaluator-based harnessNeMo SkillsPool