Enabling asynchronous checkpointing from the Nvidia Resiliency Extension (NVRx), where model parameters are copied to CPU and persisted in the background while training continues
1 more from this model
Enabling asynchronous checkpointing from the Nvidia Resiliency Extension (NVRx)