Resiliency Stable docs: @docs/training/resiliency.md, @docs/training/checkpointing.md Card: @skills/nemo-mbridge-resiliency/card.yaml Enablement Fault tolerance (Slurm only) Option 1: NeMo Run plugin (recommended) | Plugin parameter | Default | Description | |---|---|---| | | 3 | Max restarts within same job | | | 2 | Max new job launches on failure | | | 1800 | First heartbeat timeout (seconds) | | | 300 | Subsequent heartbeat timeout (seconds) | Option 2: Direct config + ft launcher Launch with (not ): | Config parameter | Default | Description | |---|---|---| | | False | Enable fault toler…