CPU Offloading References - Stable docs: @docs/training/cpu-offloading.md - Structured metadata: @skills/nemo-mbridge-perf-cpu-offloading/card.yaml What It Is Two independent mechanisms to move data from GPU to CPU memory: | Mechanism | Config namespace | What gets offloaded | PP restriction | |---|---|---|---| | Activation offloading | | Activations (and optionally weights) per transformer layer | PP must be 1 | | Optimizer offloading | | Adam optimizer states (momentum + variance) via | None | Quick Decision | Situation | Recommendation | |---|---| | Large MoE model (30B+), needs PP 1 | Opt…