single mention · optimization
Action-expert-specific sharding groups
Dedicated shard groups are created exclusively for action expert modules within FSDP training.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See training parallelism for the methods filed beside it.
Filed under optimization › training parallelism