single mention · optimization
Magnitude-based task-vector sparsification
Retains the largest-magnitude parameters in each task vector for merging.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimization for the methods filed beside it.
Also called magnitude-based sparsification.
Filed under optimization