Open Models Almanac
Methodsoptimization

single mention · optimization

Magnitude-based task-vector sparsification

Retains the largest-magnitude parameters in each task vector for merging.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimization for the methods filed beside it.

Also called magnitude-based sparsification.

Filed under optimization