Open Models Almanac
Methodsmodel architecturechannel mixerdense feed-forward network

single mention · model architecture

SwiGLU-clip

A named SwiGLU clipping technique for activation control, with no further clipping details in the evidence.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See dense feed-forward network for the methods filed beside it.

Also called SwiGLU clipping for activation control.

Filed under model architecture › channel mixer › dense feed-forward network