LFM3-1.7B
Liquid AIeach block normalizes both its input and its output to keep activations well-scaled
1 more from this model
Each block normalizes both its input and its output
specific method · filed under model architecture
Normalizes both the input and output of each block.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See normalization & residual for the methods filed beside it.
Also called Sandwich norm.
2 quotes from 2 sources, one card per model, each opening with its strongest.
each block normalizes both its input and its output to keep activations well-scaled
Each block normalizes both its input and its output