Model techniques map
Techniquesmodel architecture

specific method · filed under model architecture

Encoder-free decoder-only Transformer architecture

A single decoder-only Transformer architecture that does not use a separate encoder.

Also called encoder-free architecture.

source
1
model
1
lab adopt it
1
strongest
core

How sources treat it

One count per evidence span, weakest treatment to strongest.

core 1

Documented in

Evidence

1 span quoted from the sources, strongest treatment first.

Gemma 4 12B solves these issues by utilizing a single decoder-only transformer

coremodel architecturein Gemma 4 12BGoogle

Filed alongside

Other methods under model architecture.