specific method · filed under model architecture
Per-layer key-value conditioning
Per-layer key-value conditioning is an interface that lets a separately trained action expert receive context from a vision-language model at every layer rather than from a single compressed representation.1 Each action-expert block cross-attends to the corresponding VLM layer's keys and values, giving the expert access to the same attention state the VLM uses while keeping the backbone modular and unchanged.2
How this definition was written
Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.
Instead, MolmoAct2 conditions the expert on the VLM at every layer
— MolmoAct2 Action Reasoning Models for Real-World DeploymentEach action-expert block cross-attends to the corresponding VLM layer’s keys and values, after lightweight learned projections map the VLM attention state into the expert’s cross-attention width
— MolmoAct2 Action Reasoning Models for Real-World Deployment
Also called per-layer KV conditioning, per-layer KV (key-value) conditioning, standard per-layer KV conditioning.