Open Models Almanac
Methodsmodel architecturemultimodal architecture

specific method · filed under model architecture

Joint vision-language pre-training from the start

Trains visual and text representations jointly from the beginning of language-model pre-training.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See multimodal architecture for the methods filed beside it.

sources
3
models
2
lab adopt it
1
strongest
core

Documented in

Evidence

3 quotes from 3 sources, one card per model, each opening with its strongest.

How sources treat it
used 1core 2
↑