Open Models Almanac
Methods

single mention · not yet filed

30T-token multimodal pre-training corpus

The sources on this page only mention it in passing.