Kolibri-1
Aleph AlphaTo produce the final checkpoint we merged two checkpoints trained for the same token horizon on two different data mixtures.
usedoptimizationin KolibriAleph Alpha
1 more from this model
each parameter of a soup is the mean of its values in the two models.
useddata curationin KolibriAleph Alpha