Kolibri-1
Aleph Alphawe redact PII from all training sources. Each category is detected by a regular expression, checked by a validator that rejects false positives, and replaced by a special token.
1 more from this model
We removed personally identifiable information from pre-training data using regular expressions, replacing high-syntax-constraint entity types with special tokens