specific method · filed under data curation
XTML (eXtensible Token Markup Language)
An XML-like chat-template markup that uses reserved tokens for opening, separation, closing, and message termination.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- core
How sources treat it
One count per evidence span, weakest treatment to strongest.
core 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
the template adopts XTML (eXtensible Token Markup Language), an XML-like markup in which the angle-bracket syntax is replaced by three reserved special tokens: [open], [sep] and [close], with an additional [end_of_msg] token as the generation stop marker.
coresoftware implementationin Kimi K3Moonshot AI
Filed alongside
Other methods under data curation :: tokenization.