Model techniques map
Techniquesinference & servingagentic scaffolding

implementation detail · filed under inference & serving

StreamableParser

A parser that decodes Harmony messages while tokens are streaming.

source
1
model
1
lab adopt it
1
strongest
optional

How sources treat it

One count per evidence span, weakest treatment to strongest.

optional 1

Documented in

Evidence

1 span quoted from the sources, strongest treatment first.

Additionally the openai_harmony library also includes a StreamableParser for parsing and decoding as the model is generating new tokens.

optionalsoftware implementationin openai/harmonyOpenAI

Filed alongside

Other methods under inference & serving :: agentic scaffolding.