Qwen3.6-35B-A3B
Alibaba (Qwen)we recommend using RoPE scaling techniques to handle long texts effectively.
general family · filed under model architecture
A general family of transformations to rotary position embeddings used to handle longer contexts; the evidence names YaRN as an example.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See positional encoding for the methods filed beside it.
Also called RoPE scaling for context extension, RoPE scaling techniques.
2 quotes from 2 sources, one card per model, each opening with its strongest.
we recommend using RoPE scaling techniques to handle long texts effectively.
we recommend using RoPE scaling techniques to handle long texts effectively, e.g., YaRN.
Picked by hand, not extracted: where to read more, not evidence for anything on this page.