Open Models Almanac
Methodssoftware implementation

methods · outside the pipeline

software implementation

116 methods filed at this node or below it, from the sources of 31 models.

In this branch 116

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 15

Checkpoint sharding for offline generation used · 2 sources · 2 quotes
Data Designer used · 2 sources · 2 quotes
13 single mentions
Checkpoint abstraction core · 1 source · 1 quote
Cluster abstraction core · 1 source · 1 quote
Composable typed pipeline functions core · 1 source · 1 quote
Runtime model and dataset registry core · 1 source · 1 quote
Sequential composable WebDataset pipelines core · 1 source · 1 quote
Separation of prompt encoding from inference default · 1 source · 1 quote
CUDA used · 1 source · 1 quote
fastsafetensors used · 1 source · 1 quote
Nemotron Parse used · 1 source · 1 quote
NVIDIA NIM used · 1 source · 1 quote
Model routing and orchestration optional · 1 source · 1 quote

inference engine 19

vLLM used · 7 sources · 7 quotes
TensorRT-LLM used · 3 sources · 4 quotes
SGLang optional · 4 sources · 4 quotes
KTransformers optional · 2 sources · 2 quotes
Unsloth optional · 2 sources · 2 quotes
14 single mentions
One-GPU FP8 vLLM replicas core · 1 source · 1 quote
vLLM general-plugins entry point core · 1 source · 1 quote
vLLM plugin core · 1 source · 1 quote
Atlas inference library used · 1 source · 1 quote
litert-lm serve used · 1 source · 1 quote
llama.cpp used · 1 source · 1 quote
llm-d routing with Model Express startup used · 1 source · 1 quote
vLLM or SGLang serving used · 1 source · 1 quote
vLLM tensor parallelism across eight GPUs used · 1 source · 1 quote
Dedicated serving engines optional · 1 source · 1 quote
vLLM language-model-only serving mode optional · 1 source · 1 quote
vLLM-Ascend optional · 1 source · 1 quote
xLLM optional · 1 source · 1 quote

training framework 13

Hugging Face Transformers used · 4 sources · 4 quotes
Megatron-LM used · 3 sources · 3 quotes
NeMo Gym used · 2 sources · 2 quotes
10 single mentions
Dagster core · 1 source · 1 quote
Declarative training-run configuration core · 1 source · 1 quote
Experiments as Code core · 1 source · 1 quote
Savanna core · 1 source · 1 quote
Shared model-agnostic training loop core · 1 source · 1 quote
ms-swift used · 1 source · 1 quote
NeMo used · 1 source · 1 quote
TRL used · 1 source · 1 quote
Training with pretrained Hugging Face backbones optional · 1 source · 1 quote

kernel & quantization library 25

AngelSlim used · 2 sources · 2 quotes
FlashInfer used · 2 sources · 2 quotes
FlashInfer NVLinkOneSided all-to-all used · 2 sources · 2 quotes
FlashInfer TensorRT-LLM backend used · 2 sources · 2 quotes
MegaMoE used · 2 sources · 3 quotes
NVIDIA Model-Optimizer used · 2 sources · 2 quotes
deepseek-recipe optional · 2 sources · 2 quotes
18 single mentions
AITER gfx950 DSA indexer kernels default · 1 source · 1 quote
AITER sparse MLA decode kernels default · 1 source · 1 quote
AITER backend used · 1 source · 1 quote
Container-baked precompiled artifacts used · 1 source · 1 quote
FLASHMLA_SPARSE used · 1 source · 1 quote
FlashQLA used · 1 source · 1 quote
Marlin MoE backend used · 1 source · 1 quote
MiniTriton used · 1 source · 1 quote
MiniTriton 5 used · 1 source · 1 quote
MiniTriton dual-mode tensor library used · 1 source · 1 quote
CUTEDSL optional · 1 source · 1 quote
CUTLASS optional · 1 source · 1 quote
FlashInfer backend optional · 1 source · 1 quote
flash-moba evaluated · 1 source · 1 quote
Flash-Sparse-Attention evaluated · 1 source · 1 quote
ModelOpt AutoQuantize evaluated · 1 source · 1 quote
Triton mentioned · 1 source · 1 quote

agent product 11

OpenCode used · 4 sources · 4 quotes
Claude Code used · 3 sources · 3 quotes
OpenHands used · 2 sources · 2 quotes
Qwen-Agent used · 2 sources · 2 quotes
7 single mentions
Droid used · 1 source · 1 quote
Mini-SWE-Agent used · 1 source · 1 quote
OpenClaw used · 1 source · 1 quote
Pi used · 1 source · 1 quote
Stirrup used · 1 source · 1 quote
Kilo optional · 1 source · 1 quote

infrastructure service 33

Automatic provider failover and retry core · 7 sources · 7 quotes
32 single mentions
Core scheduling by priority class core · 1 source · 1 quote
End-to-end lineage tracking core · 1 source · 1 quote
Parallel preprocessing with Ray core · 1 source · 1 quote
Sandbox pause and resume core · 1 source · 1 quote
Allowlisted sandbox egress proxy used · 1 source · 1 quote
Apptainer image conversion and caching used · 1 source · 1 quote
Central scheduler used · 1 source · 1 quote
DeepEP v2 with ElasticBuffer used · 1 source · 1 quote
Dependency version unification used · 1 source · 1 quote
Fresh-clone repository sanitization used · 1 source · 1 quote
HTTP/HTTPS sidecar proxy used · 1 source · 1 quote
In-house batch scheduler used · 1 source · 1 quote
Local container-image caching used · 1 source · 1 quote
Model Express used · 1 source · 1 quote
Model Factory used · 1 source · 1 quote
Mooncake used · 1 source · 1 quote
NeMo Guardrails used · 1 source · 1 quote
NeMo Switchyard used · 1 source · 1 quote
NIXL toy proxy used · 1 source · 1 quote
NVIDIA Dynamo used · 1 source · 1 quote
Per-node pooling of initialization actors used · 1 source · 1 quote
Ray data plane used · 1 source · 1 quote
Shared read-only SquashFS root used · 1 source · 1 quote
Vendoring external dependencies used · 1 source · 1 quote
Write-ahead log (WAL) used · 1 source · 1 quote
Z3 SMT solver integration used · 1 source · 1 quote
Ray optional · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelfiled hereinference enginetraining frameworkkernel & quantization libraryagent productinfrastructure service
DeepSeek-V4.1-Flash-1017 usedPython reference implementation for prompt encoding used———deepseek-recipe optional———
GLM-5.3-Flash used—————Automatic provider failover and retry used—
DeepSeek-V4.1-Flash core———deepseek-recipe optional——Core scheduling by priority class coreRelaxed-consistency sandbox placement engine coreSharding and relaxed-consistency scheduling core—
Hy4-preview used—vLLM or SGLang serving used——AngelSlim usedFLASHMLA_SPARSE used———
Step-5-Preview coreCheckpoint sharding for offline generation used———MegaMoE used—Repository-level software engineering with iterative code execution and verification core—Automatic provider failover and retry used—
GLM-5.3 used———AITER backend used———
Hy3 mentioned———AngelSlim mentioned———
MiMo-V2.6-Flash used—vLLM tensor parallelism across eight GPUs used—————
NVIDIA-Nemotron-3-Ultra-550B-A55B usedCUDA usedData Designer used—Environment-variable propagation to subprocesses usedvLLM usedSGLang optionalTensorRT-LLM optional—Hugging Face Transformers usedMegatron-LM usedNeMo usedNeMo Gym used—Container-baked precompiled artifacts usedFlashInfer usedFlashInfer NVLinkOneSided all-to-all usedNVIDIA Model-Optimizer usedCUTEDSL optionalCUTLASS optional—Droid usedOpenCode usedOpenHands usedStirrup used—Dependency version unification usedFresh-clone repository sanitization usedLocal container-image caching usedPer-node pooling of initialization actors usedReplacing short-lived Ray actors with tasks usedRay optional—
DeepSeek-V4-Flash used—————Write-ahead log (WAL) usedZ3 SMT solver integration used—
DeepSeek-V4-Flash-Vision-Exp defaultSeparation of prompt encoding from inference default—vLLM optional—————
DeepSeek-V4-Pro used—————Write-ahead log (WAL) usedZ3 SMT solver integration used—
DeepSeek-V4-Pro-0813 optional—————Automatic provider failover and retry optional—
GLM-5.2 used—KTransformers optionalSGLang optionalUnsloth optionalvLLM optionalvLLM-Ascend optionalxLLM optional—Hugging Face Transformers optional——Claude Code usedOpenHands used——
Gemma 4 31B core—litert-lm serve used————Automatic provider failover and retry core—
Inkling used—————Automatic provider failover and retry used—
Kimi K3 core———MiniTriton usedMiniTriton 5 usedMiniTriton dual-mode tensor library usedTriton mentioned—OpenClaw used—Incremental sandbox checkpointing and resumption coreSandbox pause and resume coreMooncake used—
Kolibri-1 coreCheckpoint abstraction coreCluster abstraction coreComposable typed pipeline functions core—One-GPU FP8 vLLM replicas corevLLM general-plugins entry point corevLLM plugin core—Declarative training-run configuration coreSavanna core———Allowlisted sandbox egress proxy usedApptainer image conversion and caching usedDeepEP v2 with ElasticBuffer usedPassive GPU health monitoring with NVIDIA DCGM usedShared read-only SquashFS root used—
Laguna-S-2.1 coreShared codebase for research and production used—Atlas inference library used—Dagster coreExperiments as Code core———End-to-end lineage tracking coreHTTP/HTTPS sidecar proxy usedIn-house batch scheduler usedModel Factory usedVendoring external dependencies used—
MiMo-V2.5 optional————Claude Code optionalKilo optionalOpenCode optional——
MiMo-V2.5-Pro optional————Claude Code optionalKilo optionalOpenCode optional——
MiMo-V2.6-Pro used—vLLM tensor parallelism across eight GPUs usedSGLang optionalvLLM optional—————
MiniMax-M3 used—KTransformers optionalSGLang optionalUnsloth optionalvLLM optional—Hugging Face Transformers optional—flash-moba evaluatedFlash-Sparse-Attention evaluated—Claude Code usedMini-SWE-Agent usedOpenCode usedPi used——
Mistral-Large-4 default—llm-d routing with Model Express startup usedTensorRT-LLM optional—TRL used—AITER gfx950 DSA indexer kernels defaultAITER sparse MLA decode kernels defaultMegaMoE FlashInfer expert-parallel CUTEDSL backend optional——Central scheduler usedModel Express usedNIXL toy proxy usedRay data plane used—
NVIDIA-Nemotron-3.5-Lightning-30B-A3B usedNemotron Parse usedModel routing and orchestration optional—TensorRT-LLM used——ModelOpt AutoQuantize evaluated——NeMo Guardrails usedNeMo Switchyard used—
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B usedNVIDIA NIM used——ms-swift usedReinforcement-learning environments in NeMo Gym used—ModelOpt AutoQuantize evaluated——NVIDIA Dynamo used—
Qwen3.5-397B-A17B used—vLLM language-model-only serving mode optional———Qwen-Agent used—Automatic provider failover and retry used—
Qwen3.6-35B-A3B corefastsafetensors used—Dedicated serving engines optional——Marlin MoE backend used——Automatic provider failover and retry core—
Qwen3.8-Flash-Next used———FlashQLA used———
Step-3.7-Flash used—llama.cpp used——FlashInfer TensorRT-LLM backend usedFlashInfer backend optional———
VLA Foundry (Foundry-VLA-1.7B) coreRuntime model and dataset registry coreSequential composable WebDataset pipelines core——Shared model-agnostic training loop coreTraining with pretrained Hugging Face backbones optional———Parallel preprocessing with Ray core—
↑