Open Models Almanac
Methodspost-trainingagentic post-training

methods · post-training

agentic post-training

69 methods filed at this node or below it, from the sources of 19 models.

In this branch 69

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 69

Agentic reinforcement learning core · 8 sources · 8 quotes
Merlin–Arthur protocol core · 2 sources · 4 quotes
Multi-environment reinforcement learning core · 2 sources · 2 quotes
Agentic post-training used · 2 sources · 2 quotes
Agentic tool-use post-training used · 2 sources · 2 quotes
62 single mentions
Common agent-environment interaction loop core · 1 source · 1 quote
Durable peer-mailbox communication core · 1 source · 1 quote
End-to-end project development core · 1 source · 1 quote
Weighted environment sampling core · 1 source · 1 quote
Autonomous Execution Tasks used · 1 source · 1 quote
Concurrent multi-environment post-training used · 1 source · 1 quote
Container-level network isolation used · 1 source · 1 quote
Crash-as-failure trajectory handling used · 1 source · 1 quote
Generate-verify-refine loop used · 1 source · 1 quote
German-language RL training environments used · 1 source · 1 quote
Harness randomization for agentic training used · 1 source · 1 quote
Harness-optimized training used · 1 source · 1 quote
Morgana adversarial context hiding used · 1 source · 1 quote
Multi-harness reinforcement learning used · 1 source · 3 quotes
Multi-turn collaboration simulator used · 1 source · 1 quote
Per-episode configuration randomization used · 1 source · 1 quote
Prompt typo injection used · 1 source · 1 quote
Python-tool use during chain-of-thought used · 1 source · 1 quote
Re-post-training for agentic capabilities used · 1 source · 1 quote
Reinforcement learning with self-feedback used · 1 source · 1 quote
Seed-based terminal-task generation used · 1 source · 1 quote
Self-hosted user simulator used · 1 source · 1 quote
Unified white-box RL environment used · 1 source · 1 quote
Fresh or snapshot-based teammate initialization optional · 1 source · 1 quote
RL restricted to search and code environments evaluated · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelmethods
DeepSeek-V4.1-Flash-1017 coreEnd-to-end project development coreReinforcement learning with self-feedback used—
DeepSeek-V4.1-Flash coreDurable peer-mailbox communication coreCollaborative multi-agent construction of coding environments usedCrash-as-failure trajectory handling usedFailure replay and targeted reinforcement learning usedGenerating real-workflow agent environments from feedback and failure cases usedIndependent multi-agent testing and inspection of coding environments usedIsolated-container environment setup and packaging usedIterative agent-led environment repair and reverification usedLifecycle monitoring and quality re-auditing of RL tasks usedMocked-tool construction for real-world interfaces usedMulti-objective reinforcement-learning reward for agent collaboration usedFresh or snapshot-based teammate initialization optional—
GLM-5.3 usedEnvironment scaling for realistic training tasks used—
DeepSeek-V4-Flash-0731 usedRe-post-training for agentic capabilities used—
MiMo-V2.6-Flash coreAgentic reinforcement learning coreContainer-level network isolation usedEnvironment hardening during reinforcement learning usedEnvironment preparation to prevent solution leakage usedMulti-harness reinforcement learning usedUnified trajectory representation for agentic RL used—
NVIDIA-Nemotron-3-Ultra-550B-A55B usedConcurrent multi-environment post-training usedMulti-environment reinforcement learning used—
DeepSeek-V3.2 usedGenerate-verify-refine loop usedLarge-scale reinforcement learning on synthetic agentic data usedTraining agentic policies with real-world tools usedRL on synthetic agentic tasks in non-thinking mode evaluatedRL restricted to search and code environments evaluated—
Kimi K3 coreTraining on verifiable problems in agentic environments coreAutonomous Execution Tasks usedMock applications for personal-assistant RL usedUnified white-box RL environment used—
Kolibri-1 coreEnvironment sampling proportional to sampling and curriculum weights coreMerlin–Arthur protocol corePrompt sampling by difficulty bucket and evaluation recency coreRandomization of RL environments and prompts coreRetrieval-augmented question-answering training coreWeighted environment sampling coreAgentic retrieval environments for RAG training usedGerman-language RL training environments usedHarness randomization for agentic training usedLong-context question-answering RL environment usedMorgana adversarial context hiding usedPer-episode configuration randomization usedPer-group randomization of system prompt, coding harness, and user request usedPrompt typo injection usedRandomized preservation of reasoning traces across turns usedRandomized reasoning-effort level per rollout group usedRandomized retrieval setup and task language usedRandomized training environments for real-world robustness usedRL environments for political balance, copyright, and safety usedSelf-hosted user simulator usedSeparate abstention-only environment for unanswerable questions usedTool-calling and terminal-environment post-training usedTraining environments that simulate real-world use cases used—
LFM3-1.7B usedAgentic post-training usedAgentic reinforcement learning used—
Laguna-S-2.1 coreAgentic reinforcement learning coreProduction-harness-matched reinforcement learning coreMulti-harness trajectory training with native behavior preservation usedSeed-based terminal-task generation used—
MiMo-V2.5 usedAgentic post-training usedAgentic reinforcement learning used—
MiMo-V2.5-Pro usedAgentic post-training usedAgentic reinforcement learning used—
MiMo-V2.6-Pro coreAgentic reinforcement learning coreContainer-level network isolation usedEnvironment hardening during reinforcement learning usedEnvironment preparation to prevent solution leakage usedMulti-agent task decomposition and coordination usedMulti-harness reinforcement learning usedUnified trajectory representation for agentic RL used—
MiniMax-M3 usedMulti-turn collaboration simulator used—
Mistral-Large-4 coreCommon agent-environment interaction loop coreTerminal-task difficulty calibration using solver pass rates used—
NVIDIA-Nemotron-3.5-Lightning-30B-A3B coreMulti-environment reinforcement learning coreFinance-agent environment with consistent tools across training stages usedHarness-optimized training usedTraining agentic teachers on sandboxed executable tasks used—
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B usedFinance-agent environment with consistent tools across training stages usedTraining agentic teachers on sandboxed executable tasks used—
gpt-oss-120b usedAgentic tool-use post-training usedPython-tool use during chain-of-thought used—
↑