general family · filed under post-training
Reinforcement learning
Reinforcement learning is a post-training method that optimizes a model against explicit reward signals on its own rollouts rather than on fixed demonstrations.1 Unlike supervised fine-tuning, it gives targeted feedback on test-time inference errors, improving robustness and generalization.2
Trade-off It yields larger robustness and generalization gains than SFT for the same compute budget.3
How this definition was written
Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.
RL provides explicit inference feedback on the model’s own rollouts, aligning the optimization objective with how the system is actually deployed
— Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long TailUnlike SFT, which optimizes the likelihood of expert demonstrations under teacher forcing without feedback on the test-time inference errors
— Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailyields disproportionately larger gains in robustness and generalization for the same compute budget
— Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail
Also called RL, Reinforcement Learning (RL), advanced reinforcement learning techniques, reinforcement learning (RL) training, strengthened reinforcement learning, RL training.