general family · filed under inference & serving
Asynchronous inference and execution
Asynchronous inference is an inference-scheduling method for robot policies that decouples action execution from policy inference, allowing predictions and control to run in parallel.1 While the next action chunk is being inferred, the robot keeps executing the remaining actions of the current chunk, so actions are always available for execution throughout inference.2,3
Trade-off It achieves comparable success rates to synchronous inference while substantially reducing task completion time.4
How this definition was written
Summarised by glm-5.3-flash from 2 sources; every sentence is checked against the quote it cites.
the async mode decouples action execution and policy inference, allowing predictions and control to run in parallel
— SmolVLA: A vision-language-action model for affordable and efficient roboticsthe robot continues executing the remaining actions of the current chunk while the next chunk is being inferred
— Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executionthere are always actions available for execution throughout the entire inference
— Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executionboth inference modes achieve comparable success rates across three real-world tasks. However, asynchronous inference demonstrates a substantial speed advantage
— SmolVLA: A vision-language-action model for affordable and efficient robotics
Also called async scheduling, asynchronous (async) inference stack, asynchronous inference, Asynchronous inference for robot policies, Asynchronous inference scheduling, asynchronous execution.