single mention · inference & serving
Request timeouts and retries
Agent loops are advised to set request timeouts and retries for model requests.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See agentic scaffolding for the methods filed beside it.
Also called set a request timeout and a retry.
Filed under inference & serving › agentic scaffolding