specific method · filed under inference & serving
Python tool
A code interface used to interact with images through operations such as cropping, zooming, and drawing.
- sources
- 4
- models
- 3
- labs adopt it
- 3
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
Documented in
Evidence
4 spans quoted from the sources, strongest treatment first.
Use this tool to execute Python code in your chain of thought.
During inference, Inkling can also leverage a Python tool to support image understanding through operations such as zooming and cropping, while seamlessly integrating visual reasoning with code-based reasoning.
we grant the model an enriched action space to interact with images, including cropping, zooming in and out, and drawing pixels or bounding boxes. These tools are implemented as a unified code interface, commonly referred to in the field as the Python tool.
Python Tool — For fine-grained visual tasks (high-resolution images, visual probing, bounding-box analysis)
Filed alongside
Other methods under inference & serving :: agentic scaffolding.