Skip to main content
Server Tools are capabilities that ARouter executes on behalf of models during inference. Unlike user-defined function calling (where your code runs the function), Server Tools are handled entirely by ARouter — the model decides when to invoke them, ARouter executes them, and the results are injected back into the conversation automatically.
Server Tools are currently in beta. The interface is stable but additional tools are being added.

Available Server Tools

Server Tools vs Plugins vs User-Defined Tools

Use Server Tools when you want the model to decide whether and when to search, rather than forcing a search on every request.

How Server Tools Work

The entire tool execution cycle happens server-side. Your application receives the final response with results already incorporated.

Quick Start

Add Server Tools to any chat completion request via the tools array using the arouter: namespace:

Combining Multiple Server Tools

You can enable multiple Server Tools in a single request. The model will choose which to invoke based on the user’s query:

Combining with User-Defined Tools

Server Tools can coexist with your own function definitions:
ARouter handles the arouter type tools; your application handles the function type tools.

Usage Tracking

Server Tool usage is tracked in the usage field:

Next Steps