Aiter AI World
EnglishSign inGet started
Loading…

Smart Router

Let the gateway choose the model per request with the smart/eco, smart/auto and smart/max model ids.

Base URL for this deployment: https://www.aiteraiworld.com/api/v1

Routing modes

Model idBehaviour
smart/ecoAlways the cheapest candidate in the eco list.
smart/autoSimple requests go to the eco list; long prompts, tool use, structured output or long system prompts go to the max list.
smart/maxAlways the strongest candidate in the max list.

Candidates are listed by the operator in the smart_router_json site setting. When a list is empty the gateway falls back to the cheapest and most expensive listed chat models.

Using a smart model

json
{
  "model": "smart/auto",
  "messages": [{ "role": "user", "content": "Summarise this contract" }],
  "stream": true
}

The response model field names the concrete model that answered and the X-AiterAI-Routed-Model header repeats it. The generation record keeps the original smart id under details.routed_from. Usage is metered at the chosen model's price, and member pricing applies when that model supports it.

GET /api/v1/smart-router lists the modes and their current candidates.