LLM backends#
Turn a request into a reply: the one external seam of a campaign. See LLM backends.
Interface#
Anything that completes a request. |
|
One call: the role making it, the model, the prompt and the sampling parameters. |
|
The provider's answer: its text, token usage as the provider reports it and the model that answered. |
|
The provider refuses calls because the balance or quota is exhausted; its message says so in its words. |
|
The provider answered, without an error, something that is not a reply; its message says what it lacked. |
|
A backend that asks |
|
Build the backend a role's config names in |
Backends#
Complete a request with one chat-completions call. |
|
Complete a request with one Messages API call. |
|
Complete a request with one headless Claude Code call. |
|
Answer each request with the recorded reply to the same role, model and prompt. |
|
The recorded run holds no reply for a request: it ran out of calls, or the run asked something else. |
|
The call files of one run directory's |