Document invocation observation and cost reporting
This commit is contained in:
@@ -223,7 +223,7 @@ Backend definitions are supplied through caller-selected configuration
|
||||
sources. The conventional backend IDs are names only; PromptKit does not
|
||||
install definitions for them.
|
||||
|
||||
A backend definition may have `endpoint`, `api_key_env`,
|
||||
A backend definition may have `provider`, `zero_cost`, `endpoint`, `api_key_env`,
|
||||
`concurrency_limit`, `queue_capacity`, `extra_params`, and `smoke_tests`. The
|
||||
final endpoint is required and must be an absolute HTTP(S) URL with a host, no
|
||||
user information, query, or fragment. An omitted or null API-key environment
|
||||
@@ -237,6 +237,17 @@ unrecognized backend field is application data and is not automatically redacted
|
||||
by Promptkit. Applications own sensitivity declarations and disclosure policy
|
||||
for their extension fields.
|
||||
|
||||
`provider` selects response and diagnostic conventions independently of the
|
||||
backend ID, endpoint, or model. Its final value is trimmed and lowercased;
|
||||
omitted, null, or blank selects `openai-compatible` at runtime. Supported
|
||||
nonblank values are `openai-compatible`, `openrouter`, and `vllm`. `zero_cost`
|
||||
is an optional Boolean: true supplies a zero-cost fallback when a dispatched
|
||||
attempt has no usable reported cost; omitted, null, and false disable it.
|
||||
Neither setting is sent to the provider. They follow normal layering and
|
||||
inheritance, and endpoint overrides retain the selected backend's policy.
|
||||
Resource inspection shows declared normalized values without inventing runtime
|
||||
defaults; configuration inspection retains source history.
|
||||
|
||||
`smoke_tests` is optional backend metadata for explicit diagnostic operations.
|
||||
It may contain `default_profile`, `reachability`, and `authentication`:
|
||||
|
||||
@@ -274,6 +285,10 @@ Without a selected adapter, authentication diagnostics report an unsupported
|
||||
selection. An endpoint-only authentication
|
||||
block overrides the destination of a provider default; `kind: none` suppresses
|
||||
that default.
|
||||
Previously, a supplied authentication object required `kind`. Endpoint-only
|
||||
objects now use a provider default where available; clearing the object
|
||||
restores that default rather than suppressing it. Use `kind: none` to suppress
|
||||
authentication testing.
|
||||
These values are configuration only: engine construction does not contact a
|
||||
backend.
|
||||
|
||||
@@ -364,7 +379,7 @@ does not disable the caller context or HTTP transport timeout.
|
||||
|
||||
### Bundled OpenRouter Configuration
|
||||
|
||||
The default bundle installs root backend `openrouter`, endpoint
|
||||
The default bundle installs root backend `openrouter`, provider `openrouter`, endpoint
|
||||
`https://openrouter.ai/api/v1`, optional credential environment name
|
||||
`OPENROUTER_API_KEY`, and smoke metadata selecting `gpt-luna-latest` with the
|
||||
`openrouter_key` authentication adapter. Existing diagnostic endpoint fallback
|
||||
|
||||
Reference in New Issue
Block a user