59 KiB
PromptKit v0.19.0 adoption and ConfigKit operator CLI
Status: proposed roadmap for review. Scope is agreed in principle; implementation has not started. Command spellings, report designs, and API changes below are recommendations except where explicitly recorded as agreed below. Accepted report formats are an initial implementation target; practical beta feedback will guide later refinements rather than requiring exhaustive layout design now.
Purpose and ownership
Adopt released PromptKit v0.19.0 and expose useful operator tasks through
standard CommandKit commands, flags, and reports. This roadmap covers CLI
exposure, including ConfigKit v1.1.0 operator features in ckconfig. It does not
turn ckprompt into a convenience library for application-internal PromptKit
operations. Applications continue to own engine construction, domain inputs,
credentials, execution, and their executable lifecycle.
The architecture policy, optional-module decision, and reporting decision govern implementation. The CLI reference and public GoDoc remain the owners of implemented contracts. This roadmap selects work for review, not new guarantees about upstream behavior or permanent limits on future features.
Baseline and released evidence
Repository baseline: 0b4e47c4206e323f7c5d5ec3f357494dd23008b2.
The completed v0.18.0 adoption is not reopened.
| Component | Current baseline | Target |
|---|---|---|
| Core | go.maximumdirect.net/commandkit; Go 1.26.0 minimum |
No core change needed for flag collections or scoped aliases; assess a small shared YAML output helper during implementation. |
ckconfig |
ConfigKit v1.1.0; Go 1.27.0; core v0.3.0 | Shared CLI inspection extensions and a new appropriate module release. |
ckprompt |
PromptKit v0.18.0; ConfigKit v1.1.0; ckconfig/core v0.3.0; Go 1.27.0 | PromptKit v0.19.0 and the ckconfig version delivering the shared work. |
| Candidate | ckprompt v0.3.0, recorded as unpublished | Update the unpublished candidate after checking its status during implementation. |
| Local workspace | Core and both integrations, Go 1.27.0 | Validate local composition and independent modules separately. |
Use PromptKit tag v0.19.0, commit
4f3212bfb6c1f37f43d50715c2cedc1d43203064. Its Go minimum remains
1.27.0 and its ConfigKit dependency remains v1.1.0. Reviewed sources are the
release notes,
request and report types,
engine API,
namespace API,
configuration inspection API,
and smoke API.
Work against released versions only; do not inspect or monitor unreleased
upstream work in anticipation of another adoption.
ConfigKit v1.1.0 is already adopted at released commit
191015e289d7f2b91abb9fdd9c4f2f5cf75b4de9. Its
inspection API,
metadata API,
and configuration reference
support the additional CLI work below without an upstream dependency upgrade.
Its matched history for registered records moving within lists flows through
native inspection; it does not introduce identity-based CLI paths or
element-level effective diffs.
Current ckprompt supplies prompt/profile inspection, requirements discovery,
concrete request validation, prompt/profile/backend/namespace/collection
catalogs, and four smoke operations plus test all. Smoke commands already
expose most execution overrides and detailed native evidence. Validation has
profile, session, variable, and file-input flags but lacks that override surface.
There is no concrete request preview or dedicated backend detail command.
Current ckconfig supplies validation, native effective YAML, source inventory,
path explanation with history, and reduced semantic comparison. Its View
contains effective, sources, and explanation facets. Native metadata is not
exposed as a capability. config sources returns on acquisition failure before
rendering evidence; loaders convert native diagnostics into presentation
messages but do not expose a structured diagnostics report. Relevant boundaries
are ckconfig contracts,
ConfigKit adapters, and
PromptKit adapters.
Effective display currently writes the whole configuration. Sources are reported as a complete inventory. Comparison accepts independent config/overlay choices, but applies the same application selectors to both typed inputs and succeeds when a comparison reports differences. The new tasks extend those boundaries; they do not replace already-delivered explanation or smoke functionality.
Targeted end state
The original adoption tasks remain included:
- Update the dependency, checksums, attribution, and unpublished candidate note.
- Document all three upstream compatibility changes and correct credential inspection wording.
- Cover the new authentication reason and corrected smoke preparation-error propagation at CommandKit's boundary.
- Validate the final independent modules and aligned workspace.
Add the following operator capabilities. Syntax is illustrative unless selected in the decisions at the end of this document.
| Operator task | Proposed CLI | Owning module and report |
|---|---|---|
| Inspect what a concrete prompt request prepares | promptkit show prepared PROMPT_ID --profile … --input-file … --var … |
ckprompt: YAML report of selected IDs, effective settings, rendered/appended messages, output contract and schema, session, hashes, and timing from PreparedRun. |
| Supply a short sample to one prompt without creating a file | promptkit show prepared PROMPT_ID --input NAME=TEXT; also request validation |
ckprompt: native inline input for single-prompt preparation; file input remains available through --input-file NAME=PATH. |
| Reproduce target/provider settings without editing configuration | Applicable existing smoke override flags on validation and preview; --llm-extra-params JSON on these and smoke operations |
ckprompt: native request forwarding; preview and smoke reports show returned effective settings. |
| Resolve unqualified resource selections in chosen namespaces | Independent prompt/profile/backend namespace flags | ckprompt: delegate to native namespace views, retaining the distinction from catalog filters. |
| Find configuration paths and inspect their explicitness | config explain --list --scope promptkit, with historical selection; metadata alongside path explanation |
ckconfig, wired through ckprompt.ConfigScope: observed paths, effective presence, explicitness/null/origin evidence, and available history. |
| Understand both sides of configuration changes | config diff --scope promptkit --details |
ckconfig: native paths, left/right snapshots, presence/redaction, and hidden-change evidence. |
| Investigate a failed configuration load | config sources --scope promptkit on failure; config validate --details --scope promptkit |
ckconfig, with both native adapters: acquired source inventory and native codes, severities, paths, and locations while retaining the load failure. |
| Inspect one effective value or subtree | config show --scope app --path /server |
ckconfig: the selected native effective snapshot, retaining redaction and absence/null distinctions. |
| Follow a source reference | config sources --source-id ID |
ckconfig: the matching acquired source record, including evidence available after failure. |
| Compare different application selections | For example, config diff --campaign spring --against-campaign autumn |
ckconfig: independently prepared typed inputs passed to the existing native comparison provider. |
| Detect configuration differences in scripts | config diff --check |
ckconfig: a deliberate difference outcome based on native records, alongside the selected comparison report. |
| Narrow an inspection to relevant evidence | Subtree/explicitness filters on explanation discovery; severity/code filters on validation diagnostics | ckconfig: filtered native evidence with source references retained. |
The configuration suite retains six subcommands: scopes, validate, show,
sources, explain, and diff. Path discovery belongs within config explain;
structured diagnostics belong within config validate. This command placement
is agreed. OD-4 selects --list and --path as the explanation modes, with
help on a bare invocation. OD-6 selects config validate --details for detailed
diagnostics while retaining concise validation by default. Initial report
presentation and filter spellings are selected under OD-4, OD-6, and OD-8; exact
Go projections can be refined during implementation. No separate path inventory
or diagnostics subcommand is planned.
Transient configuration overrides are included under OD-11 as an opt-in loader
capability. config validate --set /workers=0 and
config show --set /server/port=8080 apply temporary overrides during acquisition
without editing source files. Numeric conversion, unusual pointer keys, loader
composition, and comparison-side grammar remain to be finalized.
Compatibility and native semantics
Document these v0.19.0 changes for consumers constructing engines and inputs:
- Successful custom
ArtifactReader.Readtransfers ownership of its returned artifact and mutable body storage. Readers retaining scratch storage must supply independent returned storage and stop mutating returned aliases. ProfileSourceandBackendSourceprovider maps now use ConfigKit's native recursive Mapping forms: built-in scalar values,[]any, andmap[string]any. Explain explicit conversion ofjson.Numberand typed containers. Runtime execution overrides have a separate accepted-value contract; do not impose configuration-source restrictions on their flags.- Local-validation and structured-output schemas must be self-contained. External resources and filename-dependent base references fail preparation; internal references or explicit schema IDs supply the supported route.
No configuration-format migration is required from v0.18.0. Correct the CLI
description of api_key_required: it indicates a usable direct or environment
credential requirement and can coexist with api_key_env. Neither field is
evidence of current credential availability.
The new authentication response-limit reason is factual evidence with unknown credential acceptance. Continue forwarding native findings without converting false, unknown, unsupported, or incomplete observations into command failures. Actual preparation/operation errors retain the operational outcome and supported cause identity. Native errors and their categories remain upstream-owned.
Preview and request flags
Expose preview as promptkit show prepared PROMPT_ID, with YAML-only output
initially, through an independently available capability alongside existing
suite callbacks. The native adapter calls Engine.Prepare and projects its returned
snapshot; a preliminary ValidateRequest call is unnecessary. Use existing
typed selection, acquisition diagnostics, and invocation reporting patterns.
Exact callback names and signatures follow the selected CLI design.
Preview performs applicable resource I/O and rendering but no model call. Rendered and appended messages contain application content. Upstream excludes resolved credentials from prepared settings; that does not make the whole snapshot a redacted configuration report or a transferable execution handle. Expose the upstream snapshot evidence without implying later execution uses that exact snapshot or will succeed.
Provide public, reusable typed execution-flag collections in ckprompt, defined
once and used by smoke, validation, preview, and application-owned commands.
The collections standardize flag names, help, parsing, completion hints,
supplied-value tracking, and binding into native PromptKit request fields.
Applications retain their own input structs, request construction, engine
acquisition, execution, and outcomes. Reusing CLI declarations is within
CommandKit's ownership boundary; it does not introduce runtime convenience APIs.
Use the existing core CommandSpec[I].Flags, typed flag constructors, and
Supplied[T]. A generic collection factory can accept destination accessors
and return ordinary []commandkit.Flag[I]. Direct binding is sufficient for
ordinary use; existing CaptureFlags and FlagValues.ApplyTo
support deferred application or multiple destinations where needed. No core
change or new core collection abstraction is currently required. Exact exported
names and accessor signatures remain implementation design choices.
Keep execution-target overrides and the request-level transient retry field distinct even when one convenient collection includes both. Preserve omission instead of imposing shared defaults: ordinary execution and smoke diagnostics have different native retry defaults. Preserve native explicit zero/empty values and whole-map replacement semantics. Support deliberate subsets for actual command needs while retaining common flag names and meanings, using a proportionate composition API. Keep parsing in CommandKit and domain validity in PromptKit. Existing application builders remain authoritative as agreed in OD-2. That decision also selects literal-text and file input bindings and defers output-contract overrides and appended-message controls.
Namespace selection
Design independent prompt, profile, and backend defaults together. Native
WithNamespaces replaces all defaults on its new view; it has no partial-update
semantics. Under the agreed OD-3 design, opt-in selectors combine explicitly
declared suite defaults with supplied overrides; they do not infer defaults
from a loader's engine view.
Qualified IDs pass through native selection unchanged. Captured references,
configuration inspection, and namespace/collection inventories retain their
native meanings. Existing --namespace/--all-namespaces catalog filters
continue to describe filtering. Install new selectors only on operations where
they have a defined use; define that applicability table during implementation.
Shared configuration capabilities
Extend ckconfig through optional capabilities so existing custom providers can
keep their currently declared operations. Both FromConfigKit and
ckprompt.ConfigScope should expose available native evidence. Do not require
all providers to implement every new inspection mode. Providers lacking metadata
or structured diagnostics retain their existing explanation/validation behavior;
mode availability and help must reflect the capabilities supplied.
For metadata, use Metadata.HistoricalPaths, Lookup, IsExplicit, and
History. Enumeration covers observed paths, not all possible schema fields.
Do not discard history because effective lookup fails. Existing explanation
already reports current/historical values; add the missing discovery and
explicitness within explanation discovery instead of reproducing upstream
provenance logic. Preserve native list-index paths; do not silently reinterpret
them as resource IDs.
For optional detailed comparison, project the native Difference records
already returned by Scope.Compare; retain the existing concise report by
default. Keep snapshots and their presence/redaction fields together, including
HiddenChanged when the safe values look equal. Reuse the same loading and
comparison path for both presentations. Native sequence comparisons remain
atomic; this work does not add element-level resource matching or a reloadable
patch format.
For failure investigation, retain LoadError.Sources() and Diagnostics() as
evidence alongside the error. The current adapters and config sources failure
path need changes, not just another renderer. Define an acquisition shape that
distinguishes unavailable evidence from an available empty inventory. A failed
load does not establish an effective configuration or metadata capability.
Render available evidence through normal invocation reporting before terminal
failure presentation. Keep the original load error and supported identity;
successful report delivery must not convert failure to success. Preserve
render/write failures separately through the current outcome machinery. Cover
cancellation with partial evidence explicitly without promising interruption of
an arbitrary writer or rollback of already-delivered bytes. OD-6 selects
config validate --details; its interaction with ordinary diagnostic messages
remains a presentation design task.
Structured records describe that validation invocation, including a failed
load; they are not a retrieval interface for an earlier command. Preserve the
current aggregate validation stopping behavior unless deliberately revised;
structured reporting alone does not promise exhaustive findings across scopes.
Additional ConfigKit operator workflows
Focused effective display. Use the effective snapshot from native
Explain(path) for path-selected display. The ordinary whole-document path
continues to use WriteEffective. A historical-only path can be explainable
while lacking an effective value; distinguish that case from a present YAML
null. Select the missing-value behavior, provider availability, and aggregate
scope applicability under OD-8. Do not read mutable Result.Config or source
files to reconstruct inspection values.
Source selection and report filters. Select source IDs from the acquired
inventory, preserving existing record fields and upstream ordering. Native
Source(id) is a convenience, not an additional provider requirement. IDs are
local to a load and do not guarantee the same source in a later acquisition.
Apply subtree filtering to parsed configuration paths, not raw string prefixes
that would confuse /server with /server2. Specify explicitness filtering for
historical-only paths without treating unavailable effective metadata as false.
Diagnostic filters affect the presented records, not the underlying acquisition
outcome; retain the source references needed to interpret selected records.
Independent comparison selections. Extend the per-side typed-input design in ADR 0012. Capture applicable selector bindings for each side, prepare and check both inputs before comparison, and preserve the existing shared invocation state. Resolve omitted right selectors, explicit empty values, repeated selectors, and flag-name collisions under OD-9. Domain interpretation and loader caching remain with the application; the comparison provider still receives two selections.
Comparison assertions. Base a difference outcome on native record presence, including hidden changes whose redacted snapshots look equal. Equal effective values can have different histories or explicitness. Comparison also does not detect changed credential bytes behind an unchanged secret reference. Use the agreed opt-in outcome and report-delivery behavior under OD-10; retain the current ordinary diff outcome. A load or comparison failure is not evidence of equality.
Transient overrides. As agreed in OD-11, parse explicitly supplied
CLI values into native Override records and pass them through a declared loader
capability. ConfigKit owns override path validity, supported values, precedence,
decoding, resolution, provenance, and validation. Its configuration overrides
recursively overlay mappings and replace sequences; this differs from the
PromptKit execution override's complete provider-map replacement. Do not reuse
one grammar implementation in a way that erases that distinction. Source-load
errors remain errors even if an override would replace the affected value.
Initial report implementation approach
Use the accepted OD-4 through OD-6 flags and formats as a practical starting point. Keep added code, report types, and translations proportionate. Beta feedback on actual reports should guide changes; do not delay implementation for speculative layout options or build a report framework in anticipation of future formats.
The repository already uses go.yaml.in/yaml/v4 and small Go-value-to-YAML
writers in core and both integrations. Centralize common encoder configuration
and reusable output helpers where practical. A small shared writer accepting an
io.Writer and a Go report value is sufficient; exact placement and exported
API, if needed across module boundaries, are implementation choices. Keep any
core helper independent of ConfigKit and PromptKit types. A separately versioned
output module or custom serialization engine is not needed. Account for module
release/dependency ordering under OD-7 if a shared public core helper is added.
Prefer directly encoding suitable native inspection/report values or a thin Go projection with serialization tags. Do not mirror a whole upstream object graph just to rename fields or rearrange equivalent data. Reuse small path, snapshot, location, and duration projections where they are genuinely needed. Types whose intended representation depends on JSON tags or custom JSON serialization cannot be assumed to encode identically under YAML; reuse their supported serialization or provide a small explicit adapter rather than inventing a reflection framework.
Exceptions serve concrete report semantics: preserving absent/null/false/zero and empty collections, expressing paths and durations readably, projecting safe snapshot values, and retaining native redaction. Encode report/inspection values, not engines, mutable runtime configuration, or request credential storage. Reuse native writers where their output already serves the selected report. Keep the existing concise diff and validation presentations; the simpler YAML approach applies to detailed reports and other suitable projections.
Separate content projection from YAML encoding and from invocation delivery. Use the existing Reporter and outcome lifecycle for delivery and failures. Share common helpers without forcing text output through a YAML round trip or forcing semantically different reports into one schema. Validate representative reports and meaningful adaptation boundaries, rather than freezing every incidental formatting detail in tests.
Work sequence
- Confirm remaining implementation choices. Use the accepted flags and report formats as the MVP target. Resolve outstanding acquisition/binding grammar and flag collisions; use concrete examples to review report details during implementation rather than reopening accepted scope.
- Adopt v0.19.0. Update
integrations/ckprompt/go.modandgo.sum, then module attribution against the released notices and source commit. Update the unpublished candidate note and affected canonical dependency/compatibility guidance. No core Go-minimum increase follows from this adoption. - Implement request inspection and selection. Add preview, literal-text
input and renamed file-input flags, applicable override flags,
provider-parameter input, and namespace selectors. Implement
public
ckpromptexecution-flag collections on existing core bindings and reuse them in the standard commands. Generate scoped convenience aliases and provide a collection for installing the commands and routing declarations. Reuse the standard suite's lifecycle and preserve existing application adapter seams. - Implement shared configuration inspection. Add discovery and metadata
within
config explain, structured diagnostics viaconfig validate --details, detailed diff presentation, and source evidence on failure inckconfig. Retain the six-command suite and wire native PromptKit facets throughConfigScope. Add focused effective display, source selection, and bounded metadata/diagnostic filters using those evidence capabilities. Extend typed comparison selection and add the agreed assertion outcome. Implement explicit override acquisition and comparison-side wiring under OD-11 as a separate reviewable unit. Reuse and centralize output helpers under the initial report implementation approach. Keep boundary coverage with each change. - Update operator and consumer documentation. The CLI reference owns syntax, report schemas, availability, and outcomes; GoDoc owns callback and value contracts. Extend maintained simple/composed examples to demonstrate the new CLI tasks using local fixtures, without adding application-internal execution helpers. Record intentional compatibility effects in module notes.
- Align module dependencies and validate. Prepare the
ckconfigrelease needed byckprompt, update the latter's dependency/checksums, and complete the validation below. OD-7 addresses the interim development dependency. Publication and hosted delivery remain separate actions under the release procedure.
Validation and completion checklist
Select focused boundary tests under the testing policy. The checklist concerns adapter/CLI behavior; it does not ask CommandKit to retest PromptKit rendering, schema, namespace, or ConfigKit resolution algorithms. Default tests remain offline and independent of real credentials.
- Dependency, checksums, attribution commit links, and candidate notes match the final selected module versions.
- All three compatibility changes and corrected credential wording are documented, with earlier v0.18.0 migration guidance retained where relevant.
- The authentication response-limit reason survives report projection with native unknown facts. Smoke preparation errors retain supported causes and operational outcomes, including the no-report case; no model dispatch is introduced by CommandKit to handle them.
promptkit show prepared PROMPT_IDforwards the intended request and faithfully reports native fields in YAML, the only initial output format. Help identifies the argument as a prompt ID and explains resource I/O and rendered content disclosure. Its CLI path makes no model call and does not create/execute retained prepared handles.- New flags preserve selected omission/empty/zero semantics, parse malformed inputs through the existing usage path, and do not leak state between runs. Numeric decoding of provider JSON matches the selected strategy in OD-2.
- The same public execution-flag collection works in a standard subcommand and an application-owned command with its own typed input. Parsing, presence, metadata, and selected subsets remain consistent; omitted retry values retain the applicable native defaults. Application execution behavior remains outside the collection.
- Canonical
--llm-flags and scoped convenience aliases follow OD-2. Alias generation covers only enabled commands and applicable flags, shares canonical binding/presence behavior, and preserves mixed-spelling occurrence order. Generic spellings remain available to unrelated application commands. - The convenient installation collection includes commands and their scoped aliases; canonical-only installation remains available. Help and migration guidance explain both forms without requiring consumer-maintained alias lists.
- Text and file input names and aliases follow OD-2. Literal content, including empty text, reaches native inline inputs; file bindings remain file references. Examples, help, and documentation use the selected meanings. Verify that the last command-line occurrence for a name wins across text/file forms and all aliases, preserving actual occurrence order.
- Output-contract override and appended-message flags remain outside this adoption, with their operator use cases retained in future work.
- Opt-in namespace selectors combine declared suite defaults with supplied fields in one native view update. Omission preserves each declared default; explicit empty values clear only the selected default. Qualified selections and catalog filters retain their native meanings. Custom scoped loaders remain usable without the option. Canonical namespace names and scoped aliases match OD-3, with an explicit applicability table.
- The full configuration suite retains six subcommands. Explanation discovery and validation diagnostics are modes of existing commands, with capability-aware help and selected mode/flag combination checks.
- Bare
config explaindisplays help successfully, presenting--listand--pathas the two alternatives. Selecting both modes is a usage error; explicitly supplied--path ""selects root explanation rather than help. - Discovery uses text by default with YAML available, compact path/presence/
explicitness fields, and the selected
--historical,--under, and--explicitbehavior. Historical-only paths and unavailable discovery are not misreported as current implicit values or an empty configuration. - Metadata discovery through
config explaindistinguishes effective and historical paths, retains available history on absent lookup, and projects native field/change records. - Default
config diffretains its concise additions/changes/deletions report. Optional--detailsuses the same comparison records to present both snapshots and presence/redaction/hidden-change evidence. Cover additions, deletions, explicit null, empty comparisons, sequence-level changes, and report-delivery failures without extra configuration loads or comparisons. Detailed YAML uses one before/after entry per path and an explicit empty list when there are no differences. - Focused display preserves native snapshot content and distinguishes missing/historical-only paths from explicit null. Whole-document display retains its current contract. Focused display uses one scope and native YAML without a snapshot wrapper; absent effective paths and unknown source IDs produce clear operational failures.
- Source-ID selection works on successful and failed acquisitions. Path, explicitness, severity, and code filters preserve the selected evidence and source references without masking the acquisition outcome.
- Independent comparison selectors preserve the chosen inheritance and repeatable-value rules, side-specific checks, and shared-state lifecycle. Explicit empty right-side collection selection is designed and covered.
- Assertion mode distinguishes equality, native differences (including
hidden changes), usage errors, and operational failures with statuses
0,3,2, and1respectively, without changing ordinary diff outcomes. Report-delivery failures remain observable. - Only supplied CLI overrides reach opted-in loaders under OD-11, with typed values and safe flag labels, selected comparison-side behavior, native errors, and returned provenance preserved. No tests independently re-establish ConfigKit override semantics.
- Default validation remains concise;
--detailsselects the additional diagnostic report, with text by default and optional YAML. Selecting YAML alone does not enable detailed mode. Severity/code filters, evidence availability, no-match presentation, and known duplicate-warning handling preserve the underlying validation outcome. config sourcesandconfig validate --detailsreport available evidence with an acquisition error; the original failure, unavailable-versus-empty evidence, cancellation, and report-delivery failures remain distinguishable.- Existing providers remain usable; help, version, and capability discovery do not start acquisition. New operation/flag metadata and static completion match the implemented surface.
- Maintained consumer examples demonstrate the selected CLI tasks and the configuration failure workflow with deterministic local evidence, including collection reuse by an application-owned command.
- Suitable reports use direct Go-value serialization or thin projections, sharing YAML and common output helpers where practical. Necessary adapters preserve native meaning without a generic report translation framework.
- Canonical documentation, module release notes, and roadmap links agree with the implemented boundary. Open decisions are resolved or deliberately superseded before the corresponding behavior is claimed complete.
- Final independent-module and aligned-workspace suites pass, with the dependency identities used by each recorded.
With the documented Go 1.27.0 toolchain selected, run
GOWORK=off GOTOOLCHAIN=local go test ./... independently in the root,
integrations/ckconfig, and integrations/ckprompt. Prepare dependencies before
offline execution as described in the release procedure.
Then validate the aligned workspace from the root with:
GOTOOLCHAIN=local go test ./...
GOTOOLCHAIN=local go test ./integrations/ckconfig/...
GOTOOLCHAIN=local go test ./integrations/ckprompt/...
Use the development guide for toolchain/workspace setup and documentation checks. Reuse successful checks for unchanged content; these adoption checks do not add permanent publication gates. The earlier disposable dependency-only compatibility test is preliminary evidence, not completion evidence for these features.
Deferred work
Focused backend inspection remains in future work until a released upstream API supports it. Do not reconstruct backend selection from configuration to deliver it in this roadmap. General execution, prepared handle lifecycle, sessions, and observer convenience APIs remain application responsibilities. Persistent configuration editing, new live probes, dynamic completion, JSON report formats, and unrelated deferred proposals are not added by this roadmap. Transient acquisition overrides are included under OD-11. Output-contract override and appended-message flags are deferred under OD-2 and retained in future work. Discovery tracing and secrets-directory bootstrap commands remain deferred: the source inventory is not a trace of rejected search candidates, and bootstrap performs application startup effects.
Open Decisions
These decisions concern significant choices within the proposed scope. Resolved items retain their numbers and record the agreed decision. OD numbers are local to this roadmap, not the retired adoption documents.
OD-1: Preview command and report presentation
Agreed: use promptkit show prepared PROMPT_ID, with YAML-only output
initially and the complete relevant PreparedRun projection. The argument names
the prompt to prepare, not a saved prepared object. A single native preparation
supplies both validation and preview evidence.
The command sits beside definition inspection and emphasizes that the report contains resolved settings and rendered content. Use help wording such as: "Prepare a prompt request and show the resulting messages and settings without calling the model."
Document resource I/O and rendered content disclosure directly in help and CLI guidance. The report is an inspection snapshot, not a saved execution handle or a guarantee that later execution uses the same snapshot or succeeds. A separate text presentation may be considered later; it is outside the initial scope.
OD-2: Request controls and provider-parameter grammar
Agreed: execution flags are public reusable CLI collections owned by
ckprompt, available to standard and application-owned commands using existing
core APIs. Give validation and preview the applicable execution controls already
on smoke tests, and add a singleton --llm-extra-params JSON object option to
all three. Use native whole-map replacement, including native behavior for
empty maps. Specify JSON number decoding deliberately so supported values reach
PromptKit without accidental precision loss or new numeric guarantees. The
single-object form is selected over repeated key assignments.
Retain the authoritative-builder rule: standard flags seed a request, and an application builder can return its complete replacement. Do not reapply CLI values after the builder returns.
Agreed naming and aliases: use --llm- canonical names throughout the
reusable request-control family. Standard promptkit commands also accept the
unprefixed convenience spellings wherever the corresponding flag applies.
Application-owned commands receive canonical names from the reusable collections;
applications may deliberately install convenience aliases on their own commands.
| Canonical flag | Convenience alias within applicable promptkit commands |
|---|---|
--llm-endpoint |
--endpoint |
--llm-model |
--model |
--llm-temperature |
--temperature |
--llm-max-tokens |
--max-tokens |
--llm-top-p |
--top-p |
--llm-timeout-seconds |
--timeout-seconds |
--llm-service-tier |
--service-tier |
--llm-reasoning-effort |
--reasoning-effort |
--llm-api-key-env |
--api-key-env |
--llm-transient-retries |
--transient-retries |
--llm-extra-params |
--extra-params |
--llm-backend |
--backend |
--llm-profile |
--profile |
--llm-prompt |
--prompt |
--llm-session-id |
--session-id |
--llm-var |
--var |
--llm-input-text NAME=TEXT |
--input-text, --llm-input, --input |
--llm-input-file NAME=PATH |
--input-file |
Retain existing value syntax and units, including integer timeout seconds. The input naming and content changes are specified below. Commands taking a positional prompt ID retain that argument; this naming decision does not add a redundant prompt flag. Execution, resource-selection, and request-input collections may remain separately composable. Namespace controls remain subject to OD-3.
Agreed assembly approach: keep alias generation in ckprompt; no core
upgrade is required. Define each flag-to-alias relationship once and generate
existing FlagAliasFor routing declarations from the flags selected for each
enabled canonical command. Do not maintain a separate hand-written matrix of
all command/flag combinations. Aliases target the original flag binding rather
than introducing duplicate bindings. Both spellings retain core parsing,
presence, and occurrence-order behavior.
Offer a convenient collection containing the command family and its scoped
routing declarations, using existing []commandkit.Declaration installation.
Keep ckprompt.Command(suite) available for canonical commands without the
convenience aliases. Exact helper names remain implementation choices. Generate
aliases only for enabled commands and applicable flags; do not install
application-wide aliases or make consumers reproduce the command/flag matrix.
Applications can install selected aliases on their own commands through the
existing core API. Subtree alias scopes and a new core declaration-bundle type
are not part of this adoption.
Help should identify canonical names and their applicable aliases using current core presentation. CommandKit is alpha with no consumers; redesign without compatibility constraints is explicitly accepted for these flags. Update implementation, examples, help, and documentation together; do not retain old meanings merely for compatibility. Canonical-only installation does not supply convenience aliases.
Agreed input forms: include literal text alongside file input for
promptkit requirements validate and promptkit show prepared. The concrete
operator task is preparing one selected prompt with a short, disposable sample
without creating a fixture file. File inputs remain useful for substantial
content and repeatable artifacts. These operations make no model call and do
not establish model-output quality or application-workflow success. Assess
usefulness within these standard commands; speculative applicability to
multi-prompt application workflows is not a reason to add flags.
Use the explicit canonical pair --llm-input-text NAME=TEXT and
--llm-input-file NAME=PATH. The scoped aliases in the table include both
--input and --llm-input for literal text. They route to the original text
binding with the same parsing, presence, and occurrence-order behavior.
--input no longer means a file path; file bindings use the explicit file form.
Do not infer file access from literal content that resembles a path.
Provide repeatable named bindings, splitting at the first = and preserving
literal content, including explicit empty text, through native Inline inputs.
File bindings continue to use native File references. Keep the canonical
forms available through reusable request-input collections; application commands
choose whether these bindings fit their workflow and may opt into aliases.
None of these aliases is application-wide by default. Do not add prompt-input
flags to smoke tests, which use their own diagnostic content.
Agreed input precedence: the last command-line occurrence for a given input name wins across text and file bindings, including every alias. Implementation must preserve actual occurrence order rather than applying one flag collection after the other in a fixed order. Select the necessary binding composition during implementation; do not claim this behavior from independent flag binding alone.
Deferred output-contract overrides: no CLI override is included in this adoption. Retain the candidate in future work; existing configuration and application builders remain available.
Deferred appended-message flags: no CLI message-appending option is included in this adoption. The potential standard-command task is reproducing a request with application-added messages for preparation validation or preview. Revisit when that is a demonstrated operator requirement; ordinary named inputs remain available for inspecting prompt definitions with concrete content. Retain the candidate in future work. No message-file format, flag syntax, or role-selection interface is selected. Native application-supplied appended messages remain part of prepared-request inspection; deferring flags does not remove that report evidence. No general-purpose request-building API follows from these CLI choices.
OD-3: Namespace flags and loader defaults
Agreed: make the standard namespace selectors opt-in with explicit
application-supplied defaults for prompts, profiles, and backends in the suite.
ckprompt combines those defaults with the supplied CLI fields, then applies
one native WithNamespaces call. Loaders using this option leave namespace
default selection to that adapter rather than relying on hidden engine-view
state. Without the option, existing scoped loaders continue as before.
Omitting a selector preserves its declared default. Supplying a namespace replaces that default for the invocation; supplying an explicitly empty value clears it. Each resource type is independent. For example, overriding the prompt namespace must preserve the declared profile and backend defaults. Qualified resource IDs pass through unchanged. Catalog namespace filters remain separate from these resource-resolution defaults.
The standard option owns composition instead of requiring an application callback to merge every selection. Applications needing custom namespace selection can retain their own loading behavior without enabling the option.
Agreed names:
| Canonical selector | Scoped alias within applicable promptkit commands |
|---|---|
--llm-prompt-namespace |
--prompt-namespace |
--llm-profile-namespace |
--profile-namespace |
--llm-backend-namespace |
--backend-namespace |
Keep catalog --namespace filtering separate. Applicability to individual
commands and exact public helper signatures remain design tasks; install only
selectors with a defined use for that operation.
OD-4: Configuration path and metadata presentation
Agreed placement: path discovery is part of config explain; no separate
path or metadata command will be added in this roadmap.
Agreed mode selection: bare config explain displays command help as a
successful help request. Help explains that an operation requires either
--list to discover paths or --path POINTER to explain a selected path. This
makes both capabilities visible instead of implicitly choosing discovery.
- Neither mode selected: show help, with success on successful help delivery.
--listselected: discover configuration paths.--pathsupplied: explain that path.- Both modes selected: report a usage error.
Track path presence separately from its value: explicit --path "" selects
the root explanation, not help. This deliberately replaces the current
missing-path usage error; automatic discovery on a bare invocation is not
selected.
Agreed initial presentation: use a compact text discovery report by default,
with YAML available through --format yaml, and one scope at a time. List
current effective paths by default; --historical adds historical-only paths
rather than selecting only removed paths. Show path, current/historical-only
presence, and available explicitness. Do not equate non-explicit values with
application defaults or historical-only metadata with explicitness false.
Use --under POINTER to narrow listing to a subtree and
--explicit=true|false to select current explicitness. Omitting explicitness
filtering includes both states and, when requested, historical-only entries;
historical-only entries do not match either current explicitness value. Apply
subtree filtering to parsed paths, not textual prefixes. These filters and
--historical belong to listing mode; --path continues to select detailed
explanation, including its available metadata and history.
Keep values and change history out of the compact listing. Include useful field metadata in detailed explanation without repeating existing evidence. If a provider cannot supply discovery metadata, report that capability as unavailable rather than presenting an empty configuration; its existing path-specific explanation remains usable. These are sufficient starting choices for the MVP; exact field layout and mode-specific error wording can be decided in code and reviewed with concrete examples.
OD-5: Detailed comparison selection and shape
Agreed: retain the existing concise additions/changes/deletions report as
the default for config diff, and add optional --details for investigating
changes. The default serves human operators who need a quick overview; retaining
it is a presentation choice, not a compatibility constraint.
The detailed mode should help an operator compare old and new values, distinguish absence from explicit null, and understand concealed changes even when the displayed safe snapshots look equal. Present native paths, left/right snapshots, presence, redaction, and hidden-change evidence in readable YAML.
Agreed initial layout: one entry per changed path in a scope-labeled YAML report, with before/after snapshots rather than expanded versions of the three summary categories. Display snapshot values as YAML values, preserving explicit presence so missing and null remain distinct. Show redaction and concealed-change annotations where relevant; omission of an optional annotation has a defined meaning and never relies on recognizing a marker-looking string. Prefer ordinary Go fields and serialization tags to custom omission logic. An empty comparison has an explicit empty difference list. YAML is the only initial detailed format.
Keep the projection close to native report values, using the shared reporting approach rather than extensive translation for cosmetic layout. Exact field names are implementation choices for the initial release and can evolve with beta feedback.
Keep implementation localized to flag selection and a second report writer,
with focused boundary tests, help, and examples. The existing Scope.Compare
contract and both native adapters already return the required difference
records. Reuse that data and existing safe-snapshot decoding; no new comparison
callback, additional load, or comparison algorithm is required. A shared YAML
output helper may be used, but detailed comparison needs no domain-specific core
API. A side-by-side terminal display is not part of this adoption. Comparison
exit status follows OD-10.
OD-6: Failure evidence and structured diagnostic delivery
Agreed placement: structured configuration diagnostics are part of
config validate; there will be no separate diagnostics command. Source
inventory on failure remains part of config sources.
Agreed: add config validate --details, consistent with the optional detail
mode on config diff. Retain concise validation by default, including its
ordinary warning and error reporting. Detailed mode reports available native
diagnostic records and source references alongside the validation result. The
purpose is to help a human operator locate and investigate configuration
problems; it does not introduce new validation rules. Selecting YAML alone does
not implicitly enable the additional detail.
Preserve available evidence when loading fails: config validate --details
reports diagnostic findings and relevant source references, and config sources
reports acquired source inventory. These describe the current invocation, not a
previous failed command. Keep the original failure and its supported cause
identity; successfully displaying evidence must not turn failure into success.
A failed load does not imply an effective configuration is available.
Build optional ckconfig evidence facets that can accompany an acquisition
error. Unlike detailed comparison, the existing adapters need to carry additional
structured evidence through to reporting. Use current core reporting and outcome
handling; no generic cross-family diagnostics framework is required.
Agreed initial presentation: detailed validation uses text by default, with
YAML available through --format yaml. Begin text output with scope and outcome,
then show readable findings with their available messages, severities, codes,
configuration paths, and source locations. Place useful locations near messages;
YAML may use a source legend shared by multiple findings.
Use repeatable --severity and --code filters in detailed mode. Multiple values
within a filter match any selected value; different filters narrow results
together. Filtering never changes the validation outcome. Distinguish no native
findings, no findings matching the filters, and unavailable structured evidence.
Keep referenced sources needed to interpret selected findings.
Avoid presenting a finding both in the detailed report and as a duplicate ordinary warning when the records have a known relationship. Do not deduplicate by guessing from message text. Preserve unrelated messages and the terminal failure explanation. Keep this coordination within the integration rather than introducing a general diagnostics framework.
Structured results use the result stream and ordinary messages use the diagnostic stream. Preserve report-delivery failures separately from the original operation failure through existing outcome handling. Retain current aggregate stopping behavior; detailed output does not promise exhaustive validation across all scopes. Partial-evidence and cancellation presentation should use the same simple report values and existing reporting lifecycle, with exact layout refined during implementation and practical testing.
OD-7: Module release and interim workspace coordination
Agreed: complete the planned integration work together rather than splitting out a dependency-only PromptKit release. With no current consumers, an early compatibility release has no demonstrated benefit. Prepare a new ckconfig minor release for the shared API/CLI features, then update the still-unpublished ckprompt candidate to require that released version. Confirm candidate status and available versions under the release procedure before choosing versions.
Use the ignored aligned workspace during joint development. Workspace success does not establish independent ckprompt correctness with its old ckconfig requirement. Before final independent validation, pin the released ckconfig version supplying the APIs and validate both independent modules and the aligned workspace. Release ckconfig before ckprompt. Publication remains a separate action requiring authorization; this decision does not authorize publication.
OD-8: Focused configuration reports and filtering
Agreed: add config show --path POINTER and
config sources --source-id ID; add subtree/explicitness filters to
config explain --list and severity/code filters to config validate --details.
Keep reports unfiltered by default. The purpose is to reduce noise for a human
operator investigating a known part of the configuration.
Focused show emits the selected native effective YAML directly, without a
snapshot wrapper containing presence/redaction/YAML fields. Use the existing
explanation capability to obtain the native snapshot. An absent effective path
or unknown source ID produces a clear operational failure. Explicitly present
null remains a valid value; historical-only paths are not effective values.
Path-selected display initially uses one scope, while whole-document
--scope all remains available.
Filters change presentation, not validation outcomes. Keep source references needed to interpret the selected findings. Apply subtree filtering to parsed paths; distinguish unavailable current metadata on historical-only paths from an effective value that was not explicitly supplied.
Selected filter grammar: OD-4 records discovery filters and OD-6 records diagnostic filters. Exact report field layout and remaining edge-case messages are implementation choices for the MVP. No additional snapshot-wrapper report or aggregate path-selected display is selected for this adoption.
OD-9: Independent comparison selector bindings
Agreed: applications declare which domain selectors support right-side
comparison values, with explicit metadata for their --against-* spellings.
Do not generate comparison flags for every application option automatically.
Omission inherits the left value and presence; an explicit right value replaces
it. For repeatable selectors, the supplied right collection replaces the
inherited collection rather than appending to it. This supports comparisons
such as two campaigns without requiring different files or repeating every
unchanged selection.
Domain parsing stays in the declared typed bindings; no generic selector language is introduced. Review the refinement of ADR 0012 and flag collision handling before implementation. Exact helper signatures and an explicit way to select an empty right-side collection remain open. An empty string element is not necessarily an empty collection; do not equate them implicitly.
OD-10: Comparison assertion outcomes
Agreed: add opt-in --check, retaining normal report delivery and ordinary
diff behavior when omitted. Under assertion mode, use status 0 for equality,
3 for differences, 2 for usage errors, and 1 for operational failures.
This distinguishes a successful comparison that found differences from a
comparison that could not run. Ordinary diff remains successful when it finds
differences.
Base the difference outcome on native records, including concealed changes, not equality of the displayed safe values. Apply existing reporting outcome rules, including preservation of a nonzero domain outcome when presentation also fails; callers can inspect the separate presentation evidence. Document and test that interaction explicitly. These are selected future behaviors, not claims about the currently implemented CLI.
OD-11: Transient configuration overrides
Agreed scope: include a declared, opt-in override capability for standard
configuration commands, with repeatable --set POINTER=JSON values passed to
application acquisition as native ConfigKit overrides. This enables validation,
inspection, and comparison of temporary settings through consistent CLI syntax.
Providers that do not accept overrides retain their existing operations. No
source file is edited, and no general application-internal convenience API is
required. The loader contract must state how it combines these records with
any existing application-owned overrides; the generic adapter cannot inject
them into an arbitrary loader after the load has completed.
Prefer inline assignments for ordinary one-value experiments. This is the largest remaining loader integration design item; revisit scope explicitly if the required acquisition changes prove disproportionate rather than silently dropping the agreed feature. Settle these details before implementation:
- Split at the first
=; JSON supplies typed null, boolean, string, numeric, array, and object values. Specify numeric conversion to ConfigKit-supported built-in forms rather than passingjson.Numberor silently promising arbitrary numeric precision. An unambiguous alternate input form may be needed for pointer keys containing=. - Forward explicit records only, with safe display labels such as
--set, never raw value-bearing arguments as provenance labels. Preserve native duplicate/overlap handling rather than silently collapsing assignments. - Follow the released mapping-path constraints, including root/index and schema-version restrictions, without extending them into a generic patch language. Empty, false, zero, and null remain intentional supplied values.
- For comparison, recommend
--setas the shared baseline and--against-setas a right-side replacement list when supplied, following OD-9's agreed repeatable-selector rule. Define an explicit way to select an empty right list before finalizing this grammar; appending or replacing individual paths would need a different selected rule. - Reflect native CLI origins and subsequent resolution in existing reports. Test CommandKit parsing, forwarding, and outcome/report adaptation, leaving ConfigKit's override algorithm to its own tests.
A structured override file is not selected as the primary interface: it handles complex values and unusual keys well but adds file setup to ordinary one-value experiments. It remains a possible supplemental form if needed to resolve the open grammar cases. Application-specific typed flags remain available, but are not a substitute for the selected standard CLI capability. No persistent configuration mutation is authorized by this decision.