git.stella-ops.org/docs/qa/feature-checks/runs/cli/cli-e2e-tests/batch-c-results.md

CLI E2E Test Results -- Batch C

Date: 2026-02-15T22:49Z Runner: cli-batch-c agent CLI Project: src/Cli/StellaOps.Cli/StellaOps.Cli.csproj Configuration: Release (pre-built, --no-build) Note: All commands exhibit ~4s SM remote probe timeout on startup (expected, no SM service running).

Summary

• Commands tested: 20
• All --help pass: 20/20
• Behavioral tests attempted: 3 (trust-profile list, offline status, sdk list)
• Behavioral tests passed: 2/3 (sdk list requires backend URL -- expected)
• Crashes/hangs: 0
• Total subcommands discovered: 98

Top-Level Command Results

#	Command	Description	Subcommands	--help OK	Exit Code	Notes
1	sbomer	SBOM composition	layer, compose, composition, drift	Yes	0	4 subcommands
2	cvss	CVSS v4.0 receipt operations	score, show, history, export	Yes	0	4 subcommands
3	risk	Manage risk profiles	profile, simulate, results, bundle	Yes	0	4 subcommands
4	graph	Call graph evidence	explain, lineage, verify, bundles	Yes	0	4 subcommands
5	deltasig	Binary delta signature operations	extract, author, sign, verify, match, pack, inspect	Yes	0	7 subcommands
6	binary	Binary reachability analysis	submit, info, symbols, verify, inspect, lookup, fingerprint, callgraph, ops, delta-sig, diff	Yes	0	11 subcommands
7	api	API management	spec	Yes	0	1 subcommand
8	sdk	SDK management	update, list	Yes	0	2 subcommands
9	mirror	Air-gap mirror bundles	create	Yes	0	1 subcommand
10	airgap	Air-gapped environment ops	import, seal, export-evidence	Yes	0	3 subcommands
11	trust-profile	Manage trust profiles	list, show, apply	Yes	0	3 subcommands
12	offline	Air-gap and offline kit ops	import, status	Yes	0	2 subcommands
13	verify	Unified verification	offline, image, bundle, release, attestation, vex, patch, sbom	Yes	0	8 subcommands
14	devportal	DevPortal offline ops	verify	Yes	0	1 subcommand
15	symbols	Symbol bundles management	bundle, verify, extract, inspect	Yes	0	4 subcommands
16	system	System operations	migrations-run, migrations-status, migrations-verify	Yes	0	3 subcommands
17	score	Score computation and replay	replay, bundle, verify, explain	Yes	0	4 subcommands
18	unknowns	Unknowns registry operations	list, escalate, resolve, budget, summary, show, proof, export, triage	Yes	0	9 subcommands
19	proof	Proof chain verification	verify, spine	Yes	0	2 subcommands
20	chain	Attestation chain traversal	show, verify, graph, layer	Yes	0	4 subcommands

Subcommand --help Verification

Parent	Subcommand	--help OK	Exit Code	Notes
sbomer	layer	Yes	0	Sub-subs: list, show, verify
sbomer	layer list	Yes (implied)	0	--
trust-profile	list	Yes	0	Options: --profiles-dir, -f/--format, -v/--verbose
offline	status	Yes	0	Options: --tenant, -o/--output, -v/--verbose
sdk	list	Yes	0	Options: -t/--tenant, -l/--language, --json, -v/--verbose
system	migrations-status	Yes	0	Options: --module, --connection
binary	inspect	Yes	0	Args: file. Options: -f/--format, -v/--verbose
unknowns	summary	Yes	0	Options: -f/--format, -v/--verbose

Behavioral Test Results

Command	Invocation	Exit Code	Result	Output Summary
trust-profile	trust-profile list	0	PASS	Listed 4 profiles: bg-gov, eu-eidas, global, us-fips. Formatted table output.
offline	offline status	0	PASS	Reported "No active offline kit." for default tenant.
sdk	sdk list	1	EXPECTED FAIL	"Backend URL is not configured. Provide STELLAOPS_BACKEND_URL or configure appsettings." -- requires running backend.

Observations

1. All 20 commands register and respond to --help correctly with exit code 0.
2. 98 total subcommands discovered across 20 parent commands. binary has the most (11), followed by unknowns (9) and verify (8).
3. No crashes, hangs, or unhandled exceptions. All commands handle missing backend/data gracefully.
4. SM remote probe timeout (~4s) occurs on every invocation -- expected behavior when SM remote service is not running.
5. trust-profile list works fully offline, reading from etc/trust-profiles/ directory.
6. offline status works fully offline, reporting no active kit.
7. sdk list correctly requires backend URL configuration -- proper error message and exit code 1.
8. Plugin system reports no CLI plugins discovered (expected for dev environment).