stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 16 Releases Wiki Activity
Files
c34fb7256d021860877dcf718ab7352fc171d441
git.stella-ops.org/scripts/bench
History
StellaOps Bot c34fb7256d
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
Details
AOC Guard CI / aoc-verify (push) Has been cancelled
Details
AOC Guard CI / aoc-guard (push) Has been cancelled
Details
Policy Lint & Smoke / policy-lint (push) Has been cancelled
Details
SDK Publish & Sign / sdk-publish (push) Has been cancelled
Details
sdk-generator-smoke / sdk-smoke (push) Has been cancelled
Details
up
2025-11-27 08:51:10 +02:00
..
determinism-run.sh
up
2025-11-27 08:51:10 +02:00
README.md
up
2025-11-27 08:51:10 +02:00

README.md

Bench scripts

  • determinism-run.sh: runs BENCH-DETERMINISM-401-057 harness (src/Bench/StellaOps.Bench/Determinism), writes artifacts to out/bench-determinism, and enforces threshold via BENCH_DETERMINISM_THRESHOLD (default 0.95). Defaults to 10 runs per scanner/SBOM pair. Pass DET_EXTRA_INPUTS (space-separated globs) to include frozen feeds in inputs.sha256; DET_RUN_EXTRA_ARGS to forward extra args to the harness; DET_REACH_GRAPHS/DET_REACH_RUNTIME to hash reachability datasets and emit dataset.sha256 + results-reach.*.

Usage:

BENCH_DETERMINISM_THRESHOLD=0.97 \
DET_EXTRA_INPUTS="offline/feeds/*.tar.gz" \
DET_REACH_GRAPHS="offline/reachability/graphs/*.json" \
DET_REACH_RUNTIME="offline/reachability/runtime/*.ndjson" \
scripts/bench/determinism-run.sh