c34fb7256d
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
AOC Guard CI / aoc-verify (push) Has been cancelled
AOC Guard CI / aoc-guard (push) Has been cancelled
Policy Lint & Smoke / policy-lint (push) Has been cancelled
SDK Publish & Sign / sdk-publish (push) Has been cancelled
sdk-generator-smoke / sdk-smoke (push) Has been cancelled
13 lines
797 B
Markdown
13 lines
797 B
Markdown
# Bench scripts
|
|
|
|
- `determinism-run.sh`: runs BENCH-DETERMINISM-401-057 harness (`src/Bench/StellaOps.Bench/Determinism`), writes artifacts to `out/bench-determinism`, and enforces threshold via `BENCH_DETERMINISM_THRESHOLD` (default 0.95). Defaults to 10 runs per scanner/SBOM pair. Pass `DET_EXTRA_INPUTS` (space-separated globs) to include frozen feeds in `inputs.sha256`; `DET_RUN_EXTRA_ARGS` to forward extra args to the harness; `DET_REACH_GRAPHS`/`DET_REACH_RUNTIME` to hash reachability datasets and emit `dataset.sha256` + `results-reach.*`.
|
|
|
|
Usage:
|
|
```sh
|
|
BENCH_DETERMINISM_THRESHOLD=0.97 \
|
|
DET_EXTRA_INPUTS="offline/feeds/*.tar.gz" \
|
|
DET_REACH_GRAPHS="offline/reachability/graphs/*.json" \
|
|
DET_REACH_RUNTIME="offline/reachability/runtime/*.ndjson" \
|
|
scripts/bench/determinism-run.sh
|
|
```
|