efaf3cb789
Some checks failed
Signals CI & Image / signals-ci (push) Has been cancelled
Signals Reachability Scoring & Events / reachability-smoke (push) Has been cancelled
Signals Reachability Scoring & Events / sign-and-upload (push) Has been cancelled
Manifest Integrity / Validate Schema Integrity (push) Has been cancelled
Manifest Integrity / Validate Contract Documents (push) Has been cancelled
Manifest Integrity / Validate Pack Fixtures (push) Has been cancelled
Manifest Integrity / Audit SHA256SUMS Files (push) Has been cancelled
Manifest Integrity / Verify Merkle Roots (push) Has been cancelled
Docs CI / lint-and-preview (push) Has been cancelled
Reachability Bench
Benchmarks the reachability scoring pipeline using offline synthetic fixtures.
Inputs
- Callgraph fixtures:
docs/samples/signals/reachability/callgraph-10k.ndjsonandcallgraph-50k.ndjson. - Runtime traces:
docs/samples/signals/reachability/runtime-10k.ndjsonandruntime-50k.ndjson. - Schema hash:
docs/benchmarks/signals/reachability-schema.json(sha256aaa5c8ab5cc2fe91e50976fafd8c73597387ab9a881af6d5d9818d202beba24e).
Running
python reachability_bench.py --callgraph ../../../../docs/samples/signals/reachability/callgraph-10k.ndjson --runtime ../../../../docs/samples/signals/reachability/runtime-10k.ndjson --output results/reachability-metrics-10k.ndjson --cache-output results/reachability-cache-10k.ndjson --threads 1 --seed 20250101
Swap the input paths for the 50k fixtures to exercise the larger dataset.
Output
- Metrics NDJSON with fields:
run,startedAtUtc,functions,runtimeEvents,facts,durationMs,factsPerSec,p50MsPerNode,p95MsPerNode,p99MsPerNode,rssMb,managedMb,gcGen2. - Cache NDJSON (
reachability-cache-*.ndjson) with per-function reachability flags, fanout, and runtime counts for downstream policy benches.
Determinism
- Processing order is sorted by runtime function id; graph traversal preserves deterministic queueing.
- Single-threaded execution avoids nondeterministic scheduling.
- Output JSON keys are sorted for stable diffs; timestamps use UTC ISO-8601.