Files
git.stella-ops.org/docs/benchmarks/signals/bench-sig-26-001-prep.md
master d519782a8f
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
prep docs and service updates
2025-11-21 06:56:36 +00:00

1.2 KiB

Reachability Scoring Bench Prep — PREP-BENCH-SIG-26-001-REACHABILITY-SCHEMA-FIX

Status: Draft (2025-11-20) Owners: Bench Guild · Signals Guild Scope: Define the inputs/fixtures for reachability scoring benchmarks pending schema freeze (Sprint 0400/0401).

Dependencies

  • Reachability schema for runtime/static signals (Sprint 0400/0401).
  • Sample callgraph/runtime traces sized for 10k/50k functions.

Proposed harness

  • Project: src/Bench/StellaOps.Bench.Signals (or shared bench harness if preferred).
  • Inputs: callgraph NDJSON + runtime traces; config with seed, concurrency, batch size.
  • Metrics: facts/sec, p95 latency, peak RSS, cache hit ratio; output NDJSON with sorted records.
  • Determinism: fixed seed; process inputs in lexical order; stable JSON property order.

Acceptance

  • Schema hash referenced once Sprint 0400/0401 publishes; placeholder noted until then.
  • Sample config + command documented.
  • File paths for sample fixtures under docs/samples/signals/ once available.

Handoff

Use this prep doc to satisfy PREP-BENCH-SIG-26-001-REACHABILITY-SCHEMA-FIX. Update with schema hash and fixtures when published; then move the task to DONE and unblock BENCH-SIG-26-001 implementation.