24 lines
1.2 KiB
Markdown
24 lines
1.2 KiB
Markdown
# Reachability Scoring Bench Prep — PREP-BENCH-SIG-26-001-REACHABILITY-SCHEMA-FIX
|
|
|
|
Status: Draft (2025-11-20)
|
|
Owners: Bench Guild · Signals Guild
|
|
Scope: Define the inputs/fixtures for reachability scoring benchmarks pending schema freeze (Sprint 0400/0401).
|
|
|
|
## Dependencies
|
|
- Reachability schema for runtime/static signals (Sprint 0400/0401).
|
|
- Sample callgraph/runtime traces sized for 10k/50k functions.
|
|
|
|
## Proposed harness
|
|
- Project: `src/Bench/StellaOps.Bench.Signals` (or shared bench harness if preferred).
|
|
- Inputs: callgraph NDJSON + runtime traces; config with seed, concurrency, batch size.
|
|
- Metrics: facts/sec, p95 latency, peak RSS, cache hit ratio; output NDJSON with sorted records.
|
|
- Determinism: fixed seed; process inputs in lexical order; stable JSON property order.
|
|
|
|
## Acceptance
|
|
- Schema hash referenced once Sprint 0400/0401 publishes; placeholder noted until then.
|
|
- Sample config + command documented.
|
|
- File paths for sample fixtures under `docs/samples/signals/` once available.
|
|
|
|
## Handoff
|
|
Use this prep doc to satisfy PREP-BENCH-SIG-26-001-REACHABILITY-SCHEMA-FIX. Update with schema hash and fixtures when published; then move the task to DONE and unblock BENCH-SIG-26-001 implementation.
|