prep docs and service updates
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
This commit is contained in:
23
docs/benchmarks/signals/bench-sig-26-001-prep.md
Normal file
23
docs/benchmarks/signals/bench-sig-26-001-prep.md
Normal file
@@ -0,0 +1,23 @@
|
||||
# Reachability Scoring Bench Prep — PREP-BENCH-SIG-26-001-REACHABILITY-SCHEMA-FIX
|
||||
|
||||
Status: Draft (2025-11-20)
|
||||
Owners: Bench Guild · Signals Guild
|
||||
Scope: Define the inputs/fixtures for reachability scoring benchmarks pending schema freeze (Sprint 0400/0401).
|
||||
|
||||
## Dependencies
|
||||
- Reachability schema for runtime/static signals (Sprint 0400/0401).
|
||||
- Sample callgraph/runtime traces sized for 10k/50k functions.
|
||||
|
||||
## Proposed harness
|
||||
- Project: `src/Bench/StellaOps.Bench.Signals` (or shared bench harness if preferred).
|
||||
- Inputs: callgraph NDJSON + runtime traces; config with seed, concurrency, batch size.
|
||||
- Metrics: facts/sec, p95 latency, peak RSS, cache hit ratio; output NDJSON with sorted records.
|
||||
- Determinism: fixed seed; process inputs in lexical order; stable JSON property order.
|
||||
|
||||
## Acceptance
|
||||
- Schema hash referenced once Sprint 0400/0401 publishes; placeholder noted until then.
|
||||
- Sample config + command documented.
|
||||
- File paths for sample fixtures under `docs/samples/signals/` once available.
|
||||
|
||||
## Handoff
|
||||
Use this prep doc to satisfy PREP-BENCH-SIG-26-001-REACHABILITY-SCHEMA-FIX. Update with schema hash and fixtures when published; then move the task to DONE and unblock BENCH-SIG-26-001 implementation.
|
||||
21
docs/benchmarks/signals/bench-sig-26-002-prep.md
Normal file
21
docs/benchmarks/signals/bench-sig-26-002-prep.md
Normal file
@@ -0,0 +1,21 @@
|
||||
# Policy Eval with Reachability Cache Prep — PREP-BENCH-SIG-26-002-BLOCKED-ON-26-001-OUTPU
|
||||
|
||||
Status: Draft (2025-11-20)
|
||||
Owners: Bench Guild · Policy Guild
|
||||
Scope: Capture prep for measuring policy evaluation overhead with reachability cache hot/cold, dependent on 26-001 outputs.
|
||||
|
||||
## Dependencies
|
||||
- Bench outputs from 26-001 (reachability scoring harness) providing cached datasets.
|
||||
- Policy overlay schema (30-001) for status fields.
|
||||
|
||||
## Proposed benchmarks
|
||||
- Scenarios: cold cache, warm cache, mixed workload (70/30), parallel workers.
|
||||
- Metrics: added latency per evaluation (p50/p95), cache hit ratio, CPU, memory.
|
||||
- Determinism: fixed seed; deterministic request order; stable JSON output ordering.
|
||||
|
||||
## Acceptance
|
||||
- Reference to reachability dataset hash from 26-001 once available.
|
||||
- Config/sample command drafted for `src/Bench/StellaOps.Bench.Policy` (or shared).
|
||||
|
||||
## Handoff
|
||||
Use this prep doc to satisfy PREP-BENCH-SIG-26-002-BLOCKED-ON-26-001-OUTPU. Update with dataset hash and schema references after 26-001 is done, then move to DONE and unblock BENCH-SIG-26-002.
|
||||
Reference in New Issue
Block a user