stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity
Files
8f54ffa2033dcd9f9558dc7dc15f66fa70615c3c
git.stella-ops.org/bench/reachability-benchmark/tools/scorer
History
StellaOps Bot 8f54ffa203
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
Details
devportal-offline / build-offline (push) Has been cancelled
Details
Mirror Thin Bundle Sign & Verify / mirror-sign (push) Has been cancelled
Details
up
2025-11-29 11:37:00 +02:00
..
README.md
up
2025-11-29 11:37:00 +02:00

README.md

rb-score (placeholder)

Planned CLI to score reachability submissions against truth sets.

Future work (BENCH-SCORER-513-008):

  • Validate submission against schemas/submission.schema.json.
  • Validate truth against schemas/truth.schema.json.
  • Compute precision/recall/F1, explainability score (0-3), runtime stats, determinism rate.
  • Emit JSON report with stable ordering.

For now this folder is a stub; implementation will be added in task 513-008 once schemas stabilize.