Files
git.stella-ops.org/bench/reachability-benchmark/schemas/README.md
StellaOps Bot 8f54ffa203
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
devportal-offline / build-offline (push) Has been cancelled
Mirror Thin Bundle Sign & Verify / mirror-sign (push) Has been cancelled
up
2025-11-29 11:37:00 +02:00

1.0 KiB

Schemas

  • case.schema.yaml — case descriptor (language, sinks, deterministic build/test, environment, optional inline ground truth summary).
  • entrypoints.schema.yaml — declared entrypoints grouped by type (http, cli, scheduled, etc.).
  • truth.schema.json — ground-truth labels + evidence per sink (reachable/unreachable/unknown).
  • submission.schema.json — submission format (tool/run metadata, per-sink predictions, explanations).
  • examples/ — minimal valid examples for each schema.

Validate quickly

# install minimal deps (offline-friendly, pinned)
python -m pip install -r ../tools/requirements.txt

# validate individual files
python ../tools/validate.py case examples/case.sample.yaml
python ../tools/validate.py entrypoints examples/entrypoints.sample.yaml
python ../tools/validate.py truth examples/truth.sample.json
python ../tools/validate.py submission examples/submission.sample.json

# or validate everything in one shot
python ../tools/validate.py all examples