up
This commit is contained in:
22
bench/reachability-benchmark/schemas/README.md
Normal file
22
bench/reachability-benchmark/schemas/README.md
Normal file
@@ -0,0 +1,22 @@
|
||||
# Schemas
|
||||
|
||||
- `case.schema.yaml` — case descriptor (language, sinks, deterministic build/test, environment, optional inline ground truth summary).
|
||||
- `entrypoints.schema.yaml` — declared entrypoints grouped by type (`http`, `cli`, `scheduled`, etc.).
|
||||
- `truth.schema.json` — ground-truth labels + evidence per sink (`reachable`/`unreachable`/`unknown`).
|
||||
- `submission.schema.json` — submission format (tool/run metadata, per-sink predictions, explanations).
|
||||
- `examples/` — minimal valid examples for each schema.
|
||||
|
||||
## Validate quickly
|
||||
```bash
|
||||
# install minimal deps (offline-friendly, pinned)
|
||||
python -m pip install -r ../tools/requirements.txt
|
||||
|
||||
# validate individual files
|
||||
python ../tools/validate.py case examples/case.sample.yaml
|
||||
python ../tools/validate.py entrypoints examples/entrypoints.sample.yaml
|
||||
python ../tools/validate.py truth examples/truth.sample.json
|
||||
python ../tools/validate.py submission examples/submission.sample.json
|
||||
|
||||
# or validate everything in one shot
|
||||
python ../tools/validate.py all examples
|
||||
```
|
||||
Reference in New Issue
Block a user