stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity
Files
02849cc9559bca4a843bfce84e5dc7ffd2ddbe19
git.stella-ops.org/bench/reachability-benchmark/benchmark/checklists/dataset-safety.md
StellaOps Bot e1262eb916 Add receipt input JSON and SHA256 hash for CVSS policy scoring tests 
- Introduced a new JSON fixture `receipt-input.json` containing base, environmental, and threat metrics for CVSS scoring.
- Added corresponding SHA256 hash file `receipt-input.sha256` to ensure integrity of the JSON fixture.
2025-12-04 07:30:42 +02:00

1.4 KiB
Raw Blame History

Dataset Safety & Provenance Checklist (RD1–RD10)

Version: 1.0.1 · Date: 2025-12-03

  • PII/secret scrub: no tokens/URLs; build/test logs redacted. Attested by DSSE when signing manifest.
  • License compatibility: all cases authored in-repo under Apache-2.0; third-party snippets none. NOTICE up to date.
  • Feed/tool lockfile: manifest.sample.json pins hashes for schemas, scorer, builder, and baseline submissions (when present).
  • Published schemas/validators: truth/submission/coverage/trace + manifest schemas; validated via tools/validate.py and tools/verify_manifest.py.
  • Evidence bundles: coverage + traces + attestation + sbom recorded per case (sample manifest).
  • Binary case recipe: cases/**/build/build.sh pinned SOURCE_DATE_EPOCH and env templates under benchmark/templates/determinism/.
  • Determinism CI: ci/run-ci.sh + tools/verify_manifest.py run twice to compare hashes; Java track still blocked on JDK availability.
  • Signed baselines: baseline submissions may include DSSE path in manifest (not required for sample kit); rulepack hashes recorded separately.
  • Submission policy: CLA/DSSE optional in sample; production kits require DSSE envelope recorded in signatures.
  • Semantic versioning & changelog: see benchmark/CHANGELOG.md; manifest version mirrors dataset release.
  • Offline kit packaging: tools/package_offline_kit.sh produces deterministic tarball with manifest + schemas + tools.