Files
git.stella-ops.org/bench/reachability-benchmark/baselines/codeql/README.md
StellaOps Bot 909d9b6220
Some checks failed
AOC Guard CI / aoc-guard (push) Has been cancelled
AOC Guard CI / aoc-verify (push) Has been cancelled
Docs CI / lint-and-preview (push) Has been cancelled
Policy Lint & Smoke / policy-lint (push) Has been cancelled
up
2025-12-01 21:16:22 +02:00

935 B
Raw Blame History

CodeQL baseline

Deterministic baseline runner that emits a benchmark submission for one or more cases using CodeQL when available. If CodeQL is not installed, it still produces a schemavalid submission marking all sinks as unreachable, so CI and comparisons remain stable.

Usage

# One case
baselines/codeql/run_case.sh cases/js/unsafe-eval /tmp/codeql-out

# All cases under a root
baselines/codeql/run_all.sh cases /tmp/codeql-all

Outputs:

  • Per-case: <out>/submission.json
  • All cases: <out>/submission.json (merged, deterministic ordering)

Determinism posture

  • No network access; all inputs are local files.
  • Stable ordering of cases and sinks.
  • If CodeQL is missing or analysis fails, the runner falls back to a deterministic “all unreachable” submission.

Requirements

  • Python 3.11+.
  • Optional: codeql CLI on PATH for real analysis (not required for offline deterministic fallback).