stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 16 Releases Wiki Activity
Files
f30805ad7f5457dac581340d20d3f7a1d3afcbf6
git.stella-ops.org/tests/reachability
History
StellaOps Bot ea970ead2a
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
Details
sdk-generator-smoke / sdk-smoke (push) Has been cancelled
Details
SDK Publish & Sign / sdk-publish (push) Has been cancelled
Details
api-governance / spectral-lint (push) Has been cancelled
Details
oas-ci / oas-validate (push) Has been cancelled
Details
Mirror Thin Bundle Sign & Verify / mirror-sign (push) Has been cancelled
Details
up
2025-11-27 07:46:56 +02:00
..
corpus
reachability test material
2025-11-25 23:26:46 +02:00
fixtures/reachbench-2025-expanded
reachability test material
2025-11-25 23:26:46 +02:00
scripts
Refactor code structure for improved readability and maintainability; removed redundant code blocks and optimized function calls.
2025-11-20 07:50:52 +02:00
StellaOps.Reachability.FixtureTests
up
2025-11-27 07:46:56 +02:00
StellaOps.Replay.Core.Tests
up
2025-11-26 07:47:08 +02:00
StellaOps.ScannerSignals.IntegrationTests
feat(ruby): Implement RubyManifestParser for parsing gem groups and dependencies
2025-11-10 09:27:03 +02:00
StellaOps.Signals.Reachability.Tests
feat(ruby): Implement RubyManifestParser for parsing gem groups and dependencies
2025-11-10 09:27:03 +02:00
README.md
reachability test material
2025-11-25 23:26:46 +02:00

README.md

Reachability Fixture Harness

This directory carries the reachbench fixture packs used by Sprint 201 to validate reachability explainability.

  • fixtures/reachbench-2025-expanded/ contains 24 multi-language cases with reachable and unreachable variants, SBOMs, callgraphs, runtime traces, and DSSE envelopes. Each variant ships a manifest with SHA-256 hashes to keep runs deterministic.
  • StellaOps.Reachability.FixtureTests provides guard rails that ensure files exist, hashes match manifests, and ground-truth paths align with reachable/unreachable variants before the Signals/Scanner reachability pipeline consumes them.

Running the fixture tests

# From the repo root
DOTNET_CLI_UI_LANGUAGE=en DOTNET_SYSTEM_GLOBALIZATION_INVARIANT=1 \
  dotnet test tests/reachability/StellaOps.Reachability.FixtureTests/StellaOps.Reachability.FixtureTests.csproj

# Focus only the evaluation harness checks
DOTNET_CLI_UI_LANGUAGE=en DOTNET_SYSTEM_GLOBALIZATION_INVARIANT=1 \
  dotnet test tests/reachability/StellaOps.Reachability.FixtureTests/StellaOps.Reachability.FixtureTests.csproj \
  --filter ReachbenchEvaluationHarnessTests

The tests validate fixture integrity (hashes, schema versions) and now enforce the evaluation harness contract: reachable variants must surface execution paths while unreachable variants must not. Keep the environment overrides above in CI to avoid localization drift during hash comparisons.