stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity
Files
bc4318ef971247e18c9c05f8b7838880f6584dc3
git.stella-ops.org/docs2/testing-and-quality.md
master bc4318ef97 Add tests for SBOM generation determinism across multiple formats 
- Created `StellaOps.TestKit.Tests` project for unit tests related to determinism.
- Implemented `DeterminismManifestTests` to validate deterministic output for canonical bytes and strings, file read/write operations, and error handling for invalid schema versions.
- Added `SbomDeterminismTests` to ensure identical inputs produce consistent SBOMs across SPDX 3.0.1 and CycloneDX 1.6/1.7 formats, including parallel execution tests.
- Updated project references in `StellaOps.Integration.Determinism` to include the new determinism testing library.
2025-12-23 18:56:12 +02:00

732 B
Raw Blame History

Testing and quality

Principles

  • Determinism is a contract: identical inputs must yield identical outputs.
  • Offline-first: tests should pass without network access.
  • Evidence-first: assertions cover evidence chains, not only verdicts.

Test layers

  • Unit and property tests for core libraries.
  • Integration tests with PostgreSQL and Valkey.
  • Contract tests for OpenAPI and schemas.
  • End-to-end tests for scan, policy, and offline workflows.
  • Replay verification against golden corpora.

Quality gates

  • Determinism checks on replay outputs.
  • Interop checks against external tooling formats.
  • Offline E2E runs as a release gate.
  • Policy and schema validation in CI.

Related references

  • testing/router-chaos.md