stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity
Files
dfaa2079aa9d25cf04ceaffd70dacd298b46106f
git.stella-ops.org/docs/product-advisories/archived/2025-12-21-testing-strategy
History
master 53503cb407 Add reference architecture and testing strategy documentation 
- Created a new document for the Stella Ops Reference Architecture outlining the system's topology, trust boundaries, artifact association, and interfaces.
- Developed a comprehensive Testing Strategy document detailing the importance of offline readiness, interoperability, determinism, and operational guardrails.
- Introduced a README for the Testing Strategy, summarizing processing details and key concepts implemented.
- Added guidance for AI agents and developers in the tests directory, including directory structure, test categories, key patterns, and rules for test development.
2025-12-22 07:59:30 +02:00
..
20-Dec-2025 - Testing strategy.md
Add reference architecture and testing strategy documentation
2025-12-22 07:59:30 +02:00
README.md
Add reference architecture and testing strategy documentation
2025-12-22 07:59:30 +02:00

README.md

Archived Advisory: Testing Strategy

Archived: 2025-12-21 Original: docs/product-advisories/20-Dec-2025 - Testing strategy.md

Processing Summary

This advisory was processed into Sprint Epic 5100 - Comprehensive Testing Strategy.

Artifacts Created

Sprint Files (12 sprints, ~75 tasks):

Sprint Name Phase
5100.0001.0001 Run Manifest Schema Phase 0
5100.0001.0002 Evidence Index Schema Phase 0
5100.0001.0003 Offline Bundle Manifest Phase 0
5100.0001.0004 Golden Corpus Expansion Phase 0
5100.0002.0001 Canonicalization Utilities Phase 1
5100.0002.0002 Replay Runner Service Phase 1
5100.0002.0003 Delta-Verdict Generator Phase 1
5100.0003.0001 SBOM Interop Round-Trip Phase 2
5100.0003.0002 No-Egress Enforcement Phase 2
5100.0004.0001 Unknowns Budget CI Gates Phase 3
5100.0005.0001 Router Chaos Suite Phase 4
5100.0006.0001 Audit Pack Export/Import Phase 5

Documentation Updated:

  • docs/implplan/SPRINT_5100_SUMMARY.md - Master epic summary
  • docs/19_TEST_SUITE_OVERVIEW.md - Test suite documentation
  • tests/AGENTS.md - AI agent guidance for tests directory

Key Concepts Implemented

  1. Deterministic Replay: Run Manifests capture all inputs for byte-identical verdict reproduction
  2. Canonical JSON: RFC 8785 principles for stable serialization
  3. Evidence Index: Linking verdicts to complete evidence chain
  4. Air-Gap Compliance: Network-isolated testing with --network none
  5. SBOM Interoperability: Round-trip testing with Syft, Grype, cosign
  6. Unknowns Budget Gates: Environment-based budget enforcement
  7. Router Backpressure: HTTP 429/503 with Retry-After validation
  8. Audit Packs: Sealed export/import for compliance verification

Release Blocking Gates

  • Replay Verification: 0 byte diff
  • Interop Suite: 95%+ findings parity
  • Offline E2E: All pass with no network
  • Unknowns Budget: Within configured limits
  • Router Retry-After: 100% compliance

Processed by: Claude Code Date: 2025-12-21