Deterministic Replayability for Tests

Module

Cli

Status

IMPLEMENTED

Description

Test infrastructure includes determinism manifests, run manifest validation, test run attestation generation, and golden output replay verification, supporting the advisory's call for deterministic replayability.

Implementation Details

Replay Infrastructure: src/Cli/StellaOps.Cli/Replay/ -- replay command and manifest handling
Determinism Tests: src/Cli/__Tests/StellaOps.Cli.Tests/Determinism/CliDeterminismTests.cs, AttestVerifyDeterminismTests.cs
Golden Output Tests: src/Cli/__Tests/StellaOps.Cli.Tests/GoldenOutput/DeterminismReplayGoldenTests.cs
Run Manifest: src/Cli/__Tests/StellaOps.Cli.Tests/Replay/RunManifestSerializerTests.cs -- run manifest serialization
Determinism Harness: src/Cli/StellaOps.Cli/Services/DeterminismHarness.cs / IDeterminismHarness.cs
Architecture:
- Run manifests capture all inputs (hashes, versions, timestamps) for reproducible execution
- Golden output tests verify byte-identical output from identical inputs
- Determinism harness wraps execution with purity checks

E2E Test Plan

Verify determinism tests pass with identical outputs across runs
Verify run manifests capture all input hashes
Verify golden output replay produces byte-identical results
Verify determinism harness detects non-deterministic behavior
Verify run manifest serialization round-trips correctly
Verify attestation generation for test runs

1.5 KiB Raw Blame History