stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity
Files
e9aeadc04084353889b1c9dbf4487f5316f4421e
git.stella-ops.org/docs/features/checked/advisoryai/deterministic-ai-artifact-replay.md
master e9aeadc040 save checkpoint
2026-02-14 09:11:48 +02:00

2.7 KiB
Raw Blame History

Deterministic AI Artifact Replay

Module

AdvisoryAI

Status

VERIFIED

Description

Deterministic replay infrastructure for AI artifacts including replay manifests, prompt template versioning, and input artifact hashing for reproducible AI outputs.

Implementation Details

  • Modules: src/AdvisoryAI/StellaOps.AdvisoryAI/Replay/, src/Attestor/__Libraries/StellaOps.Attestor.ProofChain/Replay/
  • Key Classes:
    • AIArtifactReplayer (src/AdvisoryAI/StellaOps.AdvisoryAI/Replay/AIArtifactReplayer.cs) - replays AI artifacts with deterministic inputs for verification
    • ReplayInputArtifact (src/Attestor/__Libraries/StellaOps.Attestor.ProofChain/Replay/ReplayInputArtifact.cs) - input artifact model with content-addressed hashing
    • ReplayPromptTemplate (src/Attestor/__Libraries/StellaOps.Attestor.ProofChain/Replay/ReplayPromptTemplate.cs) - versioned prompt templates for replay
    • ReplayResult (src/Attestor/__Libraries/StellaOps.Attestor.ProofChain/Replay/ReplayResult.cs) - replay execution result with comparison data
    • ReplayVerificationResult (src/Attestor/__Libraries/StellaOps.Attestor.ProofChain/Replay/ReplayVerificationResult.cs) - verification of replay output against original
    • ReplayStatus (src/Attestor/__Libraries/StellaOps.Attestor.ProofChain/Replay/ReplayStatus.cs) - replay status tracking
    • DeterministicHashVectorEncoder (src/AdvisoryAI/StellaOps.AdvisoryAI/Vectorization/DeterministicHashVectorEncoder.cs) - deterministic hash-based vector encoding for reproducibility
  • Interfaces: None (uses concrete replay pipeline)
  • Source: Feature matrix scan

E2E Test Plan

  • Record an AI inference run and verify AIArtifactReplayer can replay it with identical inputs
  • Verify ReplayInputArtifact computes content-addressed hashes that match across replay invocations
  • Verify ReplayPromptTemplate versioning: replay with a v1 template produces the same output as the original v1 run
  • Verify ReplayVerificationResult detects differences when the replay output diverges from the original
  • Verify DeterministicHashVectorEncoder produces identical vectors for identical inputs across runs
  • Verify replay with temperature=0 and fixed seed produces bit-identical outputs for supported providers

Verification

  • Verified on 2026-02-11 via run-001.
  • Tier 0: docs/qa/feature-checks/runs/advisoryai/deterministic-ai-artifact-replay/run-001/tier0-source-check.json
  • Tier 1: docs/qa/feature-checks/runs/advisoryai/deterministic-ai-artifact-replay/run-001/tier1-build-check.json
  • Tier 2: docs/qa/feature-checks/runs/advisoryai/deterministic-ai-artifact-replay/run-001/tier2-integration-check.json