stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 12 Releases Wiki Activity
Files
515975edc569a6e26e5407b8eb2f55b483315415
git.stella-ops.org/docs/dev/lnm-determinism-tests.md
master 515975edc5
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
Details
Implement Advisory Canonicalization and Backfill Migration 
- Added AdvisoryCanonicalizer for canonicalizing advisory identifiers.
- Created EnsureAdvisoryCanonicalKeyBackfillMigration to populate advisory_key and links in advisory_raw documents.
- Introduced FileSurfaceManifestStore for managing surface manifests with file system backing.
- Developed ISurfaceManifestReader and ISurfaceManifestWriter interfaces for reading and writing manifests.
- Implemented SurfaceManifestPathBuilder for constructing paths and URIs for surface manifests.
- Added tests for FileSurfaceManifestStore to ensure correct functionality and deterministic behavior.
- Updated documentation for new features and migration steps.
2025-11-07 19:54:02 +02:00

2.2 KiB
Raw Blame History

Link-Not-Merge Determinism Test Plan

Task: MERGE-LNM-21-003 — replace legacy merge determinism suites with observation/linkset regressions now that NoMergeEnabled is defaulted to true.

Objectives

  • Validate raw advisory documents remain byte-stable through observation/linkset materialisation.
  • Ensure conflicts detected during linkset building surface in telemetry and persisted artifacts without merge-side mutation.
  • Keep canonical hash output stable for exports/evidence bundles after repeated runs.

Test Coverage Outline

  1. Raw → Observation determinism

    • Feed canonical advisory raw fixtures containing mixed casing, duplicate aliases, and provenance metadata.
    • Assert repeated runs of AdvisoryObservationFactory emit identical observations (structural equality + canonical JSON hash).
    • Verify raw linkset payload retains original ordering/whitespace while canonical linkset stays normalised.
    • Initial coverage implemented via AdvisoryObservationFactoryTests.Create_IsDeterministicAcrossRuns (core tests).

  2. Linkset conflict surfacing

    • Build linksets from conflicting advisory observations (e.g., differing severity or status flags).
    • Confirm conflict markers propagate to AdvisoryLinkset outputs and associated metrics/log records.
    • Capture deterministic ordering of conflict explanations for evidence exports.

  3. Evidence/export parity

    • Re-run observation/linkset pipelines against identical fixtures and assert resulting evidence manifests hash-identically.
    • Track monotonic supersedes chains and ensure canonical link records include PRIMARY schemes.

Migration Steps

  • Retire StellaOps.Concelier.Merge.Tests determinism suites once observation/linkset equivalents land.
  • Introduce new regression fixtures under StellaOps.Concelier.Core.Tests (shared via StellaOps.Concelier.Testing).
  • Wire test helpers to Mongo in-memory harness for end-to-end parity runs.
  • Update documentation (docs/migration/no-merge.md) with validation checklist once new tests are green.

Pending: execute suites on a workstation with the .NET 10 preview SDK; local environment lacks a functioning CLI, so validation runs must happen downstream.