test fixes and new product advisories work

2026-01-28 02:30:48 +02:00
parent 82caceba56
commit 644887997c
288 changed files with 69101 additions and 375 deletions
--- a/docs/technical/testing/TEST_COVERAGE_MATRIX.md
+++ b/docs/technical/testing/TEST_COVERAGE_MATRIX.md
@@ -256,7 +256,84 @@ Weekly (Optional):

 ---

+## Turn #6 Testing Enhancements Coverage
+
+### New Coverage Dimensions (Sprint 0127.002)
+
+The following dimensions track adoption of Turn #6 testing practices across modules:
+
+| Dimension | Description | Target Coverage |
+|-----------|-------------|-----------------|
+| **Intent Tags** | Tests with `[Intent]` attribute declaring regulatory/safety/performance/competitive/operational | 100% non-trivial tests in Policy, Authority, Signer, Attestor |
+| **Observability Contracts** | W1 tests with OTel schema validation, log field contracts | 100% of W1 tests |
+| **Evidence Traceability** | Tests with `[Requirement]` attribute linking to requirements | 100% of regulatory-tagged tests |
+| **Longevity Tests** | Memory stability, counter drift, connection pool tests | Scanner, Scheduler, Notify workers |
+| **Interop Tests** | N-1/N+1 version compatibility tests | EvidenceLocker, Policy (schema-dependent) |
+| **Environment Skew** | Tests across infrastructure profiles (network latency, resource limits) | Integration tests |
+
+### Turn #6 Coverage Matrix
+
+| Module | Intent Tags | Observability | Evidence | Longevity | Interop | Skew |
+|--------|-------------|---------------|----------|-----------|---------|------|
+| **Policy** | ✅ Pilot | 🟡 | ✅ Pilot | 🟡 | 🟡 | ⬜ |
+| **EvidenceLocker** | 🟡 | 🟡 | ✅ Pilot | 🟡 | ✅ | 🟡 |
+| **Scanner** | 🟡 | ✅ Pilot | 🟡 | ✅ | 🟡 | 🟡 |
+| **Authority** | 🟡 | 🟡 | 🟡 | ⬜ | 🟡 | ⬜ |
+| **Signer** | 🟡 | 🟡 | 🟡 | ⬜ | 🟡 | ⬜ |
+| **Attestor** | 🟡 | 🟡 | 🟡 | ⬜ | 🟡 | ⬜ |
+| **Scheduler** | 🟡 | 🟡 | 🟡 | ✅ | ⬜ | 🟡 |
+| **Notify** | 🟡 | 🟡 | 🟡 | ✅ | ⬜ | ⬜ |
+
+**Legend:**
+- ✅ Pilot implementation complete
+- 🟡 Recommended, not yet implemented
+- ⬜ Not applicable
+
+### Turn #6 TestKit Components
+
+| Component | Location | Purpose | Status |
+|-----------|----------|---------|--------|
+| `IntentAttribute` | `TestKit/Traits/IntentAttribute.cs` | Tag tests with intent | ✅ Complete |
+| `IntentAnalyzer` | `TestKit.Analyzers/IntentAnalyzer.cs` | Detect missing intent tags | ✅ Complete |
+| `OTelContractAssert` | `TestKit/Observability/OTelContractAssert.cs` | Span/attribute validation | ✅ Complete |
+| `LogContractAssert` | `TestKit/Observability/LogContractAssert.cs` | Log field validation | ✅ Complete |
+| `MetricsContractAssert` | `TestKit/Observability/MetricsContractAssert.cs` | Cardinality bounds | ✅ Complete |
+| `RequirementAttribute` | `TestKit/Evidence/RequirementAttribute.cs` | Link tests to requirements | ✅ Complete |
+| `EvidenceChainAssert` | `TestKit/Evidence/EvidenceChainAssert.cs` | Hash/immutability validation | ✅ Complete |
+| `EvidenceChainReporter` | `TestKit/Evidence/EvidenceChainReporter.cs` | Traceability matrix | ✅ Complete |
+| `IncidentTestGenerator` | `TestKit/Incident/IncidentTestGenerator.cs` | Post-incident test scaffolds | ✅ Complete |
+| `SchemaVersionMatrix` | `TestKit/Interop/SchemaVersionMatrix.cs` | Version compatibility | ✅ Complete |
+| `VersionCompatibilityFixture` | `TestKit/Interop/VersionCompatibilityFixture.cs` | N-1/N+1 testing | ✅ Complete |
+| `StabilityMetrics` | `TestKit/Longevity/StabilityMetrics.cs` | Memory/counter tracking | ✅ Complete |
+| `StabilityTestRunner` | `TestKit/Longevity/StabilityTestRunner.cs` | Time-extended tests | ✅ Complete |
+| `EnvironmentProfile` | `TestKit/Environment/EnvironmentProfile.cs` | Infrastructure profiles | ✅ Complete |
+| `SkewTestRunner` | `TestKit/Environment/SkewTestRunner.cs` | Cross-profile testing | ✅ Complete |
+
+### Turn #6 Test Categories
+
+New categories added to `TestCategories.cs`:
+
+| Category | Filter | CI Lane | Gating |
+|----------|--------|---------|--------|
+| `PostIncident` | `Category=PostIncident` | Release | P1/P2 block |
+| `EvidenceChain` | `Category=EvidenceChain` | Merge | Block |
+| `Longevity` | `Category=Longevity` | Nightly | Warning |
+| `Interop` | `Category=Interop` | Release | Block |
+| `EnvironmentSkew` | `Category=EnvironmentSkew` | Nightly | Warning |
+
+### Coverage Targets (End of Q1 2026)
+
+| Dimension | Current Baseline | Target | Tracking |
+|-----------|------------------|--------|----------|
+| Intent Tags (Policy, Authority, Signer, Attestor) | 5 tests | 100% non-trivial | `IntentCoverageReport` |
+| Observability Contracts (W1 tests) | 5 tests | 100% | `OTelContractAssert` usage |
+| Evidence Traceability (Regulatory tests) | 3 tests | 100% | `EvidenceChainReporter` |
+| Longevity Tests (Worker modules) | 0 tests | 1 per worker | `StabilityTestRunner` usage |
+| Interop Tests (Schema modules) | 0 tests | 1 per schema | `SchemaVersionMatrix` usage |
+
+---
+
 **Prepared by:** Project Management
-**Date:** 2025-12-23
-**Next Review:** 2026-01-06 (Week 1 kickoff)
-**Source:** `docs/technical/testing/TEST_CATALOG.yml`, Sprint files 5100.0009.* and 5100.0010.*
+**Date:** 2026-01-27
+**Next Review:** 2026-02-03 (Turn #6 adoption review)
+**Source:** `docs/technical/testing/TEST_CATALOG.yml`, Sprint files 5100.0009.* and 5100.0010.*, SPRINT_0127_002_DOCS_testing_enhancements_turn6.md