stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity
Files
1bf6bbf3955ecbd8d20f5eeb767da5c7f8324b57
git.stella-ops.org/docs/features/unchecked/excititor/trust-vector-calibration-system.md

3.4 KiB
Raw Blame History

Trust Vector Calibration System

Module

Excititor

Status

IMPLEMENTED

Description

Full trust calibration system including: DefaultTrustVectors (per-source baseline trust), SourceClassificationService, CalibrationManifest (versioned calibration snapshots), CalibrationComparisonEngine (post-mortem comparison), TrustVectorCalibrator with learning rate, and TrustCalibrationService. Distinct from "VEX Source Trust Scoring" which is about individual scoring; this is the calibration/tuning infrastructure.

Implementation Details

  • Modules: src/Excititor/__Libraries/StellaOps.Excititor.Core/Calibration/, src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/
  • Key Classes:
    • TrustCalibrationService (src/Excititor/__Libraries/StellaOps.Excititor.Core/Calibration/TrustCalibrationService.cs) - orchestrates trust vector calibration
    • TrustVectorCalibrator (src/Excititor/__Libraries/StellaOps.Excititor.Core/Calibration/TrustVectorCalibrator.cs) - calibrates trust vectors with configurable learning rate
    • CalibrationComparisonEngine (src/Excititor/__Libraries/StellaOps.Excititor.Core/Calibration/CalibrationComparisonEngine.cs) - post-mortem comparison of calibration snapshots
    • CalibrationManifest (src/Excititor/__Libraries/StellaOps.Excititor.Core/Calibration/CalibrationManifest.cs) - versioned calibration snapshot model
    • DefaultTrustVectors (src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/DefaultTrustVectors.cs) - per-source baseline trust values
    • SourceClassificationService (src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/SourceClassificationService.cs) - classifies VEX sources for trust assignment
    • TrustVector (src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/TrustVector.cs) - trust vector model with multi-dimensional scores
    • TrustWeights (src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/TrustWeights.cs) - configurable trust weights
    • FreshnessCalculator (src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/FreshnessCalculator.cs) - calculates freshness component of trust vector
    • ProvenanceScorer (src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/ProvenanceScorer.cs) - scores provenance for trust calculation
    • CoverageScorer (src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/CoverageScorer.cs) - scores coverage for trust calculation
    • ReplayabilityScorer (src/Excititor/__Libraries/StellaOps.Excititor.Core/TrustVector/ReplayabilityScorer.cs) - scores replayability for trust calculation
  • Interfaces: None (uses concrete calibration pipeline)
  • Source: SPRINT_7100_0002_0002_source_defaults_calibration.md

E2E Test Plan

  • Run TrustCalibrationService and verify it calibrates trust vectors based on historical VEX accuracy
  • Verify TrustVectorCalibrator adjusts trust scores with configurable learning rate (slow convergence)
  • Verify CalibrationManifest creates versioned snapshots of calibration state
  • Verify CalibrationComparisonEngine compares two manifests and reports trust score drift
  • Verify DefaultTrustVectors provides correct baseline values for vendor, distro, and internal sources
  • Verify SourceClassificationService classifies new VEX sources into correct categories
  • Verify individual scorers (Freshness, Provenance, Coverage, Replayability) contribute weighted scores to the trust vector