2.0 KiB
2.0 KiB
Model Version Change Detection
Module
Scanner
Status
IMPLEMENTED
Description
Change detection for EPSS model version updates that suppresses noisy deltas when the underlying model changes, preventing false signal cascades.
Implementation Details
- EPSS Model Version Tracking:
src/Scanner/__Libraries/StellaOps.Scanner.Storage/Epss/EpssCsvStreamParser.cs-EpssCsvStreamParserdetects model version tags (e.g.,v2024.01.15) from EPSS CSV data feeds and tracks version changessrc/Scanner/__Libraries/StellaOps.Scanner.Storage/Epss/EpssExplainHashCalculator.cs-EpssExplainHashCalculatorincludesModelVersionin explain hash calculations to distinguish model-driven vs real-world score changes
- Change Detection:
src/Scanner/__Libraries/StellaOps.Scanner.Storage/Epss/EpssChangeDetector.cs-EpssChangeDetectordetects score changes between EPSS updatessrc/Scanner/__Libraries/StellaOps.Scanner.Storage/Epss/EpssChangeRecord.cs-EpssChangeRecordmodel for recording detected changes with model version context
- Events:
src/Scanner/__Libraries/StellaOps.Scanner.Storage/Epss/Events/EpssUpdatedEvent.cs-EpssUpdatedEventincludesModelVersionTagto flag model-version-driven updatessrc/Scanner/__Libraries/StellaOps.Scanner.Storage/Epss/EpssReplayService.cs-EpssReplayServicereplays EPSS data with model version awareness for noise suppression
E2E Test Plan
- Ingest two EPSS CSV feeds with the same model version and verify genuine score changes are detected
- Ingest an EPSS CSV feed with a new model version tag and verify the model version change is detected
- Verify that when a model version changes, score deltas are flagged as model-driven rather than generating false signal cascades
- Verify the explain hash includes model version so that model-change deltas are distinguishable from real-world changes
- Verify the replay service correctly handles model version transitions without generating spurious change events