Files
git.stella-ops.org/docs/features/unchecked/cli/cli-commands-for-ground-truth-and-golden-set-management.md

1.7 KiB

CLI Commands for Ground-Truth and Golden Set Management

Module

Cli

Status

IMPLEMENTED

Description

CLI command groups for ground-truth management (stella groundtruth) and golden set operations including fix verification commands.

Implementation Details

  • Ground Truth Command Group: src/Cli/StellaOps.Cli/Commands/GroundTruthCommandGroup.cs -- GroundTruthCommandGroup for stella groundtruth commands
  • Ground Truth Validation: src/Cli/Commands/GroundTruth/GroundTruthValidateCommands.cs -- validation commands for ground-truth datasets
  • Golden Set Command Group: src/Cli/StellaOps.Cli/Commands/GoldenSet/GoldenSetCommandGroup.cs -- golden set operations
  • Fix Verification: src/Cli/StellaOps.Cli/Commands/GoldenSet/VerifyFixCommandGroup.cs -- verify fix commands for golden set
  • Commands:
    • stella groundtruth list -- list ground-truth datasets
    • stella groundtruth validate -- validate ground-truth data integrity
    • stella groundtruth import -- import ground-truth datasets
    • stella golden list -- list golden sets
    • stella golden verify-fix -- verify fixes against golden set expectations
  • Tests: src/Cli/__Tests/StellaOps.Cli.Tests/GoldenOutput/ -- golden output test suite

E2E Test Plan

  • Run stella groundtruth list and verify ground-truth datasets displayed
  • Run stella groundtruth validate and verify data integrity validation
  • Run stella groundtruth import <path> and verify dataset imported
  • Run stella golden list and verify golden sets listed
  • Run stella golden verify-fix <digest> and verify fix verification against golden set
  • Verify golden output tests pass deterministically
  • Verify error handling for invalid ground-truth data