stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity
Files
4e5300660d55be9cbce0021a645936a5f8143a2e
git.stella-ops.org/docs/features/checked/advisoryai/advisoryai-pipeline-with-guardrails.md

3.3 KiB
Raw Blame History

AdvisoryAI Pipeline with Guardrails

Module

AdvisoryAI

Status

VERIFIED

Description

Full advisory AI pipeline with guardrails, chat interface, action execution, and idempotency handling. Includes retrieval, structured/vector retrievers, and SBOM context retrieval.

Implementation Details

  • Modules: src/AdvisoryAi/StellaOps.AdvisoryAI/, src/AdvisoryAi/StellaOps.AdvisoryAI.Hosting/
  • Key Classes:
    • AdvisoryGuardrailPipeline (src/AdvisoryAi/StellaOps.AdvisoryAI/Guardrails/AdvisoryGuardrailPipeline.cs) - guardrail pipeline filtering AI inputs and outputs
    • AdvisoryPipelineOrchestrator (src/AdvisoryAi/StellaOps.AdvisoryAI/Orchestration/AdvisoryPipelineOrchestrator.cs) - orchestrates pipeline stages with guardrail checks
    • AdvisoryPipelineExecutor (src/AdvisoryAi/StellaOps.AdvisoryAI/Execution/AdvisoryPipelineExecutor.cs) - executes pipeline with pre/post guardrails
    • AdvisoryStructuredRetriever (src/AdvisoryAi/StellaOps.AdvisoryAI/Retrievers/AdvisoryStructuredRetriever.cs) - retrieves structured advisory data
    • AdvisoryVectorRetriever (src/AdvisoryAi/StellaOps.AdvisoryAI/Retrievers/AdvisoryVectorRetriever.cs) - vector-based semantic retrieval
    • SbomContextRetriever (src/AdvisoryAi/StellaOps.AdvisoryAI/Retrievers/SbomContextRetriever.cs) - retrieves SBOM context for vulnerability analysis
    • ActionExecutor (src/AdvisoryAi/StellaOps.AdvisoryAI/Actions/ActionExecutor.cs) - executes AI-proposed actions
    • IdempotencyHandler (src/AdvisoryAi/StellaOps.AdvisoryAI/Actions/IdempotencyHandler.cs) - ensures idempotent action execution
    • GuardrailAllowlistLoader (src/AdvisoryAi/StellaOps.AdvisoryAI.Hosting/GuardrailAllowlistLoader.cs) - loads guardrail allowlists from configuration
    • GuardrailPhraseLoader (src/AdvisoryAi/StellaOps.AdvisoryAI.Hosting/GuardrailPhraseLoader.cs) - loads guardrail phrase filters
    • AdvisoryAiGuardrailOptions (src/AdvisoryAi/StellaOps.AdvisoryAI.Hosting/AdvisoryAiGuardrailOptions.cs) - guardrail configuration options
  • Interfaces: IAdvisoryStructuredRetriever, IAdvisoryVectorRetriever, ISbomContextRetriever, IActionExecutor, IIdempotencyHandler
  • Source: Feature matrix scan

E2E Test Plan

  • Submit a prompt through AdvisoryGuardrailPipeline and verify guardrails filter prohibited content before reaching LLM
  • Verify AdvisoryStructuredRetriever returns relevant CVE/advisory data for a given vulnerability query
  • Verify AdvisoryVectorRetriever performs semantic search and returns ranked results
  • Verify SbomContextRetriever enriches prompts with SBOM component context
  • Execute an action through ActionExecutor and verify IdempotencyHandler prevents duplicate execution
  • Verify GuardrailAllowlistLoader and GuardrailPhraseLoader correctly load and enforce content filters
  • Verify the full pipeline flow: retrieval -> guardrail check -> LLM inference -> output guardrail -> response

Verification

  • Verified on 2026-02-11 via run-001.
  • Tier 0: docs/qa/feature-checks/runs/advisoryai/advisoryai-pipeline-with-guardrails/run-001/tier0-source-check.json
  • Tier 1: docs/qa/feature-checks/runs/advisoryai/advisoryai-pipeline-with-guardrails/run-001/tier1-build-check.json
  • Tier 2: docs/qa/feature-checks/runs/advisoryai/advisoryai-pipeline-with-guardrails/run-001/tier2-integration-check.json