stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity
Files
cf5b72974f923126944f4dcd47e85864ebb31a3b
git.stella-ops.org/docs/features/unchecked/advisoryai/advisoryai-pipeline-with-guardrails.md

2.9 KiB
Raw Blame History

AdvisoryAI Pipeline with Guardrails

Module

AdvisoryAI

Status

IMPLEMENTED

Description

Full advisory AI pipeline with guardrails, chat interface, action execution, and idempotency handling. Includes retrieval, structured/vector retrievers, and SBOM context retrieval.

Implementation Details

  • Modules: src/AdvisoryAi/StellaOps.AdvisoryAI/, src/AdvisoryAi/StellaOps.AdvisoryAI.Hosting/
  • Key Classes:
    • AdvisoryGuardrailPipeline (src/AdvisoryAi/StellaOps.AdvisoryAI/Guardrails/AdvisoryGuardrailPipeline.cs) - guardrail pipeline filtering AI inputs and outputs
    • AdvisoryPipelineOrchestrator (src/AdvisoryAi/StellaOps.AdvisoryAI/Orchestration/AdvisoryPipelineOrchestrator.cs) - orchestrates pipeline stages with guardrail checks
    • AdvisoryPipelineExecutor (src/AdvisoryAi/StellaOps.AdvisoryAI/Execution/AdvisoryPipelineExecutor.cs) - executes pipeline with pre/post guardrails
    • AdvisoryStructuredRetriever (src/AdvisoryAi/StellaOps.AdvisoryAI/Retrievers/AdvisoryStructuredRetriever.cs) - retrieves structured advisory data
    • AdvisoryVectorRetriever (src/AdvisoryAi/StellaOps.AdvisoryAI/Retrievers/AdvisoryVectorRetriever.cs) - vector-based semantic retrieval
    • SbomContextRetriever (src/AdvisoryAi/StellaOps.AdvisoryAI/Retrievers/SbomContextRetriever.cs) - retrieves SBOM context for vulnerability analysis
    • ActionExecutor (src/AdvisoryAi/StellaOps.AdvisoryAI/Actions/ActionExecutor.cs) - executes AI-proposed actions
    • IdempotencyHandler (src/AdvisoryAi/StellaOps.AdvisoryAI/Actions/IdempotencyHandler.cs) - ensures idempotent action execution
    • GuardrailAllowlistLoader (src/AdvisoryAi/StellaOps.AdvisoryAI.Hosting/GuardrailAllowlistLoader.cs) - loads guardrail allowlists from configuration
    • GuardrailPhraseLoader (src/AdvisoryAi/StellaOps.AdvisoryAI.Hosting/GuardrailPhraseLoader.cs) - loads guardrail phrase filters
    • AdvisoryAiGuardrailOptions (src/AdvisoryAi/StellaOps.AdvisoryAI.Hosting/AdvisoryAiGuardrailOptions.cs) - guardrail configuration options
  • Interfaces: IAdvisoryStructuredRetriever, IAdvisoryVectorRetriever, ISbomContextRetriever, IActionExecutor, IIdempotencyHandler
  • Source: Feature matrix scan

E2E Test Plan

  • Submit a prompt through AdvisoryGuardrailPipeline and verify guardrails filter prohibited content before reaching LLM
  • Verify AdvisoryStructuredRetriever returns relevant CVE/advisory data for a given vulnerability query
  • Verify AdvisoryVectorRetriever performs semantic search and returns ranked results
  • Verify SbomContextRetriever enriches prompts with SBOM component context
  • Execute an action through ActionExecutor and verify IdempotencyHandler prevents duplicate execution
  • Verify GuardrailAllowlistLoader and GuardrailPhraseLoader correctly load and enforce content filters
  • Verify the full pipeline flow: retrieval -> guardrail check -> LLM inference -> output guardrail -> response