stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 16 Releases Wiki Activity
Files
69c59defdcef132dbb511fecfc75f14878ddf9fe
git.stella-ops.org/docs/implplan/SPRINT_110_ingestion_evidence.md
master 69c59defdc
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
Details
feat: Implement Runtime Facts ingestion service and NDJSON reader 
- Added RuntimeFactsNdjsonReader for reading NDJSON formatted runtime facts.
- Introduced IRuntimeFactsIngestionService interface and its implementation.
- Enhanced Program.cs to register new services and endpoints for runtime facts.
- Updated CallgraphIngestionService to include CAS URI in stored artifacts.
- Created RuntimeFactsValidationException for validation errors during ingestion.
- Added tests for RuntimeFactsIngestionService and RuntimeFactsNdjsonReader.
- Implemented SignalsSealedModeMonitor for compliance checks in sealed mode.
- Updated project dependencies for testing utilities.
2025-11-10 07:56:15 +02:00

14 KiB
Raw Blame History

Sprint 110 - Ingestion & Evidence

Active items only. Completed/historic work now resides in docs/implplan/archived/tasks.md (updated 2025-11-08).

Wave coordination

Wave Guild owners Shared prerequisites Status Notes
110.A AdvisoryAI Advisory AI Guild · Docs Guild · SBOM Service Guild Sprint 100.A – Attestor (closed 2025-11-09 per docs/implplan/archived/SPRINT_100_identity_signing.md) DOING Regression/perf suite (AIAI-31-009) and console doc (DOCS-AIAI-31-004) remain DOING; SBOM (SBOM-AIAI-31-001/003), CLI (CLI-VULN-29-001/CLI-VEX-30-001), Policy (POLICY-ENGINE-31-001), and DevOps (DEVOPS-AIAI-31-001) owners owe delivery ETA updates on 2025-11-10 so the CLI/policy/runbook docs can unblock.
110.B Concelier Concelier Core & WebService Guilds · Observability Guild · AirGap Guilds (Importer/Policy/Time) Sprint 100.A – Attestor DOING Paragraph chunk API shipped 2025-11-07; structured field/caching (CONCELIER-AIAI-31-002) is still TODO, telemetry (CONCELIER-AIAI-31-003) DOING, and air-gap/console/attestation tracks remain gated on Link-Not-Merge + Cartographer schema.
110.C Excititor Excititor WebService/Core Guilds · Observability Guild · Evidence Locker Guild Sprint 100.A – Attestor DOING Normalized justification projections (EXCITITOR-AIAI-31-001) are DOING; chunk API, telemetry, docs, attestation, and mirror backlog stay queued behind that work plus Link-Not-Merge / Cartographer prerequisites.
110.D Mirror Mirror Creator Guild · Exporter Guild · CLI Guild · AirGap Time Guild Sprint 100.A – Attestor TODO Wave remains TODO—MIRROR-CRT-56-001 has not started, so DSSE/TUF, OCI/time-anchor, CLI, and scheduling integrations cannot proceed.

Status Snapshot (2025-11-09)

  • Advisory AI (110.A) – WebService orchestration (AIAI-31-004), typed SBOM client/tooling (AIAI-31-002/003), guardrail pipeline (AIAI-31-005), and overview/API/architecture docs (DOCS-AIAI-31-001/002/003) are DONE; focus now sits on DOCS-AIAI-31-004 and AIAI-31-009 while CLI/policy/SBOM deliverables unblock the remaining docs.
    • 2025-11-09: AIAI-31-009 remains DOING after converting the guardrail harness into JSON fixtures, expanding property/perf coverage, and validating offline cache seeding; remote inference packaging (AIAI-31-008) is still TODO until the policy knob work in AIAI-31-006..007 completes.
    • 2025-11-09: DOCS-AIAI-31-004 continues DOING—guardrail/offline sections are drafted, but screenshots plus copy blocks wait on CONSOLE-VULN-29-001, CONSOLE-VEX-30-001, and EXCITITOR-CONSOLE-23-001.
    • SBOM-AIAI-31-003 and DOCS-AIAI-31-005/006/008/009 remain BLOCKED pending SBOM-AIAI-31-001, CLI-VULN-29-001, CLI-VEX-30-001, POLICY-ENGINE-31-001, and DEVOPS-AIAI-31-001.
  • Concelier (110.B) – /advisories/{advisoryKey}/chunks shipped on 2025-11-07 with tenant enforcement, chunk tuning knobs, and regression fixtures; structured field/caching work (CONCELIER-AIAI-31-002) is still TODO while telemetry/guardrail instrumentation (CONCELIER-AIAI-31-003) is DOING.
    • Air-gap provenance/staleness bundles (CONCELIER-AIRGAP-56-001 → CONCELIER-AIRGAP-58-001), console views/deltas (CONCELIER-CONSOLE-23-001..003), and attestation metadata (CONCELIER-ATTEST-73-001/002) remain TODO pending Link-Not-Merge plus Cartographer schema delivery.
    • Connector provenance refreshes FEEDCONN-ICSCISA-02-012 and FEEDCONN-KISA-02-008 are still overdue, leaving evidence parity gaps for those feeds.
  • Excititor (110.C) – Normalized VEX justification projections (EXCITITOR-AIAI-31-001) are DOING as of 2025-11-09; the downstream chunk API (EXCITITOR-AIAI-31-002), telemetry/guardrails (EXCITITOR-AIAI-31-003), docs/OpenAPI alignment (EXCITITOR-AIAI-31-004), and attestation payload work (EXCITITOR-ATTEST-*) stay TODO until that projection work plus Link-Not-Merge schema land.
    • Mirror/air-gap backlog (EXCITITOR-AIRGAP-56-001 .. EXCITITOR-AIRGAP-58-001) and connector provenance parity (EXCITITOR-CONN-TRUST-01-001) remain unscheduled, so Advisory AI cannot yet hydrate sealed VEX evidence or cite connector signatures.
  • Mirror (110.D) – MIRROR-CRT-56-001 (deterministic bundle assembler) has not kicked off, so DSSE/TUF (MIRROR-CRT-56-002), OCI exports (MIRROR-CRT-57-001), time anchors (MIRROR-CRT-57-002), CLI verbs (MIRROR-CRT-58-001), and Export Center automation (MIRROR-CRT-58-002) are all blocked.

Blockers & Overdue Follow-ups

  • Advisory AI customer-facing coverage remains blocked until SBOM-AIAI-31-001 exposes the /v1/sbom/context hand-off kit and until CLI-VULN-29-001, CLI-VEX-30-001, POLICY-ENGINE-31-001, and DEVOPS-AIAI-31-001 ship—keeping SBOM-AIAI-31-003 plus DOCS-AIAI-31-005/006/008/009 and the remote inference packaging work (AIAI-31-008) on hold.
  • CONCELIER-GRAPH-21-001, CONCELIER-GRAPH-21-002, and CONCELIER-GRAPH-21-005 remain BLOCKED awaiting CONCELIER-POLICY-20-002 outputs and Cartographer schema (CARTO-GRAPH-21-002), keeping downstream Excititor graph consumers on hold.
  • EXCITITOR-GRAPH-21-001, EXCITITOR-GRAPH-21-002, and EXCITITOR-GRAPH-21-005 stay BLOCKED until the same Cartographer/Link-Not-Merge prerequisites are delivered.
  • Connector provenance updates FEEDCONN-ICSCISA-02-012 (due 2025-10-23) and FEEDCONN-KISA-02-008 (due 2025-10-24) remain past due and need scheduling. FeedMerge coordination tasks have been dropped (no AOC policy/governance backing yet), so capacity shifts to schema/guard deliverables.
  • Mirror evidence work remains blocked until MIRROR-CRT-56-001 ships; align Export Center (EXPORT-OBS-51-001) and AirGap time anchor (AIRGAP-TIME-57-001) owners for kickoff.

Immediate actions (target: 2025-11-12)

  • Advisory AI – Land AIAI-31-009 test harness updates plus remote inference packaging (AIAI-31-008) once POLICY-ENGINE-31-001 and DEVOPS-AIAI-31-001 expose the required knobs; SBOM guild to deliver SBOM-AIAI-31-001 so SBOM-AIAI-31-003 and the CLI/policy/runbook docs can unblock.
  • Concelier – Finish CONCELIER-AIAI-31-002 structured fields/caching and wire CONCELIER-AIAI-31-003 telemetry before starting air-gap or console endpoints; hold daily sync with Cartographer owners on CONCELIER-LNM-21-201/202 + CARTO-GRAPH-21-002.
  • Excititor – Wrap EXCITITOR-AIAI-31-001 justification projections, then immediately stage EXCITITOR-AIAI-31-002/003 plus EXCITITOR-ATTEST-01-003 to keep Advisory AI evidence feeds parallel to Concelier.
  • Mirror – Schedule MIRROR-CRT-56-001 kickoff with Export Center/AirGap Time guilds, confirm EXPORT-OBS-51-001 + AIRGAP-TIME-57-001 owners, and pre-stage DSSE/TUF design notes so MIRROR-CRT-56-002 can start as soon as the assembler lands.
  • Downstream prep – Scanner (Sprint 130) and Policy/Vuln Explorer (Sprint 129) owners should review AIAI-31-009 outputs after 2025-11-10 to ensure schema expectations match; Concelier CONSOLE (23-001..003) and AIRGAP (56/57/58) leads need Link-Not-Merge dates set during the 2025-11-11 checkpoint; Excititor mirror/air-gap teams should stage EXCITITOR-AIRGAP-56/57/58 implementation plans; Mirror CLI/Export Center teams should assemble design notes ahead of MIRROR-CRT-56-002/58-001 once the assembler kickoff happens.

Wave detail references (2025-11-09)

  • 110.A AdvisoryAI (docs/implplan/SPRINT_111_advisoryai.md)
    DOCS-AIAI-31-004 remains DOING; DOCS-AIAI-31-005/006/008/009 are BLOCKED on CLI/POLICY/SBOM/DevOps dependencies; SBOM-AIAI-31-003 is still TODO awaiting SBOM-AIAI-31-001; AIAI-31-008 is TODO until guardrail knobs land, and AIAI-31-009 stays DOING with the expanded harness/perf coverage work.
  • 110.B Concelier (docs/implplan/SPRINT_112_concelier_i.md)
    CONCELIER-AIAI-31-002 is TODO while CONCELIER-AIAI-31-003 is DOING; all air-gap (CONCELIER-AIRGAP-56/57/58-*), attestation (CONCELIER-ATTEST-73-*), and console (CONCELIER-CONSOLE-23-*) tracks remain TODO pending Link-Not-Merge (CONCELIER-LNM-21-*) and Cartographer schema (CARTO-GRAPH-21-002) delivery.
  • 110.C Excititor (docs/implplan/SPRINT_119_excititor_i.md)
    EXCITITOR-AIAI-31-001 is DOING; EXCITITOR-AIAI-31-002/003/004, EXCITITOR-ATTEST-01-003/-73-001/-73-002, EXCITITOR-AIRGAP-56/57/58-* and EXCITITOR-CONN-TRUST-01-001 are all TODO awaiting the justification projection output plus Link-Not-Merge contracts.
  • 110.D Mirror (docs/implplan/SPRINT_125_mirror.md)
    Every MIRROR-CRT-56/57/58 task is still TODO; DSSE/TUF, OCI bundle, time-anchor, CLI, and Export Center automation cannot start until the deterministic bundle assembler (MIRROR-CRT-56-001) is underway with EXPORT-OBS-51-001 and AIRGAP-TIME-57-001 owners confirmed.

Downstream dependency rollup (snapshot: 2025-11-09)

Wave Dependent sprint(s) (selected) Impact if 110.* slips
110.A AdvisoryAI SPRINT_130_scanner_surface.md, SPRINT_129_policy_reasoning.md, SPRINT_513_provenance.md, SPRINT_514_sovereign_crypto_enablement.md Scanner analyzers need AdvisoryAI schemas/feeds, Policy/Vuln Explorer tracks cannot expose advisory reasoning, and provenance/sovereign crypto programs remain paused until evidence contracts land.
110.B Concelier SPRINT_113_concelier_ii.md, SPRINT_114_concelier_iii.md, SPRINT_115_concelier_iv.md Link-Not-Merge schema + observation APIs gate Concelier graph, telemetry, and orchestrator waves; Console/advisor UIs stay blocked.
110.C Excititor SPRINT_120_excititor_ii.md → SPRINT_124_excititor_vi.md VEX chunk/attestation phases cannot progress until Excititor.I ships justification projections/guardrails, delaying Lens, Policy, and Advisory AI parity for VEX evidence.
110.D Mirror SPRINT_125_mirror.md Export Center, CLI, and air-gap bundles rely on MIRROR-CRT-56-001; no downstream mirror automation can begin until the deterministic assembler is complete.

Interlocks & owners

Interlock Participants Needed artifact(s) Status / notes (2025-11-09)
Advisory AI customer surfaces Advisory AI Guild · SBOM Service Guild · CLI Guild · Policy Guild · DevOps Guild SBOM-AIAI-31-001, SBOM-AIAI-31-003, CLI-VULN-29-001, CLI-VEX-30-001, POLICY-ENGINE-31-001, DEVOPS-AIAI-31-001 SBOM hand-off kit + CLI/Policy knobs still pending; DOCS-AIAI-31-005/006/008/009 stay blocked until these artifacts ship.
Link-Not-Merge contract Concelier Core/WebService Guilds · Cartographer Guild · Platform Events Guild CONCELIER-LNM-21-001→21-203, CARTO-GRAPH-21-002, CONCELIER-GRAPH-21-001/002, CONCELIER-CONSOLE-23-001..003 Schema and observation APIs not started; Cartographer schema delivery remains the gate for CONCELIER-AIAI-31-002/003 and all console/air-gap tracks.
VEX justification + attestation Excititor WebService/Core Guilds · Observability Guild · Evidence Locker Guild · Cartographer Guild EXCITITOR-AIAI-31-001→31-004, EXCITITOR-ATTEST-01-003, EXCITITOR-ATTEST-73-001/002, EXCITITOR-AIRGAP-56/57/58-*, EXCITITOR-CONN-TRUST-01-001 Justification enrichment is DOING; every downstream chunk/telemetry/attestation/mirror task remains TODO pending that output plus Link-Not-Merge contracts.
Mirror evidence kickoff Mirror Creator Guild · Exporter Guild · AirGap Time Guild · Security Guild · CLI Guild MIRROR-CRT-56-001→56-002, MIRROR-CRT-57-001/002, MIRROR-CRT-58-001/002, EXPORT-OBS-51-001, EXPORT-OBS-54-001, AIRGAP-TIME-57-001, CLI-AIRGAP-56-001, PROV-OBS-53-001 No owner meeting yet; assembler (MIRROR-CRT-56-001) is still unscheduled, so DSSE/TUF, OCI, time-anchor, CLI, and Export Center hooks cannot start.

Upcoming checkpoints

Date (UTC) Focus Agenda / expected exit
2025-11-10 Advisory AI customer surfaces Confirm SBOM-AIAI-31-001 delivery slot, align CLI-VULN/CLI-VEX scope owners, and capture POLICY-ENGINE-31-001 + DEVOPS-AIAI-31-001 readiness so DOCS-AIAI-31-005/006/008/009 can resume.
2025-11-11 Link-Not-Merge contract Cartographer to present CARTO-GRAPH-21-002 schema draft, Concelier to commit dates for CONCELIER-LNM-21-001..003 and CONCELIER-AIAI-31-002/003 telemetry wiring.
2025-11-11 VEX justification + attestation Walk EXCITITOR-AIAI-31-001 output, sequence EXCITITOR-AIAI-31-002/003, and lock attestation backlog order (EXCITITOR-ATTEST-01-003, -73-001, -73-002).
2025-11-12 Mirror evidence kickoff Assign MIRROR-CRT-56-001 lead, confirm EXPORT-OBS-51-001/AIRGAP-TIME-57-001 owners, and outline DSSE/TUF design reviews for MIRROR-CRT-56-002.

Coordination log

Date Notes
2025-11-09 Sprint file refreshed with wave detail references, interlocks, and risk log; waiting on 2025-11-10/11/12 syncs for SBOM/CLI/POLICY/DevOps, Link-Not-Merge, Excititor justification, and Mirror assembler commitments.

Risk log (2025-11-09)

Risk Impact Mitigation / owner
SBOM/CLI/Policy/DevOps deliverables slip past 2025-11-12 Advisory AI CLI/docs remain blocked; downstream Scanner/Policy/Vuln Explorer sprints cannot validate schema feeds Capture ETAs during 2025-11-10 interlock; SBOM/CLI/Policy/DevOps guild leads to publish commit dates and update sprint rows immediately
Link-Not-Merge schema delays (CONCELIER-LNM-21-*, CARTO-GRAPH-21-002) Concelier evidence APIs, console views, and Excititor graph consumers cannot progress; Advisory AI loses deterministic Concelier feeds 2025-11-11 checkpoint to lock schema delivery; Cartographer + Concelier core owners to share migration plan and unblock CONCELIER-AIAI-31-002/003
Excititor justification/attestation backlog stalls Advisory AI cannot cite VEX evidence, Excititor attestation/air-gap tasks remain TODO, Mirror parity slips Excititor web/core leads to finish EXCITITOR-AIAI-31-001 and schedule EXCITITOR-AIAI-31-002/003 + ATTEST tasks during 2025-11-11 session
Mirror assembler lacks staffing (MIRROR-CRT-56-001) DSSE/TUF, OCI/time-anchor, CLI, Export Center automations cannot even start, blocking Wave 110.D and Sprint 125 entirely 2025-11-12 kickoff must assign an owner and confirm EXPORT-OBS/AIRGAP-TIME prerequisites; track progress daily until assembler code is in flight