61f963fd52
Some checks failed
Docs CI / lint-and-preview (push) Has been cancelled
- Added `LedgerMetrics` class to record write latency and total events for ledger operations. - Created comprehensive tests for Ruby packages endpoints, covering scenarios for missing inventory, successful retrieval, and identifier handling. - Introduced `TestSurfaceSecretsScope` for managing environment variables during tests. - Developed `ProvenanceMongoExtensions` for attaching DSSE provenance and trust information to event documents. - Implemented `EventProvenanceWriter` and `EventWriter` classes for managing event provenance in MongoDB. - Established MongoDB indexes for efficient querying of events based on provenance and trust. - Added models and JSON parsing logic for DSSE provenance and trust information.
15 KiB
15 KiB
Sprint 160 - Export & Evidence
Active items only. Completed/historic work now resides in docs/implplan/archived/tasks.md (updated 2025-11-08).
This file now only tracks the export & evidence status snapshot. Active backlog lives in Sprint 161+ files.
Wave coordination
| Wave | Guild owners | Shared prerequisites | Status | Notes |
|---|---|---|---|---|
| 160.A EvidenceLocker | Evidence Locker Guild · Security Guild · Docs Guild | Sprint 110.A – AdvisoryAI; Sprint 120.A – AirGap; Sprint 130.A – Scanner; Sprint 150.A – Orchestrator | BLOCKED (2025-11-12) | Waiting for orchestrator capsule data and AdvisoryAI evidence bundles to stabilize before wiring ingestion APIs. |
| 160.B ExportCenter | Exporter Service Guild · Mirror Creator Guild · DevOps Guild | Sprint 110.A – AdvisoryAI; Sprint 120.A – AirGap; Sprint 130.A – Scanner; Sprint 150.A – Orchestrator | BLOCKED (2025-11-12) | Profiles can begin once EvidenceLocker contracts are published; keep DSSE/attestation specs ready. |
| 160.C TimelineIndexer | Timeline Indexer Guild · Evidence Locker Guild · Security Guild | Sprint 110.A – AdvisoryAI; Sprint 120.A – AirGap; Sprint 130.A – Scanner; Sprint 150.A – Orchestrator | BLOCKED (2025-11-12) | Postgres/RLS scaffolding drafted; hold for event schemas from orchestrator/notifications. |
Sprint 160 - Export & Evidence
Detail trackers & next actions
160.A EvidenceLocker
- Detail trackers: SPRINT_161_evidencelocker.md (wave entry) and SPRINT_187_evidence_locker_cli_integration.md for CLI/replay integration follow-ups.
- Task radar (all TODO as of 2025-11-12):
EVID-REPLAY-187-001— add Evidence Locker replay bundle ingestion/retention APIs and document storage policy (src/EvidenceLocker/StellaOps.EvidenceLocker,docs/modules/evidence-locker/architecture.md).RUNBOOK-REPLAY-187-004&CLI-REPLAY-187-002— CLI + ops readiness for replay bundles (docs/runbooks/replay_ops.md, CLI module).EVID-CRYPTO-90-001— route hashing/signing/bundle encryption throughICryptoProviderRegistry/ICryptoHashperdocs/security/crypto-routing-audit-2025-11-07.md.
- Contracts: bundle packaging + DSSE layout documented in
docs/modules/evidence-locker/bundle-packaging.md(EVID-OBS-54-002); portable/incident modes live underdocs/modules/evidence-locker/incident-mode.md. - Gating dependencies: orchestrator capsule schema (
docs/events/orchestrator-scanner-events.md), AdvisoryAI evidence bundle payload notes, and replay ledger requirements fromdocs/replay/DETERMINISTIC_REPLAY.md. - Ready-to-start checklist: finalize ingest schema deltas, stage Replay Ledger ops drills, and publish the API surface summary into
SPRINT_161_evidencelocker.mdbefore moving items to DOING.
EvidenceLocker task snapshot (2025-11-12)
| Task ID | Scope | State | Notes / Owners |
|---|---|---|---|
| EVID-REPLAY-187-001 | Replay bundle ingestion + retention APIs | TODO | Evidence Locker Guild · docs/modules/evidence-locker/architecture.md |
| CLI-REPLAY-187-002 | CLI record/verify/replay UX | TODO | CLI Guild · docs/modules/cli/architecture.md |
| RUNBOOK-REPLAY-187-004 | Replay ops runbook + drills | TODO | Docs/Ops Guild · /docs/runbooks/replay_ops.md |
| EVID-CRYPTO-90-001 | Sovereign crypto routing | TODO | Evidence Locker + Security Guilds · ICryptoProviderRegistry integration |
160.B ExportCenter
- Detail trackers: SPRINT_162_exportcenter_i.md (mirror/bootstrap/attestation jobs,
DVOFF-64-002,EXPORT-AIRGAP-56/57/58,EXPORT-ATTEST-74/75,EXPORT-OAS-61/62) and SPRINT_163_exportcenter_ii.md (service automation, observability, notification hooks, crypto routingEXPORT-CRYPTO-90-001). - Task radar highlights:
- Mirror & bootstrap:
EXPORT-AIRGAP-56-001/002/003/004/005andEXPORT-AIRGAP-57-001,EXPORT-AIRGAP-58-001— build mirror bundles, bootstrap packs, portable evidence exports, and notifications. - Attestation bundles:
EXPORT-ATTEST-74-001/002andEXPORT-ATTEST-75-001/002— job implementation, CI/offline integration, CLI verify/import, and documentation (docs/modules/attestor/airgap.md). - API/OAS:
EXPORT-OAS-61-001/002,EXPORT-OAS-62-001,EXPORT-OAS-63-001— refreshed OpenAPI, discovery endpoint, SDK updates, deprecation headers. - Service/observability:
EXPORT-SVC-35-001…005,EXPORT-OBS-50/51/52, plusEXPORT-CRYPTO-90-001ensuring crypto routing parity with Evidence Locker.
- Mirror & bootstrap:
- Dependencies: EvidenceLocker contracts + DSSE proofs define digests; orchestration relies on Orchestrator events + Scheduler readiness; crypto routing must stay aligned with
docs/security/crypto-routing-audit-2025-11-07.md. - Ready-to-start checklist: confirm sealed bundle spec (from EvidenceLocker) is frozen, reconcile crypto provider matrix with RootPack deployments, and prep the DevPortal verification CLI scaffolding so
DVOFF-64-002can move immediately.
ExportCenter task snapshot (2025-11-12)
| Task ID | Scope | State | Notes / Owners |
|---|---|---|---|
| DVOFF-64-002 | DevPortal bundle verification CLI | TODO | DevPortal Offline + AirGap Controller Guilds |
| EXPORT-AIRGAP-56-001/002 | Mirror bundle + bootstrap pack profiles | TODO | Exporter + Mirror Creator + DevOps Guilds |
| EXPORT-AIRGAP-57-001 | Portable evidence export mode | TODO | Exporter Service + Evidence Locker Guild |
| EXPORT-ATTEST-74-001/002 | Attestation bundle job + CI integration | TODO | Attestation Bundle + Exporter Guilds |
| EXPORT-ATTEST-75-001/002 | CLI verify/import + offline kit integration | TODO | Attestation Bundle + CLI + Exporter Guilds |
| EXPORT-OAS-61/62/63 | OpenAPI refresh, discovery, SDK + deprecation headers | TODO | Exporter Service + API Governance + SDK Guilds |
| EXPORT-CRYPTO-90-001 | Sovereign crypto routing | TODO | Exporter Service + Security Guilds |
160.C TimelineIndexer
- Detail tracker: SPRINT_165_timelineindexer.md (TIMELINE-OBS-52-001…004 and TIMELINE-OBS-53-001 covering migrations, ingestion pipeline, APIs, RLS, and evidence linkage).
- Task radar:
TIMELINE-OBS-52-001— bootstrap service + Postgres migrations with deterministic scripts and RLS scaffolding.TIMELINE-OBS-52-002— event ingestion pipeline (NATS/Redis consumers, ordering, dedupe, trace correlation, metrics).TIMELINE-OBS-52-003— REST/gRPC APIs with filtering/pagination + OpenAPI contracts.TIMELINE-OBS-52-004— finalize RLS, scope checks, audit logging, legal hold enforcement tests.TIMELINE-OBS-53-001— evidence linkage endpoint returning signed manifest references.
- Dependencies: needs orchestrator/notifications event schemas plus EvidenceLocker digest references to land before Postgres migrations can be frozen; export bundle IDs must be stable to hydrate
/timeline/{id}/evidence. - Ready-to-start checklist: secure the event schema package, stage Postgres migration plan (including RLS policies) for review, and align ingest ordering semantics with Scheduler/ExportCenter event cadence.
TimelineIndexer task snapshot (2025-11-12)
| Task ID | Scope | State | Notes / Owners |
|---|---|---|---|
| TIMELINE-OBS-52-001 | Service bootstrap + Postgres migrations/RLS | TODO | Timeline Indexer Guild |
| TIMELINE-OBS-52-002 | Event ingestion pipeline + metrics | TODO | Timeline Indexer Guild |
| TIMELINE-OBS-52-003 | REST/gRPC APIs + OpenAPI contracts | TODO | Timeline Indexer Guild |
| TIMELINE-OBS-52-004 | RLS policies, audit logging, legal hold tests | TODO | Timeline Indexer + Security Guilds |
| TIMELINE-OBS-53-001 | Evidence linkage endpoint | TODO | Timeline Indexer + Evidence Locker Guilds |
Interlocks & readiness signals
| Dependency | Owner / Source | Impacts | Status / Next signal |
|---|---|---|---|
Orchestrator capsule & notifications schema (docs/events/orchestrator-scanner-events.md) |
Orchestrator Service Guild · Notifications Guild (Sprint 150.A + 140 wave) | 160.A, 160.B, 160.C | Pending schema drop scheduled for 2025-11-15 sync; unblock EvidenceLocker ingestion, ExportCenter notifications, and TimelineIndexer ordering once envelopes freeze. |
| AdvisoryAI evidence bundle schema & payload notes (Sprint 110.A) | AdvisoryAI Guild | 160.A, 160.B | Still stabilizing; EvidenceLocker cannot finalize DSSE manifests or digests until this contract lands. Follow up in AdvisoryAI stand-up on 2025-11-14. |
Replay ledger spec alignment (docs/replay/DETERMINISTIC_REPLAY.md, /docs/runbooks/replay_ops.md) |
Replay Delivery Guild (Sprint 187) | 160.A | Replay ops runbook exists (2025-11-03); EvidenceLocker must incorporate retention API shape before DOING. Track in EVID-REPLAY-187-001. |
Crypto routing parity (docs/security/crypto-routing-audit-2025-11-07.md) |
Security Guild + Export/Evidence teams (EVID-CRYPTO-90-001, EXPORT-CRYPTO-90-001) |
160.A, 160.B | Audit published 2025-11-07; both guilds must wire ICryptoProviderRegistry before enabling sovereign profiles. Target reenlist date: 2025-11-18 readiness review. |
DevPortal verification CLI scaffolding (DVOFF-64-002) |
DevPortal Offline Guild (Sprint 162) | 160.B | CLI still TODO; keep stella devportal verify bundle.tgz prototype ready so that once bundle contracts are signed, DOING can start within same sprint. |
DevPortal verification CLI scaffolding (DVOFF-64-002) |
DevPortal Offline Guild (Sprint 162) | 160.B | CLI still TODO; keep stella devportal verify bundle.tgz prototype ready so that once bundle contracts are signed, DOING can start within same sprint. |
Upcoming checkpoints (UTC)
| Date | Session / Owner | Target outcome | Fallback / Escalation |
|---|---|---|---|
| 2025-11-14 | AdvisoryAI stand-up (AdvisoryAI Guild) | Freeze evidence bundle schema + payload notes so EvidenceLocker can finalize DSSE manifests (blocked). | If schema slips, log BLOCKED status in Sprint 110 tracker and re-evaluate at 2025-11-18 review. |
| 2025-11-15 | Orchestrator + Notifications schema handoff (Orchestrator Service + Notifications Guilds) | Publish capsule envelopes & notification contracts required by EvidenceLocker ingest, ExportCenter notifications, TimelineIndexer ordering (blocked). | If envelopes not ready, escalate to Wave 150/140 leads and leave blockers noted here; defer DOING flips. |
| 2025-11-18 | Sovereign crypto readiness review (Security Guild + Evidence/Export teams) | Validate ICryptoProviderRegistry wiring plan for EVID-CRYPTO-90-001 & EXPORT-CRYPTO-90-001; green-light sovereign modes (blocked). |
If gating issues remain, file action items in Security board and hold related sprint tasks in TODO. |
| 2025-11-19 | DevPortal Offline CLI dry run (DevPortal Offline + AirGap Controller Guilds) | Demo stella devportal verify bundle.tgz using sample manifest to prove readiness once EvidenceLocker spec lands (blocked awaiting schema). |
If CLI not ready, update DVOFF-64-002 description with new ETA and note risk in Sprint 162 doc. |
Action tracker
| Wave | Immediate action | Owner(s) | Due | Status |
|---|---|---|---|---|
| 160.A EvidenceLocker | Draft ingest schema summary + Replay Ledger API notes into SPRINT_161_evidencelocker.md once orchestrator + AdvisoryAI schemas land. |
Evidence Locker Guild · Replay Delivery Guild | 2025-11-16 | Pending (blocked on Nov-14/15 checkpoints) |
| 160.A EvidenceLocker | Validate crypto provider registry plan for EVID-CRYPTO-90-001 ahead of the Nov-18 review. |
Evidence Locker Guild · Security Guild | 2025-11-17 | Risk: awaiting Security design feedback |
| 160.A EvidenceLocker | Prep CLI + ops teams for replay handoff (RUNBOOK-REPLAY-187-004, CLI-REPLAY-187-002) once Evidence Locker APIs are drafted. |
CLI Guild · Ops Guild · Evidence Locker Guild | 2025-11-18 | Pending |
| 160.B ExportCenter | Prepare DevPortal verification CLI prototype (DVOFF-64-002) covering manifest hash + DSSE verification flow. |
DevPortal Offline Guild · AirGap Controller Guild | 2025-11-19 | In progress (design draft shared; waiting on bundle schema) |
| 160.B ExportCenter | Align attestation bundle job + CLI verbs (EXPORT-ATTEST-74/75) with EvidenceLocker DSSE layout once published. |
Exporter Service Guild · Attestation Bundle Guild · CLI Guild | 2025-11-20 | Pending |
| 160.B ExportCenter | Stage crypto routing hooks in exporter service (EXPORT-CRYPTO-90-001) tied to the Nov-18 review. |
Exporter Service Guild · Security Guild | 2025-11-18 | Pending |
| 160.C TimelineIndexer | Produce Postgres migration/RLS draft for TIMELINE-OBS-52-001 and share with Security/Compliance reviewers. | Timeline Indexer Guild · Security Guild | 2025-11-18 | Pending |
| 160.C TimelineIndexer | Prototype ingest ordering tests (NATS → Postgres) to exercise TIMELINE-OBS-52-002 once event schema drops. | Timeline Indexer Guild | 2025-11-19 | Pending |
| 160.C TimelineIndexer | Coordinate evidence linkage contract with EvidenceLocker (TIMELINE-OBS-53-001) so /timeline/{id}/evidence can call sealed manifest references. |
Timeline Indexer Guild · Evidence Locker Guild | 2025-11-20 | Pending |
Risks & mitigations
| Risk | Impacted wave(s) | Severity | Mitigation / Owner |
|---|---|---|---|
| AdvisoryAI schema slips past 2025-11-14, delaying DSSE manifest freeze. | 160.A, 160.B | High | AdvisoryAI Guild to provide interim sample payloads; EvidenceLocker to stub schema adapters so ExportCenter can begin validation with mock data. |
| Orchestrator/Notifications schema handoff misses 2025-11-15 window. | 160.A, 160.B, 160.C | High | Escalate to Wave 150/140 leads, record BLOCKED status in both sprint docs, and schedule daily schema stand-ups until envelopes land. |
| Sovereign crypto routing design not ready by 2025-11-18 review. | 160.A, 160.B | Medium | Security Guild to publish ICryptoProviderRegistry reference implementation; Evidence/Export guilds to nominate fallback providers per profile. |
| DevPortal verification CLI lacks signed bundle fixtures for dry run. | 160.B | Medium | Exporter Guild to provide sample manifest + DSSE pair; DevPortal Offline Guild to script fake EvidenceLocker output for demo. |
| TimelineIndexer Postgres/RLS plan not reviewed before coding. | 160.C | Medium | Timeline Indexer Guild to share migration plan with Security/Compliance for async review; unblock coding by securing written approval in sprint doc. |
Status log
- 2025-11-12 — Snapshot refreshed; all Export & Evidence waves remain BLOCKED pending orchestrator capsule data, AdvisoryAI bundle schemas, and EvidenceLocker contracts. Re-evaluate readiness after the orchestrator + notifications schema handoff (target sync: 2025-11-15).
- 2025-11-12 (EOD) — Added checkpoint calendar, action tracker, and risk table to keep Wave 160 aligned on pre-work while dependencies stabilize; next update scheduled immediately after the AdvisoryAI + Orchestrator handoffs.