stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity

Archive completed search correction sprints 031-034

Browse Source
This commit is contained in:
master
2026-03-08 02:23:07 +02:00
parent 484abe0039
commit c7b7ddf436
6 changed files with 0 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

77
docs-archived/implplan/SPRINT_20260307_031_DOCS_search_operator_correction_phases.md Normal file
View File

@@ -0,0 +1,77 @@
# Sprint 20260307-031 - Search Operator Correction Phases
## Topic & Scope
- Convert fresh operator feedback from live search use into explicit product rules and execution phases.
- Close the gap between "search-first on paper" and the actual shipped interaction model.
- Publish the next implementation phases so FE, AdvisoryAI, and E2E work align on one zero-learning experience.
- Working directory: `docs/`.
- Expected evidence: updated why/how documentation, new phased sprint files, and a docs-only commit.
## Dependencies & Concurrency
- Extends `SPRINT_20260307_025_DOCS_search_consolidation_corrective_phases.md`.
- Extends `SPRINT_20260307_028_AdvisoryAI_consolidated_ranking_blending_and_optional_telemetry.md`.
- Safe parallelism: implementation may start in `src/Web/StellaOps.Web/**`, `src/AdvisoryAI/**`, and `src/Web/StellaOps.Web/tests/e2e/**` once these rules are published.
## Documentation Prerequisites
- `docs/modules/ui/search-zero-learning-primary-entry.md`
- `docs/modules/advisory-ai/knowledge-search.md`
- `docs/modules/advisory-ai/unified-search-architecture.md`
- `src/AdvisoryAI/__Tests/INFRASTRUCTURE.md`
## Delivery Tracker
### DOCS-ZL2-001 - Capture live operator objections as product rules
Status: DONE
Dependency: none
Owners: Project Manager, Documentation author
Task description:
- Record the specific failures reported from real use of the consolidated search: assistant/search split, leftover mode thinking, exposed scope mechanics, misplaced `Did you mean`, dead suggestions, and history pollution from failed searches.
- Translate those into product rules that are precise enough to guide implementation and reject regressions.
Completion criteria:
- [x] The why/how doc records the live operator objections explicitly.
- [x] The rules state that search is primary and AdvisoryAI is secondary.
- [x] The rules state that telemetry is optional and suggestion viability depends on corpus readiness.
### DOCS-ZL2-002 - Publish implementation phases with single-directory ownership
Status: DONE
Dependency: DOCS-ZL2-001
Owners: Project Manager
Task description:
- Break the follow-up work into implementation phases that can be executed and committed independently.
- Each phase must have a single owning directory, explicit dependencies, and non-ambiguous completion criteria.
Completion criteria:
- [x] Separate sprint files exist for FE surface cleanup, AdvisoryAI query/viability hardening, and live E2E verification.
- [x] Each sprint includes exact tests and evidence expectations.
- [x] Dependencies and safe parallelism notes are explicit.
### DOCS-ZL2-003 - Publish setup and live validation expectations
Status: DONE
Dependency: DOCS-ZL2-002
Owners: Documentation author
Task description:
- Make the live validation path explicit: corpus rebuild order, CLI compile-or-source-run expectations, and the rule that search suggestion coverage is invalid when the corpus is empty even if service health is green.
- Keep the docs concise and operator-focused.
Completion criteria:
- [x] The doc links to the compiled CLI or `dotnet run` fallback guidance already in the repo.
- [x] The phase stack explicitly requires ingestion-backed validation.
- [x] The decisions section references the updated why/how doc.
## Execution Log
| Date (UTC) | Update | Owner |
| --- | --- | --- |
| 2026-03-07 | Sprint created to turn live operator search feedback into phased corrective work with explicit ownership and test gates. | Project Manager |
| 2026-03-07 | Published operator-correction rules in `search-zero-learning-primary-entry.md`, added FE/backend/live-E2E phase sprints, and wired ingestion-backed validation plus optional-telemetry expectations into the phase stack. | Project Manager |
## Decisions & Risks
- Decision: the product no longer asks the user to understand search modes, scope toggles, or recovery mechanics.
- Decision: suggestion executability is part of product correctness, not a nice-to-have.
- Risk: previous corrective work removed some visible controls but left hidden dependencies in FE contracts and history storage.
- Mitigation: phase the correction pass into FE cleanup, backend contract hardening, and live-ingested E2E gates.
- Reference: `docs/modules/ui/search-zero-learning-primary-entry.md`
## Next Checkpoints
- 2026-03-08: publish the correction phases and start FE surface cleanup.
- 2026-03-09: start backend query-understanding and suggestion viability hardening.

87
docs-archived/implplan/SPRINT_20260307_032_FE_search_primary_surface_cleanup.md Normal file
View File

@@ -0,0 +1,87 @@
# Sprint 20260307-032 - FE Search Primary Surface Cleanup
## Topic & Scope
- Finish the search-first surface so operators can use it without learning Stella-specific search mechanics.
- Remove the remaining FE mode residue, simplify correction/result cues, and make recent history truly success-only.
- Keep the assistant as a secondary action launched beside search or from grounded answers.
- Working directory: `src/Web/StellaOps.Web/`.
- Expected evidence: FE implementation, targeted unit tests, Playwright regression coverage, and a scoped commit.
## Dependencies & Concurrency
- Depends on `SPRINT_20260307_031_DOCS_search_operator_correction_phases.md`.
- Informs `SPRINT_20260307_033_AdvisoryAI_search_query_understanding_and_viability.md`.
- Safe parallelism: backend work may proceed in `src/AdvisoryAI/**` if it does not break the current Web contract before this sprint lands.
## Documentation Prerequisites
- `docs/modules/ui/search-zero-learning-primary-entry.md`
- `src/Web/StellaOps.Web/AGENTS.md`
## Delivery Tracker
### FE-ZL2-001 - Remove remaining FE mode dependencies
Status: DONE
Dependency: none
Owners: Developer
Task description:
- Remove `Find / Explain / Act` as a frontend concept, not just as a visible control.
- Eliminate mode-driven prompt helpers and chip/question filtering from the shared search context contracts and FE composition paths.
Completion criteria:
- [x] Search and assistant FE code no longer depend on `SearchExperienceModeService`.
- [x] Page-owned search contracts do not use `preferredModes`.
- [x] Search-to-chat prompts derive from query, route, evidence, and last actions only.
### FE-ZL2-002 - Tighten the primary search surface
Status: DONE
Dependency: FE-ZL2-001
Owners: Developer
Task description:
- Keep the assistant launcher beside the search input, move `Did you mean` directly below the field, and simplify operator-facing labels.
- Remove residual explanatory clutter that teaches the system instead of helping the user search.
Completion criteria:
- [x] `Did you mean` renders as an input-adjacent correction cue.
- [x] Empty-state starters stay concise and executable with no ranking-mechanics copy.
- [x] Result labels use plain operator language for in-scope and spillover sections.
### FE-ZL2-003 - Migrate recent history to a success-only contract
Status: DONE
Dependency: FE-ZL2-002
Owners: Developer
Task description:
- Replace the legacy bare-string history store with a structured success-only format.
- Drop old failed or unknown legacy entries on load so history reflects only searches that actually worked.
Completion criteria:
- [x] Local recent history stores structured successful entries rather than bare strings.
- [x] Legacy entries are ignored unless they can be confirmed from server history as successful.
- [x] No-result searches never reappear after reload.
### FE-ZL2-004 - Verify the simplified search surface
Status: DONE
Dependency: FE-ZL2-003
Owners: Developer, Test Automation
Task description:
- Add targeted Angular and Playwright coverage for the simplified search model.
- Tests must prove the removal of FE modes, input-adjacent correction cues, and success-only history behavior.
Completion criteria:
- [x] Angular tests cover history migration and no-mode FE composition.
- [x] Playwright covers input correction placement, success-only history, and assistant launch from the field.
- [x] No route-jump or visible scope/mode controls remain in covered flows.
## Execution Log
| Date (UTC) | Update | Owner |
| --- | --- | --- |
| 2026-03-07 | Sprint created for the FE half of the operator correction pass on global search. | Project Manager |
| 2026-03-07 | Removed the FE mode contract (`SearchExperienceModeService`, `preferredModes`), migrated successful history to `stella-successful-searches-v3`, simplified overflow/correction copy, and verified with targeted Angular tests plus deterministic and live Playwright suggestion suites. Commands: `npm test -- --include src/tests/context/ambient-context.service.spec.ts --include src/tests/global_search/global-search.component.spec.ts`; `npx playwright test tests/e2e/unified-search-contextual-suggestions.e2e.spec.ts tests/e2e/unified-search-experience-quality.e2e.spec.ts tests/e2e/unified-search-self-serve-answer-panel.e2e.spec.ts --config playwright.config.ts`; `LIVE_ADVISORYAI_SEARCH_BASE_URL=http://127.0.0.1:10451 npx playwright test tests/e2e/unified-search-contextual-suggestions.live.e2e.spec.ts --config playwright.config.ts`. Results: `32/32` Angular tests passed, `14/14` deterministic Playwright tests passed, and `5/5` live Doctor suggestion tests passed. | Developer / Test Automation |
## Decisions & Risks
- Decision: search surface simplification is not cosmetic; it removes product concepts the operator should never need to learn.
- Risk: FE still carries hidden mode-specific behavior in contracts and helper services.
- Mitigation: remove the mode service and related contract fields as part of this sprint rather than hiding them behind UI changes.
- Reference: `docs/modules/ui/search-zero-learning-primary-entry.md`
## Next Checkpoints
- 2026-03-08: remove FE mode dependencies and simplify the input/result surface.
- 2026-03-08: land history migration and deterministic regression coverage.

77
docs-archived/implplan/SPRINT_20260307_033_AdvisoryAI_search_query_understanding_and_viability.md Normal file
View File

@@ -0,0 +1,77 @@
# Sprint 20260307-033 - AdvisoryAI Search Query Understanding And Viability
## Topic & Scope
- Make unified search infer answer shape from the query and context instead of relying on frontend mode hints.
- Harden suggestion viability so the UI can suppress dead suggestions when the corpus is empty, stale, or unsupported for the current route.
- Keep telemetry fully optional and separate from retrieval correctness.
- Working directory: `src/AdvisoryAI/`.
- Expected evidence: backend contract/logic changes, focused service/integration tests, and a scoped commit.
## Dependencies & Concurrency
- Depends on `SPRINT_20260307_031_DOCS_search_operator_correction_phases.md`.
- Builds on `SPRINT_20260307_028_AdvisoryAI_consolidated_ranking_blending_and_optional_telemetry.md`.
- Safe parallelism: FE surface work in `src/Web/StellaOps.Web/**` may proceed as long as the additive contracts remain backward-compatible until both sprints land.
## Documentation Prerequisites
- `docs/modules/ui/search-zero-learning-primary-entry.md`
- `docs/modules/advisory-ai/knowledge-search.md`
- `docs/modules/advisory-ai/unified-search-architecture.md`
- `src/AdvisoryAI/AGENTS.md`
## Delivery Tracker
### AI-ZL2-001 - Remove mode-shaped answer assumptions from unified search
Status: DONE
Dependency: none
Owners: Developer
Task description:
- Ensure the backend answer path derives decisive vs blended vs clarify behavior from query structure, route context, evidence distribution, and recent actions.
- Do not require FE mode hints to choose answer behavior.
Completion criteria:
- [ ] Unified search answer behavior no longer depends on FE mode fields.
- [ ] Tests prove query/context-driven decisive and blended answers.
- [ ] Clarify and insufficient fallbacks remain deterministic.
### AI-ZL2-002 - Strengthen suggestion viability and corpus readiness signals
Status: DONE
Dependency: AI-ZL2-001
Owners: Developer
Task description:
- Expand suggestion viability responses so FE can distinguish a genuinely viable suggestion from empty-corpus or unsupported-domain states.
- Keep the response bounded and deterministic.
Completion criteria:
- [ ] Viability responses differentiate viable, no-match, and corpus-readiness failures.
- [ ] Empty corpus or missing supported projections suppress suggestions cleanly.
- [ ] Integration tests cover live-readiness and empty-corpus behavior.
### AI-ZL2-003 - Keep telemetry optional and non-blocking
Status: DONE
Dependency: AI-ZL2-002
Owners: Developer
Task description:
- Preserve the optional telemetry posture while the new viability and answer behavior land.
- Search correctness, history, and suggestion gating must work with telemetry disabled.
Completion criteria:
- [ ] Telemetry-disabled paths still return identical retrieval and viability behavior.
- [ ] Tests prove analytics and feedback remain disabled while search works.
- [ ] Docs state that viability and history do not depend on telemetry.
## Execution Log
| Date (UTC) | Update | Owner |
| --- | --- | --- |
| 2026-03-07 | Sprint created for the backend half of the operator correction pass on unified search. | Project Manager |
| 2026-03-07 | Implementation started: tightening query-driven answer shaping, corpus-readiness-aware suggestion viability, and telemetry-disabled parity before rerunning backend and Playwright suggestion suites. | Developer |
| 2026-03-07 | Completed backend query-driven answer shaping, grounded-only suggestion viability, and telemetry-off parity. Evidence: `dotnet build src/AdvisoryAI/__Tests/StellaOps.AdvisoryAI.Tests/StellaOps.AdvisoryAI.Tests.csproj -v minimal -p:BuildInParallel=false -p:UseSharedCompilation=false`; `StellaOps.AdvisoryAI.Tests.exe -class StellaOps.AdvisoryAI.Tests.UnifiedSearch.UnifiedSearchServiceTests`; `StellaOps.AdvisoryAI.Tests.exe -class StellaOps.AdvisoryAI.Tests.Integration.UnifiedSearchEndpointsIntegrationTests`; `StellaOps.AdvisoryAI.Tests.exe -class StellaOps.AdvisoryAI.Tests.UnifiedSearch.SearchAnalyticsServiceTests`; `StellaOps.AdvisoryAI.Tests.exe -class StellaOps.AdvisoryAI.Tests.UnifiedSearch.SearchQualityMonitorTests`; live query `database connectivity` returned `contextAnswer.status = grounded`. | Developer |
## Decisions & Risks
- Decision: FE should not be responsible for choosing answer mode or rescuing dead suggestions.
- Risk: if viability is too coarse, FE will still surface suggestions that fail in live corpora.
- Mitigation: return explicit bounded viability states and keep live-ingested tests as the final gate.
- Reference: `docs/modules/ui/search-zero-learning-primary-entry.md`
## Next Checkpoints
- 2026-03-09: land query/context-driven answer shaping.
- 2026-03-09: land stricter suggestion viability states and backend tests.

76
docs-archived/implplan/SPRINT_20260307_034_FE_live_search_readiness_matrix.md Normal file
View File

@@ -0,0 +1,76 @@
# Sprint 20260307-034 - FE Live Search Readiness Matrix
## Topic & Scope
- Prove the operator-corrected search experience with deterministic and live-ingested Playwright coverage.
- Fail early when corpus rebuilds are missing, the local CLI is uncompiled, or the active corpora cannot support surfaced suggestions.
- Keep telemetry-off behavior covered so optional analytics never become a hidden dependency.
- Working directory: `src/Web/StellaOps.Web/tests/e2e/`.
- Expected evidence: Playwright suites, exact setup commands, execution logs, and a scoped commit.
## Dependencies & Concurrency
- Depends on `SPRINT_20260307_032_FE_search_primary_surface_cleanup.md`.
- Depends on `SPRINT_20260307_033_AdvisoryAI_search_query_understanding_and_viability.md`.
- Safe parallelism: live suites may run in parallel only when each suite uses isolated services or a read-only prepared corpus.
## Documentation Prerequisites
- `docs/modules/ui/search-zero-learning-primary-entry.md`
- `docs/modules/advisory-ai/knowledge-search.md`
- `src/AdvisoryAI/__Tests/INFRASTRUCTURE.md`
## Delivery Tracker
### QA-ZL2-001 - Expand deterministic Playwright for the simplified surface
Status: DONE
Dependency: none
Owners: Test Automation
Task description:
- Cover the simplified top-bar search experience with deterministic mocks.
- Prove correction placement, assistant launch, success-only history, and no dead-end starter flows.
Completion criteria:
- [ ] Deterministic E2E covers `Did you mean` placement, assistant launch, success-only history, and spillover rendering.
- [ ] Covered flows have no visible scope/mode controls.
- [ ] Covered starter chips always land on a meaningful result or explicit grounded fallback.
### QA-ZL2-002 - Run live ingestion-backed suggestion and readiness matrix
Status: DONE
Dependency: QA-ZL2-001
Owners: Test Automation
Task description:
- Rebuild live corpora using the documented CLI compile-or-source-run path and verify corpus readiness before UI checks start.
- Execute surfaced suggestions on covered pages and fail on dead ends.
Completion criteria:
- [ ] Live suites preflight corpus readiness, not just process health.
- [ ] Every surfaced live suggestion on covered pages resolves to results or an explicit grounded fallback state.
- [ ] Execution logs record the exact rebuild and Playwright commands.
### QA-ZL2-003 - Verify telemetry-off search flows
Status: DONE
Dependency: QA-ZL2-002
Owners: Test Automation
Task description:
- Prove that the operator journey works with telemetry disabled or unavailable.
- Search and assistant deep-dive must keep functioning without analytics calls.
Completion criteria:
- [ ] Playwright covers a telemetry-off path.
- [ ] Search, answer rendering, suggestions, and assistant handoff still work.
- [ ] The execution log records the telemetry-off configuration and results.
## Execution Log
| Date (UTC) | Update | Owner |
| --- | --- | --- |
| 2026-03-07 | Sprint created to keep live-ingested suggestion correctness and telemetry-off behavior as explicit release gates. | Project Manager |
| 2026-03-07 | Added grounded-only live suggestion assertions, telemetry-off deterministic coverage, and reran the combined Playwright gate with live corpus preflight. Evidence: `.artifacts/stella-cli/StellaOps.Cli.exe advisoryai sources prepare --json`; `POST /v1/advisory-ai/index/rebuild`; `POST /v1/search/index/rebuild`; `npx playwright test tests/e2e/unified-search-experience-quality.e2e.spec.ts --config playwright.config.ts`; `LIVE_ADVISORYAI_SEARCH_BASE_URL=http://127.0.0.1:10451 npx playwright test tests/e2e/unified-search-contextual-suggestions.live.e2e.spec.ts --config playwright.config.ts`; final combined gate `20/20` passed. | Test Automation |
## Decisions & Risks
- Decision: live suggestion correctness is a product requirement; deterministic mocks alone are insufficient evidence.
- Decision: setup failures such as an uncompiled CLI or empty corpus must fail the suite early and clearly.
- Risk: corpus parity may remain uneven across domains.
- Mitigation: treat coverage per domain explicitly and only surface suggestions when the backed corpus can support them.
- Reference: `docs/modules/ui/search-zero-learning-primary-entry.md`
## Next Checkpoints
- 2026-03-10: run the live readiness matrix against the simplified FE surface.
- 2026-03-10: add telemetry-off E2E evidence for the corrected flow.

77
docs-archived/implplan/SPRINT_20260307_037_AdvisoryAI_search_answer_proof_and_weighting.md Normal file
View File

@@ -0,0 +1,77 @@
# Sprint 20260307-037 - AdvisoryAI Search Answer Proof and Weighting
## Topic & Scope
- Tighten backend unified search so automatic current-route weighting, overflow suppression, and blended answer composition feel decisive and trustworthy.
- Make suggestion viability and answer usefulness stricter so surfaced search starters do not survive on weak or clarify-only evidence.
- Preserve the rule that telemetry is optional and not part of search correctness.
- Working directory: `src/AdvisoryAI/`.
- Expected evidence: backend implementation, targeted tests, updated docs, and a scoped commit.
## Dependencies & Concurrency
- Depends on `SPRINT_20260307_035_DOCS_search_first_final_correction_phases.md`.
- Depends on `SPRINT_20260307_036_FE_search_first_shell_consolidation.md` for final FE phrasing, but contract work may proceed in parallel if additive.
- Informs `SPRINT_20260307_038_FE_live_search_supported_route_execution_matrix.md`.
## Documentation Prerequisites
- `docs/modules/ui/search-zero-learning-primary-entry.md`
- `docs/modules/advisory-ai/knowledge-search.md`
- `docs/modules/advisory-ai/unified-search-architecture.md`
- `src/AdvisoryAI/AGENTS.md`
## Delivery Tracker
### AI-SF-001 - Strengthen automatic in-scope weighting and overflow suppression
Status: TODO
Dependency: none
Owners: Developer
Task description:
- Tighten route, entity, and recent-action weighting so supported current-page answers win more consistently when the evidence is actually close.
- Keep overflow only when outside-scope evidence still materially improves the answer.
Completion criteria:
- [ ] Service tests cover current-route winners, close-score blends, and suppressed overflow cases.
- [ ] Coverage metadata still explains the winning scope without FE heuristics.
- [ ] Unsupported or weak current-scope corpora do not hide clearly better outside-scope answers.
### AI-SF-002 - Make blended answers and suggestion viability stricter
Status: TODO
Dependency: AI-SF-001
Owners: Developer
Task description:
- Refine context-answer composition so close clusters produce a short grounded blend and dominant results stay decisive.
- Keep suggestion viability grounded-only for surfaced chips and detect unsupported/empty corpora explicitly.
Completion criteria:
- [ ] Blended and dominant answer paths are tested separately.
- [ ] Clarify-only or unsupported suggestions do not pass visible viability.
- [ ] Corpus-readiness states remain explicit in the response contract.
### AI-SF-003 - Preserve optional telemetry and deterministic fallbacks
Status: TODO
Dependency: AI-SF-002
Owners: Developer
Task description:
- Keep analytics and feedback optional without changing search ranking, history semantics, or answer composition.
- Ensure the final correction pass does not reintroduce telemetry coupling.
Completion criteria:
- [ ] Search behavior remains stable with telemetry disabled.
- [ ] Tests cover telemetry-disabled search and suggestion flows.
- [ ] Docs state clearly that telemetry is optional infrastructure.
## Execution Log
| Date (UTC) | Update | Owner |
| --- | --- | --- |
| 2026-03-07 | Sprint created for the backend weighting and suggestion-proof half of the final search-first correction pass. | Project Manager |
## Decisions & Risks
- Decision: search answer shape is inferred, not selected by the operator.
- Decision: suggestion executability requires grounded evidence on supported routes.
- Decision: telemetry remains optional and separate from correctness.
- Risk: stricter viability may suppress too many starters unless corpus readiness is modeled accurately.
- Mitigation: add route-support and corpus-readiness test coverage instead of guessing in FE.
- Reference: `docs/modules/ui/search-zero-learning-primary-entry.md`
## Next Checkpoints
- 2026-03-09: land tighter weighting/blending tests and stricter suggestion gating.
- 2026-03-09: verify telemetry-disabled behavior remains unchanged.

77
docs-archived/implplan/SPRINT_20260307_038_FE_live_search_supported_route_execution_matrix.md Normal file
View File

@@ -0,0 +1,77 @@
# Sprint 20260307-038 - FE Live Search Supported Route Execution Matrix
## Topic & Scope
- Prove that surfaced search suggestions and answer paths work end to end on the supported live routes, not only on Doctor.
- Treat corpus rebuild, route support, and suggestion executability as release gates for the search-first UX.
- Expand Playwright verification across findings, policy, VEX, and the existing Doctor coverage where ingestion supports them.
- Working directory: `src/Web/StellaOps.Web/`.
- Expected evidence: live Playwright coverage, setup-proof docs when needed, and a scoped commit.
## Dependencies & Concurrency
- Depends on `SPRINT_20260307_035_DOCS_search_first_final_correction_phases.md`.
- Depends on `SPRINT_20260307_036_FE_search_first_shell_consolidation.md` and `SPRINT_20260307_037_AdvisoryAI_search_answer_proof_and_weighting.md`.
- Safe parallelism: deterministic FE-only tests may evolve independently as long as the live matrix assertions remain additive.
## Documentation Prerequisites
- `docs/modules/ui/search-zero-learning-primary-entry.md`
- `docs/modules/advisory-ai/knowledge-search.md`
- `src/AdvisoryAI/__Tests/INFRASTRUCTURE.md`
- `src/Web/StellaOps.Web/AGENTS.md`
## Delivery Tracker
### QA-SF-001 - Add supported-route live preflight and corpus readiness checks
Status: TODO
Dependency: none
Owners: Test Automation
Task description:
- Extend the live Playwright harness so it verifies route support and corpus readiness before the UI assertions begin.
- Fail fast on empty or unsupported corpora instead of letting dead suggestions surface as flaky UI failures.
Completion criteria:
- [ ] Live tests verify the rebuild order and supported-route readiness before UI assertions.
- [ ] Unsupported routes are skipped explicitly, not treated as passing suggestion coverage.
- [ ] Empty corpora fail the suite clearly.
### QA-SF-002 - Execute surfaced suggestions on supported routes
Status: TODO
Dependency: QA-SF-001
Owners: Test Automation
Task description:
- For each covered live route, open the search surface, capture the surfaced starter chips, execute them, and verify grounded or materially useful results.
- Cover assistant handoff from the grounded answer path as part of the same journey.
Completion criteria:
- [ ] Every surfaced starter on covered live routes is executed in Playwright.
- [ ] The route-level suite verifies grounded answers or visible useful cards, not just non-empty DOM.
- [ ] Assistant handoff keeps the current page context.
### QA-SF-003 - Keep deterministic shell regression aligned with live proof
Status: TODO
Dependency: QA-SF-002
Owners: Developer, Test Automation
Task description:
- Update deterministic Playwright coverage so the simplified shell behavior and the live-route behavior assert the same product rules.
- Keep the suites readable and route-specific rather than one monolithic soak.
Completion criteria:
- [ ] Deterministic and live suites assert the same search-first product rules.
- [ ] Covered routes include at least Doctor plus every additional supported ingested route.
- [ ] The execution log records exact commands and results.
## Execution Log
| Date (UTC) | Update | Owner |
| --- | --- | --- |
| 2026-03-07 | Sprint created for the supported-route live suggestion execution matrix in the final search-first correction pass. | Project Manager |
## Decisions & Risks
- Decision: suggestion coverage is invalid unless the live corpus is rebuilt and non-empty.
- Decision: supported-route proof is part of search release quality, not an optional smoke test.
- Risk: some routes may not yet have enough ingested corpus support to sustain live suggestion coverage.
- Mitigation: preflight route support explicitly and suppress unsupported suggestions in product code.
- Reference: `docs/modules/ui/search-zero-learning-primary-entry.md`
- Reference: `src/AdvisoryAI/__Tests/INFRASTRUCTURE.md`
## Next Checkpoints
- 2026-03-09: land live preflight and supported-route route matrix scaffolding.
- 2026-03-10: execute the first full live supported-route suggestion pass.