Verify supported-route live search matrix

This commit is contained in:
master
2026-03-08 02:23:58 +02:00
parent 145e67a544
commit 93872e73ec
3 changed files with 235 additions and 47 deletions

View File

@@ -21,7 +21,7 @@
## Delivery Tracker
### QA-SF-001 - Add supported-route live preflight and corpus readiness checks
Status: TODO
Status: DONE
Dependency: none
Owners: Test Automation
Task description:
@@ -29,12 +29,12 @@ Task description:
- Fail fast on empty or unsupported corpora instead of letting dead suggestions surface as flaky UI failures.
Completion criteria:
- [ ] Live tests verify the rebuild order and supported-route readiness before UI assertions.
- [ ] Unsupported routes are skipped explicitly, not treated as passing suggestion coverage.
- [ ] Empty corpora fail the suite clearly.
- [x] Live tests verify the rebuild order and supported-route readiness before UI assertions.
- [x] Unsupported routes are skipped explicitly, not treated as passing suggestion coverage.
- [x] Empty corpora fail the suite clearly.
### QA-SF-002 - Execute surfaced suggestions on supported routes
Status: TODO
Status: DONE
Dependency: QA-SF-001
Owners: Test Automation
Task description:
@@ -42,12 +42,12 @@ Task description:
- Cover assistant handoff from the grounded answer path as part of the same journey.
Completion criteria:
- [ ] Every surfaced starter on covered live routes is executed in Playwright.
- [ ] The route-level suite verifies grounded answers or visible useful cards, not just non-empty DOM.
- [ ] Assistant handoff keeps the current page context.
- [x] Every surfaced starter on covered live routes is executed in Playwright.
- [x] The route-level suite verifies grounded answers or visible useful cards, not just non-empty DOM.
- [x] Assistant handoff keeps the current page context.
### QA-SF-003 - Keep deterministic shell regression aligned with live proof
Status: TODO
Status: DONE
Dependency: QA-SF-002
Owners: Developer, Test Automation
Task description:
@@ -55,18 +55,20 @@ Task description:
- Keep the suites readable and route-specific rather than one monolithic soak.
Completion criteria:
- [ ] Deterministic and live suites assert the same search-first product rules.
- [ ] Covered routes include at least Doctor plus every additional supported ingested route.
- [ ] The execution log records exact commands and results.
- [x] Deterministic and live suites assert the same search-first product rules.
- [x] Covered routes include at least Doctor plus every additional supported ingested route.
- [x] The execution log records exact commands and results.
## Execution Log
| Date (UTC) | Update | Owner |
| --- | --- | --- |
| 2026-03-07 | Sprint created for the supported-route live suggestion execution matrix in the final search-first correction pass. | Project Manager |
| 2026-03-08 | Completed the supported-route live matrix against a rebuilt local corpus and running Angular shell. Evidence: `.artifacts/stella-cli/StellaOps.Cli.exe advisoryai sources prepare --json`; `Invoke-RestMethod -Method Post http://127.0.0.1:10451/v1/advisory-ai/index/rebuild` with `X-StellaOps-Scopes: advisory-ai:admin`, `X-StellaOps-Tenant: test-tenant`, `X-StellaOps-Actor: playwright-live`; `Invoke-RestMethod -Method Post http://127.0.0.1:10451/v1/search/index/rebuild` with the same headers; `npm run serve:test`; `LIVE_ADVISORYAI_SEARCH_BASE_URL=http://127.0.0.1:10451 npx playwright test tests/e2e/unified-search-contextual-suggestions.e2e.spec.ts tests/e2e/unified-search-contextual-suggestions.live.e2e.spec.ts tests/e2e/unified-search-self-serve-answer-panel.e2e.spec.ts tests/e2e/unified-search-experience-quality.e2e.spec.ts --config playwright.config.ts` -> `24 passed`, `3 skipped`. | Test Automation |
## Decisions & Risks
- Decision: suggestion coverage is invalid unless the live corpus is rebuilt and non-empty.
- Decision: supported-route proof is part of search release quality, not an optional smoke test.
- Decision: local HTTP rebuilds require explicit StellaOps tenant/scope headers; `sources prepare` is the local CLI step, but index rebuilds remain authenticated backend operations.
- Risk: some routes may not yet have enough ingested corpus support to sustain live suggestion coverage.
- Mitigation: preflight route support explicitly and suppress unsupported suggestions in product code.
- Reference: `docs/modules/ui/search-zero-learning-primary-entry.md`