Verify supported-route live search matrix
This commit is contained in:
@@ -21,7 +21,7 @@
|
||||
## Delivery Tracker
|
||||
|
||||
### QA-SF-001 - Add supported-route live preflight and corpus readiness checks
|
||||
Status: TODO
|
||||
Status: DONE
|
||||
Dependency: none
|
||||
Owners: Test Automation
|
||||
Task description:
|
||||
@@ -29,12 +29,12 @@ Task description:
|
||||
- Fail fast on empty or unsupported corpora instead of letting dead suggestions surface as flaky UI failures.
|
||||
|
||||
Completion criteria:
|
||||
- [ ] Live tests verify the rebuild order and supported-route readiness before UI assertions.
|
||||
- [ ] Unsupported routes are skipped explicitly, not treated as passing suggestion coverage.
|
||||
- [ ] Empty corpora fail the suite clearly.
|
||||
- [x] Live tests verify the rebuild order and supported-route readiness before UI assertions.
|
||||
- [x] Unsupported routes are skipped explicitly, not treated as passing suggestion coverage.
|
||||
- [x] Empty corpora fail the suite clearly.
|
||||
|
||||
### QA-SF-002 - Execute surfaced suggestions on supported routes
|
||||
Status: TODO
|
||||
Status: DONE
|
||||
Dependency: QA-SF-001
|
||||
Owners: Test Automation
|
||||
Task description:
|
||||
@@ -42,12 +42,12 @@ Task description:
|
||||
- Cover assistant handoff from the grounded answer path as part of the same journey.
|
||||
|
||||
Completion criteria:
|
||||
- [ ] Every surfaced starter on covered live routes is executed in Playwright.
|
||||
- [ ] The route-level suite verifies grounded answers or visible useful cards, not just non-empty DOM.
|
||||
- [ ] Assistant handoff keeps the current page context.
|
||||
- [x] Every surfaced starter on covered live routes is executed in Playwright.
|
||||
- [x] The route-level suite verifies grounded answers or visible useful cards, not just non-empty DOM.
|
||||
- [x] Assistant handoff keeps the current page context.
|
||||
|
||||
### QA-SF-003 - Keep deterministic shell regression aligned with live proof
|
||||
Status: TODO
|
||||
Status: DONE
|
||||
Dependency: QA-SF-002
|
||||
Owners: Developer, Test Automation
|
||||
Task description:
|
||||
@@ -55,18 +55,20 @@ Task description:
|
||||
- Keep the suites readable and route-specific rather than one monolithic soak.
|
||||
|
||||
Completion criteria:
|
||||
- [ ] Deterministic and live suites assert the same search-first product rules.
|
||||
- [ ] Covered routes include at least Doctor plus every additional supported ingested route.
|
||||
- [ ] The execution log records exact commands and results.
|
||||
- [x] Deterministic and live suites assert the same search-first product rules.
|
||||
- [x] Covered routes include at least Doctor plus every additional supported ingested route.
|
||||
- [x] The execution log records exact commands and results.
|
||||
|
||||
## Execution Log
|
||||
| Date (UTC) | Update | Owner |
|
||||
| --- | --- | --- |
|
||||
| 2026-03-07 | Sprint created for the supported-route live suggestion execution matrix in the final search-first correction pass. | Project Manager |
|
||||
| 2026-03-08 | Completed the supported-route live matrix against a rebuilt local corpus and running Angular shell. Evidence: `.artifacts/stella-cli/StellaOps.Cli.exe advisoryai sources prepare --json`; `Invoke-RestMethod -Method Post http://127.0.0.1:10451/v1/advisory-ai/index/rebuild` with `X-StellaOps-Scopes: advisory-ai:admin`, `X-StellaOps-Tenant: test-tenant`, `X-StellaOps-Actor: playwright-live`; `Invoke-RestMethod -Method Post http://127.0.0.1:10451/v1/search/index/rebuild` with the same headers; `npm run serve:test`; `LIVE_ADVISORYAI_SEARCH_BASE_URL=http://127.0.0.1:10451 npx playwright test tests/e2e/unified-search-contextual-suggestions.e2e.spec.ts tests/e2e/unified-search-contextual-suggestions.live.e2e.spec.ts tests/e2e/unified-search-self-serve-answer-panel.e2e.spec.ts tests/e2e/unified-search-experience-quality.e2e.spec.ts --config playwright.config.ts` -> `24 passed`, `3 skipped`. | Test Automation |
|
||||
|
||||
## Decisions & Risks
|
||||
- Decision: suggestion coverage is invalid unless the live corpus is rebuilt and non-empty.
|
||||
- Decision: supported-route proof is part of search release quality, not an optional smoke test.
|
||||
- Decision: local HTTP rebuilds require explicit StellaOps tenant/scope headers; `sources prepare` is the local CLI step, but index rebuilds remain authenticated backend operations.
|
||||
- Risk: some routes may not yet have enough ingested corpus support to sustain live suggestion coverage.
|
||||
- Mitigation: preflight route support explicitly and suppress unsupported suggestions in product code.
|
||||
- Reference: `docs/modules/ui/search-zero-learning-primary-entry.md`
|
||||
|
||||
Reference in New Issue
Block a user