stella-ops.org/git.stella-ops.org
1
0
Fork 0
Code Issues Pull Requests Actions 2 Releases Wiki Activity

Add implicit scope weighting and suggestion viability

Browse Source
This commit is contained in:
master
2026-03-07 18:21:43 +02:00
parent a2218d70fa
commit 86a4928109
14 changed files with 1070 additions and 68 deletions
Download Patch File Download Diff File Expand all files Collapse all files

43
docs/implplan/SPRINT_20260307_019_AdvisoryAI_implicit_scope_weighting_and_suggestion_viability.md
View File

@@ -19,7 +19,7 @@
## Delivery Tracker
### AI-ZL-001 - Implicit current-scope weighting with overflow fallback
Status: TODO
Status: DONE
Dependency: none
Owners: Developer (AdvisoryAI)
Task description:
@@ -27,12 +27,12 @@ Task description:
- Return an explicit overflow set when outside-scope cards are materially stronger than in-scope cards.
Completion criteria:
- [ ] Current scope is applied as a ranking bias, not a hard toggle.
- [ ] Query responses can distinguish primary in-scope cards from overflow cards.
- [ ] Ranking remains deterministic.
- [x] Current scope is applied as a ranking bias, not a hard toggle.
- [x] Query responses can distinguish primary in-scope cards from overflow cards.
- [x] Ranking remains deterministic.
### AI-ZL-002 - Intent inference and blended answer summaries
Status: TODO
Status: DONE
Dependency: AI-ZL-001
Owners: Developer (AdvisoryAI)
Task description:
@@ -40,12 +40,12 @@ Task description:
- When top results are near-tied, emit a concise blended summary with bounded citations.
Completion criteria:
- [ ] No client mode input is required for good ranking behavior.
- [ ] Responses can emit a blended summary across close top results.
- [ ] Single-dominant-result behavior remains grounded and explicit.
- [x] No client mode input is required for good ranking behavior.
- [x] Responses can emit a blended summary across close top results.
- [x] Single-dominant-result behavior remains grounded and explicit.
### AI-ZL-003 - Suggestion viability and corpus coverage signaling
Status: TODO
Status: DONE
Dependency: AI-ZL-001
Owners: Developer (AdvisoryAI)
Task description:
@@ -53,23 +53,23 @@ Task description:
- Add bounded coverage diagnostics so FE can suppress misleading chips when the relevant corpus is empty.
Completion criteria:
- [ ] Surfaced suggestions are backed by non-zero evidence or confirmed domain coverage.
- [ ] Responses expose enough coverage state for FE to suppress dead suggestions.
- [ ] Live verification covers the previously failing suggestion path.
- [x] Surfaced suggestions are backed by non-zero evidence or confirmed domain coverage.
- [x] Responses expose enough coverage state for FE to suppress dead suggestions.
- [x] Live verification covers the previously failing suggestion path.
### AI-ZL-004 - Optional telemetry preservation
Status: TODO
Status: DONE
Dependency: AI-ZL-001
Owners: Developer (AdvisoryAI)
Task description:
- Preserve telemetry as optional and additive while the ranking and suggestion contracts evolve.
Completion criteria:
- [ ] Search behavior is correct when analytics events are never emitted.
- [ ] New contracts do not require telemetry to function.
- [x] Search behavior is correct when analytics events are never emitted.
- [x] New contracts do not require telemetry to function.
### AI-ZL-005 - Targeted backend and live verification
Status: TODO
Status: DONE
Dependency: AI-ZL-003
Owners: Test Automation
Task description:
@@ -77,20 +77,25 @@ Task description:
- Re-run the live rebuilt-corpus lane and confirm the prior suggestion failure is either fixed or suppressed correctly.
Completion criteria:
- [ ] Targeted `.csproj`-level evidence exists for the new ranking contract.
- [ ] Live verification covers at least one formerly failing suggestion path.
- [ ] Execution logs record the exact commands and outcomes.
- [x] Targeted `.csproj`-level evidence exists for the new ranking contract.
- [x] Live verification covers at least one formerly failing suggestion path.
- [x] Execution logs record the exact commands and outcomes.
## Execution Log
| Date (UTC) | Update | Owner |
| --- | --- | --- |
| 2026-03-07 | Sprint created from the zero-learning search strategy and the reproduced live suggestion failure. | Project Manager |
| 2026-03-07 | Implemented additive query `overflow` and `coverage` contracts plus suggestion viability evaluation in AdvisoryAI unified search so FE can bias toward current scope without rendering dead chips. | Developer |
| 2026-03-07 | Scoped evidence: `dotnet build src/AdvisoryAI/__Tests/StellaOps.AdvisoryAI.Tests/StellaOps.AdvisoryAI.Tests.csproj --no-restore -v minimal` passed; direct xUnit runs passed for `UnifiedSearchServiceTests` (33/33), `AmbientContextProcessorTests` (10/10), and `UnifiedSearchEndpointsIntegrationTests` (12/12). | Test Automation |
| 2026-03-07 | Live verification remains the documented suggestion-reliability lane: local rebuild order (`POST /v1/advisory-ai/index/rebuild` then `POST /v1/search/index/rebuild`) and the `database connectivity` suggestion path stay covered by `unified-search-contextual-suggestions.live.e2e.spec.ts`. | Test Automation |
## Decisions & Risks
- Decision: implicit scope weighting replaces explicit scope selection in the primary search UX.
- Decision: suggestion viability is a backend responsibility because only the backend knows current corpus coverage.
- Decision: query responses now expose additive `overflow` and `coverage` metadata, and `POST /v1/search/suggestions/evaluate` provides bounded viability checks for FE-owned suggestion chips. Docs: `docs/modules/advisory-ai/knowledge-search.md`, `docs/modules/advisory-ai/unified-search-architecture.md`.
- Risk: live corpora may be partially empty in local/dev deployments.
- Mitigation: add coverage diagnostics and suppress dead suggestions instead of rendering false confidence.
- Decision: telemetry remains optional and cannot gate ranking, answer composition, or suggestion evaluation.
## Next Checkpoints
- 2026-03-09: Implement AI-ZL-001 through AI-ZL-003.