Skip to content

US-60 — A repeatable score for ai/query.py, run in CI #393

Open

Description

@ARSH871-bot

As a maintainer, I want the question-answering layer scored the same way every time, so a change that makes it answer wrongly fails CI instead of reaching a user.

Acceptance criteria

Shape

Not a pipeline feature: AI layer and tooling.

Why this is in the milestone

The question layer has been measured once, by hand: 20 questions on 10 August (docs/evaluation.md, Part 2). It has never been pinned in CI.

Depends on #385: its method is reused, so it merges first.


Epic: Specialist pick (explainable and trustworthy AI for network security) | Size: estimated at sprint planning | Assigned: @patelankeet2

Specialist pick agreed by all four on 13 October 2026 (slate row 3). Acceptance criteria are drafted from the slate's wording; the owner refines them at sprint planning on 19 October.

Part of Phase 3 - market readiness.

Activity

  1. added
    enhancementNew feature or request
    layer: aiLayer 2 — local LLM explanation and Q&A
    phase: 3Market readiness -- what stands between us and a product someone could buy.
    on Oct 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestlayer: aiLayer 2 — local LLM explanation and Q&Aphase: 3Market readiness -- what stands between us and a product someone could buy.

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions