Skip to content

Measure which prompting strategy works best for explanations #411

Open

Description

@patelankeet2

As the AI-layer owner, I want a measured comparison of prompting strategies for ai/explain.py, so that the current prompt is a tested choice rather than an unexamined first draft.

Acceptance criteria

Shape

AI layer, tooling and measurement only. No change to the F-1 finding shape or to /api/findings's response contract.

Why this is worth doing

The current prompt in ai/Modelfile was never compared against an alternative. This is the cheapest possible test of that gap, reusing infrastructure that already exists rather than building new measurement tooling.


Epic: Candidate idea (AI layer) - not yet agreed as a specialist pick
Size: not yet estimated
Assigned: @patelankeet2

Proposed 27 October 2026 as a candidate feature idea. Not yet discussed or agreed by the team; open for refinement or rejection at the next planning session, the same status every other idea in this batch carries.

Activity

  1. self-assigned this
    on Oct 26, 2026
  2. added
    enhancementNew feature or request
    layer: aiLayer 2 — local LLM explanation and Q&A
    phase: 3Market readiness -- what stands between us and a product someone could buy.
    on Oct 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestlayer: aiLayer 2 — local LLM explanation and Q&Aphase: 3Market readiness -- what stands between us and a product someone could buy.

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions