Skip to content

feat(observe): annotation queues - #757

Merged
LinuxDevil merged 2 commits into
mainfrom
obs/o26-annotation-queues
Oct 28, 2026
Merged

LinuxDevil merged 2 commits into
mainfrom
obs/o26-annotation-queues

Conversation

@LinuxDevil

Copy link
Copy Markdown
Owner

Annotation queues in the observe daemon: queue trace ids, take the oldest pending one, and complete it with rubric-checked human scores written through the same path as POST /api/v1/scores.

Ticket: O26 (Forge Observe vs LangSmith evaluation follow-up)

Changes

  • feat(observe): annotation queues

Verification: focused vitest, tsc --noEmit, eslint on changed files (details in the review package); full suite and fallow run in CI.

🤖 Generated with Claude Code

@LinuxDevil
LinuxDevil force-pushed the obs/o26-annotation-queues branch from 9355080 to 7cc2deb Compare October 28, 2026 21:36
Adds annotation_queues/annotation_items (migration 6) and the
/api/v1/queues routes: create/list/get/delete, add trace ids, next
(oldest pending, 204 when none, no lock) and complete, which writes human
scores through a shared writeHumanScore helper (also used by
POST /api/v1/scores) in one transaction with the status update.
transaction() now joins an already-open transaction on the same db.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@LinuxDevil
LinuxDevil force-pushed the obs/o26-annotation-queues branch from 7cc2deb to 5451d2a Compare October 28, 2026 21:52
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@LinuxDevil
LinuxDevil force-pushed the obs/o26-annotation-queues branch from 5451d2a to 1827a2f Compare October 28, 2026 21:52
@LinuxDevil
LinuxDevil merged commit 7632035 into main Oct 28, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant