Issues

• chore: update @fastify/static to patched Fastify 5 release

  mattpocock/evalite#407 · Filter by author akazemier-godaddy opened on Sep 30, 2026

• Is this still an active project

  mattpocock/evalite#405 · Filter by author dkokotov opened on Aug 13, 2026
  1

• UI fails on any remote access: bundle hardcodes localhost + server has no configurable bind host

  mattpocock/evalite#404 · Filter by author Mr-Ripperton opened on Aug 6, 2026

• Support for AI SDK v7 in peerDependencies

  mattpocock/evalite#400 · Filter by author nicolas-besnard opened on Jun 29, 2026

• phantom dependency from evalite to vitest

  mattpocock/evalite#398 · Filter by author Yvem opened on Jun 9, 2026
  1

• Bug: wrapAISDKModel({ caching: false }) is silently ignored when tracing is enabled

  mattpocock/evalite#395 · Filter by author Sraleik opened on May 7, 2026

• Various test suite UI improvements

  mattpocock/evalite#394 · Filter by author jreidgreer opened on May 5, 2026

• Don't log task results when using evalite serve

  mattpocock/evalite#393 · Filter by author jreidgreer opened on May 5, 2026

• Clicking a trace row in the eval detail view does nothing (UI stays on eval-level panel)

  mattpocock/evalite#391 · Filter by author emilkallioniemi opened on Apr 21, 2026

• possible regression: cannot use @nuxt/test-utils defineVitestProject directly in evalite.config.ts

  mattpocock/evalite#390 · Filter by author vachmara opened on Apr 18, 2026

• Upgrade to tsgo

  mattpocock/evalite#386 · Filter by author mattpocock opened on Mar 26, 2026
  4

• wrapAISDKModel for EmbeddingModelV2

  enhancement
  mattpocock/evalite#374 · Filter by author Fox32 opened on Jan 29, 2026

• Vercel's default gateway model doesn't work with built-in LLM scorers

  triaged
  mattpocock/evalite#372 · Filter by author joshpitzalis opened on Jan 14, 2026
  1

• evalite export does not fail if threshold is not reached

  mattpocock/evalite#370 · Filter by author Fox32 opened on Jan 8, 2026
  2

• Add support for running multiple eval files by name

  enhancement
  mattpocock/evalite#367 · Filter by author matchai opened on Dec 16, 2025
  

• Add describe/it or other ways to better organize evals within a file

  enhancement
  mattpocock/evalite#364 · Filter by author matchai opened on Dec 9, 2025

• wrapAISDKModel: Unsupported content type: reasoning (AI SDK v5 reasoning parts)

  mattpocock/evalite#361 · Filter by author brennanmceachran opened on Dec 5, 2025
  4

• A/B testing pass "variant" as argument to test data function

  enhancement
  mattpocock/evalite#359 · Filter by author smileLilith opened on Nov 30, 2025
  1

• Add caveat to 'built-in scorers' that they be used sparingly

  documentationenhancement
  mattpocock/evalite#356 · Filter by author mattpocock opened on Nov 28, 2025
  2

• Bug: Evalite Creates Cache Directory Regardless of cacheEnabled Setting

  mattpocock/evalite#354 · Filter by author dimitris4 opened on Nov 27, 2025
  2

  

• Display more trace details

  enhancement
  mattpocock/evalite#353 · Filter by author cjol opened on Nov 27, 2025

• Score calculation needs more explanation

  enhancement
  mattpocock/evalite#348 · Filter by author kevin-moechel opened on Nov 21, 2025
  1

• Threshold as evalite config param

  enhancement
  mattpocock/evalite#347 · Filter by author kevin-moechel opened on Nov 21, 2025

• UI: Show progress and evals as they complete when trialCount > 1

  enhancement
  mattpocock/evalite#345 · Filter by author salterj opened on Nov 20, 2025
  1

• Support .only line in vitest do focus on specific files/tests

  enhancement
  mattpocock/evalite#344 · Filter by author nicolas-besnard opened on Nov 19, 2025
  1