Repository navigation
fix(router): route only to model ids the live catalog serves - #43
Merged
Merged
Conversation
added 2 commits
October 19, 2026 23:14
Free tiers named nvidia/nemotron-3-super-120b (delisted) and nemotron-3-nano-omni (available:false); both are redirected to nvidia/llama-3.2-11b-vision, the only available free model, which all free tiers now name. Eco/Auto Simple named hidden moonshot/kimi-k2.7 and now use google/gemini-2.5-flash-lite / google/gemini-2.5-flash, matching router-core. Adds a retired-id test across all profiles and an opt-in live catalog test (BLOCKRUN_LIVE_CATALOG=1).
Contributor
Author
|
Follow-up commit: the catalog's |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Live bug
SmartChatrouted to ids the gateway no longer serves (checked againstGET https://blockrun.ai/api/v1/modelsand a $0 probe of each free id on 2026-10-20):nvidia/nemotron-3-super-120b: not in/v1/models. The gateway answers it withnvidia/llama-3.2-11b-vision, soSmartChatResponse.Modelnamed a model that never served the call.nvidia/nemotron-3-nano-omni-30b-a3b-reasoning: listed withavailable: falseand also redirected tollama-3.2-11b-vision.moonshot/kimi-k2.7: hidden from/v1/models.Replacements
nvidia/llama-3.2-11b-visionbilling_mode: free, pricing 0 andavailable: true. The other free ids (nemotron-3.5-lightning, nemotron-3-ultra-550b, nano-omni, muse-glimmer-30b, north-mini-code, laguna-xs-2.1) are allavailable: falseand get redirected.google/gemini-2.5-flash-lite($0.10/$0.40)ecoTiers.SIMPLEprimary isnvidia/nemotron-3.5-lightningand its first fallback is nano-omni. Both areavailable: falsenow, so this takes the first live rung of that chain.google/gemini-2.5-flash($0.30/$2.50)tiers.SIMPLEprimary.All other routed ids are listed and available, so they did not change (deepseek-chat, gemini-2.5-pro, deepseek-reasoner, gemini-3.5-flash, gemini-3.1-pro, gpt-5.5, claude-opus-4.8, o3).
README examples, the free-model table and the routing table are updated to match.
TestReadmeRoutingTableMatchesCodeenforces the routing table. CHANGELOG has an Unreleased entry. VERSION is unchanged.Guarding against regressions
TestRoutingTableAvoidsRetiredIDsnow covers every profile, not only free. Its denylist includes the ids above plus kimi-k2.5/k2.6/k2.7.TestRoutingTableMatchesLiveCatalogis opt-in (BLOCKRUN_LIVE_CATALOG=1). It fetches/v1/modelsand fails if any routed id is missing oravailable: false, or if a free tier routes to a model that is not billed as free.Checks
go build ./...: okgo vet ./...: okgo test ./...: okBLOCKRUN_LIVE_CATALOG=1 go test -run 'TestRoutingTable|TestReadme|TestFreeRouting' .: ok, against the live catalogintegration_test.go(build tagintegration, needs a wallet) was not run.Note
The free tier now runs on a single model, an 11B vision model. Its quality on Complex and Reasoning prompts will be lower than nemotron's. That is the only free option the catalog currently marks available.