Repository navigation
docs(docs): add the Exporting weights guide, from a checkpoint to a float or quantized file - #98
Merged
Merged
Conversation
chmjkb
force-pushed
the
@chmjkb/python-quantizer
branch
from
November 4, 2026 10:16
5e92e44 to
3c4e31a
Compare
chmjkb
force-pushed
the
@chmjkb/docs-exporting-weights
branch
from
November 4, 2026 12:31
6215422 to
b8dc1e2
Compare
6 of 11 tasks
chmjkb
force-pushed
the
@chmjkb/python-quantizer
branch
from
November 5, 2026 11:42
d284954 to
0aaf88d
Compare
chmjkb
force-pushed
the
@chmjkb/docs-exporting-weights
branch
from
November 5, 2026 11:42
b8dc1e2 to
e8146f1
Compare
chmjkb
force-pushed
the
@chmjkb/docs-exporting-weights
branch
from
November 10, 2026 13:59
e8146f1 to
b511130
Compare
…e quantized group
…loat or quantized file
…ghts, with measured MiniLM figures
…e diagram, no row-end arrow
…nd name the quantized model once
…LM weights, not the random-weight test
…rom Exporting weights, keep what a reader does
… and quantizing, with a branching diagram
…runntime core is published
…at Conv1d and ConvTranspose1d load quantized
chmjkb
force-pushed
the
@chmjkb/docs-exporting-weights
branch
from
November 12, 2026 14:33
b511130 to
a4ca278
Compare
chmjkb
marked this pull request as ready for review
November 12, 2026 14:34
xxpopielxx
reviewed
Nov 12, 2026
| of `F32` and doesn't change how the model computes. | ||
|
|
||
| If a weight is missing or has the wrong shape, loading stops with a | ||
| `CHECKPOINT_MISMATCH` error that names it (see |
Member
There was a problem hiding this comment.
Maybe also say that an extra tensor in the file fails the same way (unexpected: pooler.dense.weight)? A plain HF checkpoint hits this. --drop could be listed with the other flags, since it removes them when quantizing.
Collaborator
Author
There was a problem hiding this comment.
once #101 lands unexpected tensors no longer throw unless strict: true is passed, but I'll add a small mention
… the quantizer's --drop flag
xxpopielxx
approved these changes
Nov 13, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Part of #70: a new docs page, Zoo → Guides → Exporting weights, on how to get your own weights into runntime.
modelPath, spreading amodelsconfig).dtype.CHECKPOINT_MISMATCHand what it reports).runntime quantize(feat(tools): add runntime quantize, a uv Python CLI that writes int8/int4 checkpoints in format v1 #93): command, defaults,--f16,--drop,--include/--exclude, reading the report, measured MiniLM file sizes.Introduces a breaking change?
Type of change
Testing instructions
pnpm typecheck && pnpm lint && pnpm format:checkpnpm --filter docs... run build, thenpnpm dev:docsand open/zoo/exporting-weights/in light and dark theme, desktop and phone width.Related issues
Part of #70. Stacked on #93.
Checklist
Additional notes
mainso far; the page says so in one place, to extend as Moonshine and EmbeddingGemma 2 land.