Repository navigation

feat: support Moondream Parakeet Ultra and Redux - #77

Merged

mudler merged 56 commits into

masterfrom

feat/hf-ternary-vad

Oct 3, 2026

Merged

feat: support Moondream Parakeet Ultra and Redux#77
mudler merged 56 commits into
masterfrom
feat/hf-ternary-vad

Commits on Sep 29, 2026
- feat(convert): import HF safetensors Parakeet TDT checkpoints
  mudler
  committed
  ae599e1
- feat(convert): keep ternary weights packed and carry the VAD head
  mudler
  committed
  b9105f7
- feat(loader): read the ternary and VAD flags from the GGUF
  mudler
  committed
  c70d419
- feat(ternary): repack, int8 activation quantization and scalar reference
  mudler
  committed
  bd1ff06
- feat(ternary): run packed ternary encoder linears through a ggml op pair
  mudler
  committed
  e54e0c5
- fix(ternary): validate and repack packed weights at load
  mudler
  committed
  bc8775e
- feat(ternary): AVX-512 VNNI and AVX2 kernels with runtime dispatch
  mudler
  committed
  4bf3e96
- feat(ternary): NEON dot-product kernel
  mudler
  committed
  f2eb381
- fix(ternary): move NEON -ffp-contract=off flag inside NOT MSVC guard
  mudler
  committed
  c8499e6
- docs: ternary Redux support, measurements and converter
  mudler
  committed
  9d151fb
- bench: compare ternary kernels with ggml Q8_0 and F16 mul_mat
  mudler
  committed
  f7c9e8c
- docs: fix ternary numbers and wording after review
  mudler
  committed
  b4164da
- ternary: one output row per vector lane in the kernels
  mudler
  committed
  7c8cc48
- bench: run the scalar ternary reference with fewer repetitions
  mudler
  committed
  93028b6
- ternary: tune the x86 tile shapes
  mudler
  committed
  6136e9b
- ternary: vectorize the activation quantization on x86
  mudler
  committed
  f228376
- ternary: build the AVX-512 quantizer for avx512f only
  mudler
  committed
  8b66c63
- docs: ternary speed after the kernel rework
  mudler
  committed
  8b18b08
Commits on Sep 30, 2026
Commits on Oct 1, 2026
- Merge master into feat/hf-ternary-vad
  mudler
  committed
  cb6208d
Commits on Oct 2, 2026
- perf: add a pool of CPU backends with thread-local routing
  mudler
  committed
  2543ff9
- feat(capi): opt-in concurrent requests, parakeet_capi_set_concurrency
  mudler
  committed
  3bf3480
- fix: make first-use weight realization thread safe
  mudler
  committed
  da82770
- feat: --concurrency K for parakeet-cli bench and parakeet-server
  mudler
  committed
  c27a524
- test: stress and shutdown tests for the backend pool
  mudler
  committed
  24abdae
Commits on Oct 3, 2026

Commits

Commits on Sep 29, 2026

Commits on Sep 30, 2026

Commits on Oct 1, 2026

Commits on Oct 2, 2026

Commits on Oct 3, 2026