Skip to content

fix: explicit licences in publish_hf.py (no CC-BY default), docs/licenses.md - #86

Merged
mudler merged 1 commit into
masterfrom
fix/publish-hf-licences
Oct 3, 2026
Merged

mudler merged 1 commit into
masterfrom
fix/publish-hf-licences

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Problem

scripts/publish_hf.py defaulted every model except Nemotron 3.5 to CC-BY-4.0. Regenerating the Hugging Face card would have put a wrong licence on parakeet_realtime_eou_120m-v1 (it uses the NVIDIA Open Model License) and would have dropped sections that were added by hand to the live card.

Changes

  • Every model id now has an explicit licence, with no default:
    • CC-BY-4.0: the NVIDIA Parakeet models and the Moondream models.
    • OpenMDW 1.1: Nemotron 3.5 ASR and Nemotron 3 Diarization.
    • NVIDIA Open Model License, with its notice: parakeet_realtime_eou_120m-v1.
    • MIT: Silero VAD.
  • An unknown model id now fails instead of falling back to a licence.
  • New --check-licences option prints the licence of each model id.
  • New test tests/python/check_publish_hf_licences.py checks that the table in the script equals docs/licenses.md (new file).
  • The collection card now regenerates the front matter, the licence section, and the diarization, Moondream and Silero VAD sections.

Factual correction

The generated WER column for the Nemotron 3.5 Q6_K, Q5_K and Q4_K files now says "not measured". The repo has no measurement for them; the previous 0.0000 values were hard-coded without a run artifact. F16 and Q8_0 keep 0.0000. That value means agreement with NeMo on the repo's two short test clips, not accuracy on a corpus.

Limits

  • The regenerated card differs from the live one in small ways: per-model licence labels, family bullets instead of globs, and sizes need the GGUF files to be present.
  • The NVIDIA notice wording was not checked against the licence text.
  • C++ tests were not run. Only check_publish_hf_licences.py and publish_hf.py --check-licences were run, and both pass.

🤖 Generated with Claude Code

…ections

The Hugging Face card was edited by hand with per-model licences, but
publish_hf.py still defaulted every model to CC-BY-4.0, so a regeneration
would have mislabelled parakeet_realtime_eou_120m-v1 and dropped the
Nemotron, Moondream and Silero VAD sections.

- LICENSES now lists every model id with no default; an unknown id raises.
  realtime_eou_120m-v1 is the NVIDIA Open Model License with the required
  notice, Nemotron 3.5 ASR and 3 Diarization are OpenMDW 1.1, Moondream
  Ultra and Redux are CC-BY-4.0, Silero VAD is MIT (Silero Team).
- The collection card uses the mixed-licence front matter and a per-family
  License section with the notices, and appends static sections for the
  files it does not convert (scripts/hf_card/).
- Add `--check-licences` and tests/python/check_publish_hf_licences.py. The
  test also checks the script table against docs/licenses.md.
- Stop claiming WER 0 for the Nemotron 3.5 Q6_K, Q5_K and Q4_K files: no
  measurement of them is recorded.

Assisted-by: Claude:claude-sonnet-5-5 [Claude Code]
@mudler
mudler merged commit 11b19a6 into master Oct 3, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants