chore(deps): update dependency transformers to v5.15.0 - #280
Open
dreadnode-renovate-bot[bot] wants to merge 1 commit into
Open
chore(deps): update dependency transformers to v5.15.0#280dreadnode-renovate-bot[bot] wants to merge 1 commit into
dreadnode-renovate-bot[bot] wants to merge 1 commit into
Conversation
| datasource | package | from | to | | ---------- | ------------ | ------ | ------ | | pypi | transformers | 5.14.1 | 5.15.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
| Package | Change | Age | Confidence |
|
Generated Summary:
transformerslibrary from version 5.14.1 to 5.15.0.This summary was generated with ❤️ by rigging
| transformers |
|
|
==5.14.1→==5.15.0|Release Notes
huggingface/transformers (transformers)
v5.15.0: Release: v5.15.0Compare Source
Release v5.15.0
New Model additions
Meta Muse Glimmer
Muse Glimmer, released today, is Meta’s new multimodal model, especially designed for agentic use cases. Distilled from Muse to 30B parameters, and released under the Apache 2.0 license, it can be deployed to local setups for privacy-aware applications such as coding, document analysis, personal assistants, Claw- or Hermes-like setups.
Muse Glimmer is a dense 30B parameter model consisting of:
We're covering it in the following blogpost: http://hf.co/blog/muse-glimmer
GraniteMoeSWA & GraniteSWA
Links: Documentation
Links: Documentation
A.X-K1 & A.X-K2
Links: Documentation
Links: Documentation
Cosmos3 Edge
Links: Documentation
Breaking changes
Kernels are now opt-in rather than mandatory for linear attention models (Mamba, GDN, Conv-only, etc.), so users who relied on automatic kernel selection must explicitly enable kernels to maintain previous behavior.
Kernels] Refactor all linear attn models & native kernels fallback (#47630) by @vasquThe cache cropping API now only accepts negative values (relative offsets) instead of absolute sizes, so users calling crop methods directly must update their code to pass negative values accordingly.
T5 and its model family (MT5, LongT5, etc.) now support SDPA and other attention backends via
ALL_ATTENTION_FUNCTIONS, meaning the default attention implementation may change and users relying on the previous eager-only path should explicitly setattn_implementation="eager"if needed.Several small private helper functions (e.g.,
_is_url,_build_image_tokens) have been removed from multimodal processor files, so users or downstream libraries that imported these private functions directly must remove or replace those references.Attention
This release includes several attention fixes and improvements, including correcting Multi-Head Latent Attention (MLA) cache compression, optimizing Flash Attention max sequence length computation in vision models, and fixing bugs in CTRL flex-attention and SDPA prefill with position bias. Additional changes refactor linear attention models for better maintainability, make Gemma 4's heterogeneous attention config explicit, and improve MPS support via metal-flash-sdpa integration.
per_layer_configfor Gemma 4 so that heterogeneous attention config is explicit (#47384) by @hmellor in [#47384]valuepadding into the attention interfaces that need it (#47451) by @hmellor in [#47451]BlockMaskcrash in CTRL flex-attention generation (#46854) by @jiqing-feng in [#46854]Vision
Vision improvements in this release include performance optimizations such as faster image preprocessing for vision-language models (GLM4V, MiniMaxM3-VL, and others) by eliminating redundant tensor copies, and more efficient Flash Attention variable-length paths by precomputing maximum sequence lengths once per forward pass. Several bug fixes were also applied, including correcting dtype alignment in Kosmos2/Kosmos2_5 embedding merges, fixing a position-embedding initialization fallback in Phi4Multimodal, resolving PIL resize parity in Hunyuan-VL, and patching stop-sequence handling in the image-text-to-text pipeline.
Generation
Several generation improvements and bug fixes were made, including enabling batched audio generation for Qwen2.5/3-Omni, allowing sliding window cache layers to work with speculative decoding, and fixing memory overhead from static cache persistence across
generate()calls. Multiple model-specific bugs were also resolved, including crashes in KyutaiSpeechToText, MusicgenForCausalLM, CTRL flex-attention, and assisted decoding for EncoderDecoder cache and OlmoHybrid models.generate()last window (#46952) by @jiqing-feng in [#46952]MusicgenForCausalLM.generate()(#46974) by @jiqing-feng in [#46974]Cache
Several cache-related bugs were fixed, including correcting NemotronH's missing
"mlp"layer-type mapping, resolving recurrent-layer padding masks being skipped during chunked prefill and cache continuation for hybrid models, and fixing assisted decoding for models withEncoderDecoderCacheand OlmoHybrid. Additional improvements include aligning OlmoHybrid to use a native cache, enabling sliding window layers to support speculative decoding rollback, and stopping the static cache from being stored as a model attribute to reduce unexpected memory overhead."mlp"in the cache layer-type mappings (#47535) by @qgallouedec in [#47535]Kernels
kernelspython package will very likely be a required dependency fortransformers[torch]in the near future. This will help us deliver maximum performance to all users; kernels will only be downloaded from trusted publishers manually approved by the HF team. Please let us know of any issues you're facing beforehands so that we may solidify our integration.Improved robustness of the kernels integration by refactoring function handling to use layer repos, fixing CI EROFS fallback patches for kernel downloads via
HfApi, resolving a positional argument collision incausal_conv1d_fn, and bumping the FP8 kernels version to prevent NaNs.Kernels] Refactor function handling (#46883) by @vasqu in [#46883]causal_conv1d_fnpositionalactivationcolliding with hub kernel'sseq_idx(#47527) by @qgallouedec in [#47527]FP8] Bump kernels version (#47344) by @vasqu in [#47344]Quantization
Quantization support was expanded with FP8 kernels for compressed-tensors models, fixes for FP8 module normalization and format-based compression detection, and a multi-device MXFP4 dequantization race condition fix. GPTQ and MXFP4 tests were also extended to cover Intel XPU devices.
_convert_moe_packed_tensors(#47423) by @kaixuanliu in [#47423]Audio
Batched audio generation is now supported for Qwen2.5/3-Omni, and several bug fixes were applied across audio models, including a dtype mismatch in Gemma4 audio feature merging, a bfloat16 positional embedding error in AudioFlamingo3, and missing backend requirement guards for Voxtral. The VibeVoice ASR processor was also updated to make audio input optional and support multiple audios per prompt.
Parallelization
Expanded FSDP support across 94
ForCausalLMmodel classes with auto-generated FSDP plans, added end-to-end FSDP tests including distributed checkpoint save/load and generation, and introduced a dedicated FSDP CI job. Additionally, fixed a device mismatch bug increate_bidirectional_sliding_window_maskunder model parallelism and resolved a tensor parallel inference issue for models with tied embeddings.create_bidirectional_sliding_window_mask(#47560) by @abcgco in [#47560]Tokenization
This release adds native support for Mistral's "tekken" tokenizer format via AutoTokenizer, fixes a CodeLlama tokenizer bug where leading whitespace was incorrectly dropped during decode, and patches a potential ReDoS vulnerability caused by unescaped tokenizer filenames being used as regex patterns in
from_pretrained.Serve
Improved the
servechat parsing to unify streaming and non-streaming paths under a single response parser that handles tool calls, reasoning, and content, simplifying the addition of new model support. Additionally, hardened daily CI reporting by fixing GitHub API diagnostic output being captured in Slack payloads and adding rate-limit resilience to prevent report failures when paginating large job matrices.Bugfixes and improvements
PhimoeIntegrationTest(#46539) by @ydshieh in [#46539]Configuration
📅 Schedule: (UTC)
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Mend Renovate CLI.