Skip to content

[Desktop] weights failed to load: Qwen3.6-35B-A3B NVFP4 #782

Open

Description

@srvhbkking-collab

Before you start

  • I have checked the supported models and this checkpoint is not listed there. A listed checkpoint that fails is a bug; use a Bug report instead.
  • I have read the Roadmap and this model is not already planned there.
  • I have read the FAQ.
  • I have searched existing issues and found no duplicate.
  • This is not a GGUF checkpoint. GGUF support is on the Roadmap; please do not open an issue for it.

Hugging Face link

i am doing a home project

Is the model architecture already supported

Not sure

Is the quantization already supported

Not sure

What happens when you load it

>>>>>>>> PASTE THE FULL SERVER LOG HERE <<<<<<<<
(copied with the "Copy server log" button in the failure dialog, or Logs -> Server status -> Copy)

WeightLoadError: ValueError: 'C:\\Users\\ersau\\.freetoken\\models\\Qwen3.6-35B-A3B-NVFP4' stores NVFP4 global scales as fp16 (e.g. 'model.layers.0.mlp.shared_expert.down_proj.weight_global') but Free

Anything else

Desktop 0.2.0-beta.23; engine 0.2.0+g425dc7bf1; NVIDIA GeForce RTX 4070, 12.0 GiB, driver 617.42; Intel Core i5-14600K, 31.8 GiB

Activity

  1. lolmc0587 commented on Oct 21, 2026

    @lolmc0587

    same here @jason-fxz

  2. jason-fxz commented on Oct 21, 2026

    @jason-fxz
    Collaborator

    If you use FTW, may redownload/reconvert this model, we have breaking change in #739

  3. added
    bugSomething isn't working
    and removed on Oct 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions