Skip to content

ggml-hrx: support Gemma routed IDs and expert scales - #183

Open
AaronStGeorge wants to merge 1 commit into
hrx-graph-develop-v2from
users/astgeorg/gemma-hrx-bringup-reopened
Open

AaronStGeorge wants to merge 1 commit into
hrx-graph-develop-v2from
users/astgeorg/gemma-hrx-bringup-reopened

Conversation

@AaronStGeorge

Copy link
Copy Markdown
Collaborator

Reopens accidentally merged PR #180.

Bind exact router ID view spans and gather scalar expert scales with runtime ID bounds checks. Validated on gfx1151 with focused operator/backend tests, full paired HRX/Vulkan perplexity, and generation. High absolute perplexity and CPU REPEAT fallback remain documented limitations.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant