OpenVINO Backend: Fuse IM2COL + MatMul convolution into OpenVINO convolution - #277

Open

mostafafaheem wants to merge 61 commits into

ravi9:dev_backend_openvinofrom

mostafafaheem:fuse_to_conv

Commits on Jul 27, 2026

OpenVINO backend: 1) enable gpt-oss moe on OV bk; 2) enable mxfp4 support

zhaixuejun1993
authored and
wine99
committed
1f88919
OpenVINO backend: disable TOPK_MOE op test

zhaixuejun1993
authored and
wine99
committed
4707c44
OpenVINO Backend: Add op FILL support

zhaixuejun1993
authored and
wine99
committed
bbe855b
OpenVINO backend: enable set rows with multi dims

zhaixuejun1993
authored and
wine99
committed
5c3b962
fix the name missmatch in setrow + view

zhaixuejun1993
authored and
wine99
committed
4b68df1
OpenVINO backend: enable op GGML_UNARY_OP_SIGMOID

zhaixuejun1993
authored and
wine99
committed
36d0bc3
OpenVINO Backend: enable SQR & SQRT

zhaixuejun1993
authored and
wine99
committed
ef525ec
OpenVINO backend: 1) ensure unique node names for OpenVINO; 2) add org_src to recorde the src ggml tensor for OpenVINO dynamic shape infer

zhaixuejun1993
authored and
wine99
committed
301882b
OpenVINO backend: enable fallback for openVINO to CPU backend

zhaixuejun1993
authored and
wine99
committed
e197045
OpenVINO backend: fix accurace issue in gemma3n arch test

zhaixuejun1993
authored and
wine99
committed
bec8a61
fix mpt failed case

zhaixuejun1993
authored and
wine99
committed
29d14d8
OpenVINO backend: clean nodeinfo

zhaixuejun1993
authored and
wine99
committed
c6d80e9
OpenVINO Backend: enable zero-size copy for view

zhaixuejun1993
authored and
wine99
committed
32d2b86
add concat ssm_conv in compute_dynamic_dim
wine99
committed
bf460cb
OpenVINO backend: disable EXP with FP32, which failed in op test. Root reason: the backend test initializes unary op inputs over a wide range, [-150, 150]. For FP32, exp(x) overflows around x ~= 88…

zhaixuejun1993
authored and
wine99
committed
745a95b
OpenVINO backend: fix CPY op test failed issue

zhaixuejun1993
authored and
wine99
committed
5f77b5f
OpenVINO backend: fix GATED_DELTA_NET op test failed issue

zhaixuejun1993
authored and
wine99
committed
eba9c7c
handle in-place op, handle qwen35 dynamic clearing of cache in cgraph
wine99
committed
05a92b8
handle qwen35 dynamic clearing of cache correctly
wine99
committed
cb09887
Enable qwen35 dense multi seq
wine99
committed
8546cb4
Fix qwen35 9b gqa
wine99
committed
c13deb5
Fix after rebase
wine99
committed
c21bf94
Disable SOLVE_TRI
wine99
committed
487db27
openvino: fix NEOX RoPE accuracy on GPU stateful (mixed-rank Multiply)

cavusmustafa
authored and
wine99
committed
867a993
OpenVINO backend: 1) remove the unique name in llama.cpp; 2) add new ov name in ov bk; 3) fix issue in arch test & op test with latest code update

zhaixuejun1993
authored and
wine99
committed
64c9d62
OpenVINO Backenb: remove changes in llama.cpp

zhaixuejun1993
authored and
wine99
committed
58ab393
Doc change (use x64 Native Tools Command Prompt for VS)

virajwad
authored and
wine99
committed
7591b24
Cleaner sentence

authored and
wine99
committed
8452765
OpenVINO Backend: cache key upgrade includes all src name

zhaixuejun1993
authored and
wine99
committed
88fbdc6
OpenVINO Backend: enable llama arch test on ci

zhaixuejun1993
authored and
wine99
committed
07f5918
OpenVINO Backend: move parameter node creating from decoder into translate

zhaixuejun1993
authored and
wine99
committed
37d76cb
OpenVINO Backend: create extra input ov node move from decoder to translate

zhaixuejun1993
authored and
wine99
committed
110e57a
fix for op regression due to is_model_splitted

suryasidd
authored and
wine99
committed
175f422

Commits on Jul 28, 2026

openvino: fix CPY writeback for recurrent state rollback
wine99
committed
e4085c0

Commits on Jul 30, 2026

qwen35 moe
wine99
committed
7162f3a
optimize MoE expert aggregation with ReduceSum
wine99
committed
820e72c

Commits on Jul 31, 2026

Commits on Aug 1, 2026

Commits on Aug 3, 2026

openvino: fix GPU mul_mat_id op tests
zhaixuejun1993
committed
ec01bd6
Merge pull request #271 from zhaixuejun1993/xuejun/fix-op-test-failed
zhaixuejun1993
authored
fd36389
ggml-openvino: add GGML_OPENVINO_RELEASE_WEIGHTS to reclaim host weight RSS on GPU

Mustafa Cavus
authored and
zhaixuejun1993
committed
fa089b1
ggml-openvino: stream weight requantization to cut the compile-time RSS peak

Mustafa Cavus
authored and
zhaixuejun1993
committed
98698af
ggml-openvino: avoid redundant token_embd requantization at compile

Mustafa Cavus
authored and
zhaixuejun1993
committed
9222c69
ggml-openvino: gate compile-memory optimizations behind GGML_OPENVINO_REDUCE_COMPILE_MEM

Mustafa Cavus
authored and
zhaixuejun1993
committed
7af5940
ggml-openvino: add frontend model cache (GGML_OPENVINO_MODEL_CACHE_DIR)

Mustafa Cavus
authored and
zhaixuejun1993
committed
72090f4
ggml-openvino: harden frontend model cache correctness
zhaixuejun1993
committed
2efe0b5
ggml-openvino: add memory optimization umbrella switch
zhaixuejun1993
committed
edf91ec
ggml-openvino: rename compiled model cache env
zhaixuejun1993
committed
b3c3d8b

Commits on Aug 4, 2026

Commits on Aug 7, 2026

Commits on Aug 10, 2026

OpenVINO Backend: Fuse IM2COL + MatMul convolution into OpenVINO convolution
mostafafaheem
committed
619e3fb
Register pass
mostafafaheem
committed
7d3ff8c