mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-11-07 19:47:58 +01:00
Code Issues Packages Projects Releases Wiki Activity
9,046 Commits 963 Branches 8,404 Tags
a290ce626663dae1d54f70bce3ca6d8f67aab62f
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Shawn GuandLi He c5a3bc39b1 opencl: Adreno optimization for MoE - MxFP4 (#22301) 
* MoE Mxfp4 CLC kernel added, router reorder on GPU

* Pass test-backend-ops for MoE mxfp4 Adreno CLC

* remove putenv in llama-model.cpp

* fix indent style and whitespace

* opencl: remove unnecessary headers

* opencl: do not save cl_program objects

* opencl: remove unnecessary assert

* fix precision issue

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-05-01 23:02:24 -07:00
Shawn Gu 81387858f1 opencl: transposed gemm/gemv moe kernel with mxfp4,f32 (#16602) 
* opencl: transposed gemm/gemv moe kernel with mxfp4,f32

* add restore kernel for moe transpose

* fix trailing whitespaces

* resolve compilation warnings
 2025-10-17 17:55:32 -07:00
Shawn GuandLi He 3edd87cd05 opencl: optimize mxfp4 kernels (#16037) 
- flatten mxfp4 and packed fp4->fp16 bit-wise convert function (replace lut)
- MoE kernel optimizations

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2025-09-18 12:03:34 -07:00