mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-10-29 07:07:59 +01:00
Code Issues Packages Projects Releases Wiki Activity
9,066 Commits 923 Branches 8,242 Tags
05ff59cb57860cc992fc6dcede32c696efea711c
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
leonardHONG 05ff59cb57 CUDA: batch out_prod inner loop with cublasSgemmStridedBatched (#22651) 
* CUDA: batch out_prod inner loop with cublasSgemmStridedBatched

* CUDA: batch out_prod inner loop with cublasSgemmStridedBatched

* CUDA: add cublasSgemmStridedBatched mapping for HIP and MUSA backends
 2026-05-07 21:59:29 +02:00
leonardHONG e77056f9b2 CUDA: use fastdiv for batch index split in get_rows (#22650) 2026-05-04 16:24:05 +02:00
leonardHONG 97895129e5 ggml-cuda: flush legacy pool on OOM and retry (#22155) 
* ggml-cuda: flush legacy pool on OOM and retry

Signed-off-by: 梁厚宏 <2695316095@qq.com>

* Address review comments: add explicit sync, update destructor, clean up MUSA macros

Signed-off-by: 梁厚宏 <2695316095@qq.com>

---------

Signed-off-by: 梁厚宏 <2695316095@qq.com>
 2026-04-20 23:30:38 +02:00