mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-03 21:22:20 +02:00
Code Issues Packages Projects Releases Wiki Activity
1,327 Commits 758 Branches 7,317 Tags
e2583cbc29cd7d6d1403f338842c07dfc0467e6c
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
shibe2 e2583cbc29 CLBlast: Fix handling of on-device tensor data 
Fix uploading tensor data to device, including 3D, 4D, and non-contiguous tensors.
Use correct offsets into data that is already in VRAM.
Correct handling of OpenCL events when multiple commands are queued.
 2023-10-05 18:25:23 +04:00
shibe2andGitHub 665018c749 CLBlast: Add broadcast support for matrix multiplication (#3402) 
Broadcast src0 into src1 across dimensions 2 and 3 when needed.
This is required for models that use GQA.
 2023-10-02 21:26:15 +02:00
shibe2andGitHub 36b904e200 ggml-opencl.cpp: Make private functions static (#3300) 2023-09-21 14:10:26 -04:00