mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-10-26 13:50:39 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,632 Commits 902 Branches 8,183 Tags
ad76569f8e78ab6ca921bda25cef25a157361719
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Masaya, Kato da3913d8f9 batched: fix n_predict parameter (#8527) 2024-07-17 10:34:28 +03:00
Masaya, KatoGeorgi Gerganovslaren
 		a5735e4426 ggml : use OpenMP as a thread pool (#7606) 
* ggml: Added OpenMP for multi-threads processing

* ggml : Limit the number of threads used to avoid deadlock

* update shared state n_threads in parallel region

* clear numa affinity for main thread even with openmp

* enable openmp by default

* fix msvc build

* disable openmp on macos

* ci : disable openmp with thread sanitizer

* Update ggml.c

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: slaren <slarengh@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-06-03 17:14:15 +02:00
Masaya, Kato faa0e6979a ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (#7433) 
* Add SVE support for q4_0_q8_0 q8_0_q8_0

* remove ifdef
 2024-05-25 11:42:31 +03:00