mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-27 01:48:32 +02:00
Code Issues Packages Projects Releases Wiki Activity
5,161 Commits 728 Branches 7,194 Tags
6602304814e679cc8c162bb760a034aceb4f8965
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nicolò ScipioneandGitHub 94148ba330 sycl: allow ggml-sycl configuration and compilation using Visual Studio project/solution (#12625) 2025-04-04 16:00:46 +02:00
Nicolò ScipioneandGitHub 99487b57d4 SYCL: Introducing memory host pool (#11251) 
* Implement host pool for matrix_info

Creating a new memory pool on the host to store memory location for
matrix_info needed to launch gemm_batch from oneMKL/oneMath.
Removing complex support in gemm_batch since it is not used in llama.cpp

* Remove unnecessary headers and cast

* Reorder member variable to avoid warning on initialization

* Formatting

* Remove unused variable

* Address PR review feedback - remove warning

---------

Signed-off-by: nscipione <nicolo.scipione@codeplay.com>
 2025-01-19 21:33:34 +08:00
Nicolò ScipioneandGitHub 40c6d79fb5 SYCL : Move to compile time oneMKL interface backend selection for NVIDIA backend (#10584) 
* [SYCL] Move to Compile Time backend selection on oneMKL Interface for NVIDIA backend

Move to compile time selection to backend to avoid latency at run time.
Add it to all mkl gemm calls and only for NVIDIA backend.

Signed-off-by: nscipione <nicolo.scipione@codeplay.com>

* Formatting

* Address PR comments to increase readibility

---------

Signed-off-by: nscipione <nicolo.scipione@codeplay.com>
 2024-12-04 09:29:20 +08:00