mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-11-07 19:47:58 +01:00
Code Issues Packages Projects Releases Wiki Activity
5,437 Commits 963 Branches 8,404 Tags
b7a17463ec190aeee7b9077c606c910fb4688b84
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Xinpeng Dou f0adb80bf7 CANN: Update CANN model support (#13162) 
* Update CANN model support status

* Update of model support

* update

* update

* update

* fix format of CANN.md

* fix format of CANN.md

* fix format of CANN.md
 2025-05-20 11:43:43 +08:00
Xinpeng Dou b0c75ac9f9 CANN: Optimize CANN buffer pool memory management (#12875) 
Multiple optional memory pools are provided for CANN, including VMM, 
priority queue-based, and traditional memory pools.
1.When the memory pool is available and GGML_CANN_DISABLE_VMM_POOL 
   is not defined, the VMM pool is selected by default.
2.Otherwise, if GGML_CANN_ENABLE_BUF_PRIO_POOL is defined, 
   the priority queue-based memory pool is used.
3.If neither condition is met, the default memory pool is used.
 2025-04-15 10:04:24 +08:00
Dou Xinpeng 904837e0cb cann: fix crash when llama-bench is running on multiple cann devices (#9627) 2024-09-25 11:30:38 +08:00