mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-11-04 10:08:00 +01:00
Code Issues Packages Projects Releases Wiki Activity
5,182 Commits 948 Branches 8,338 Tags
c6e8cc28c15166dba15629dba6a7366d4d5955ca
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Xinpeng Dou b0c75ac9f9 CANN: Optimize CANN buffer pool memory management (#12875) 
Multiple optional memory pools are provided for CANN, including VMM, 
priority queue-based, and traditional memory pools.
1.When the memory pool is available and GGML_CANN_DISABLE_VMM_POOL 
   is not defined, the VMM pool is selected by default.
2.Otherwise, if GGML_CANN_ENABLE_BUF_PRIO_POOL is defined, 
   the priority queue-based memory pool is used.
3.If neither condition is met, the default memory pool is used.
 2025-04-15 10:04:24 +08:00
Dou Xinpeng 904837e0cb cann: fix crash when llama-bench is running on multiple cann devices (#9627) 2024-09-25 11:30:38 +08:00