mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-29 10:42:18 +02:00
Code Issues Packages Projects Releases Wiki Activity
196 Commits 737 Branches 7,226 Tags
ab77d7631211b299cb734bea6ad1f74324154150
Commit Graph
4 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Erik ScholzandGitHub 4122dffff9 cmake: make llama an actual library (#392) 2023-03-22 18:37:10 +02:00
Erik ScholzandGitHub 56e659a0b2 fix perplexity after c-api refactor (#390) 
* preallocate a buffer of fitting size for tokenization (utils.cpp)

* don't create a new std::string (especially here, where it's usually large)
 2023-03-22 18:09:38 +02:00
Erik ScholzandGitHub 01a297b099 specify build type for ctest on windows (#371) 2023-03-21 23:34:25 +02:00
Erik ScholzGitHubTy Everett
 		0b366e7357 Command line switch to use F16 for memory_k and memory_v (refactor of #154) (#294) 
* Use F16 for memory_k and memory_v

* add command line switch to use f16 instead of f32 for memory k+v

---------

Co-authored-by: Ty Everett <ty@tyweb.us>
 2023-03-19 19:57:00 +02:00