mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-11 00:52:23 +02:00
Code Issues Packages Projects Releases Wiki Activity
2,183 Commits 780 Branches 7,393 Tags
7ad554f90e735cf2a0f612ce44f9aa4fad6ae46a
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Pierrick HymbertandGitHub c145f8a132 server : slots monitoring endpoint (#5550) 2024-02-18 19:39:57 +02:00
Pierrick HymbertandGitHub e75c6279d1 server : enhanced health endpoint (#5548) 
* server: enrich health endpoint with available slots, return 503 if not slots are available

* server: document new status no slot available in the README.md
 2024-02-18 18:31:28 +02:00
Pierrick HymbertandGitHub 36376abe05 server : --n-predict option document and cap to max value (#5549) 
* server: document --n-predict

* server: ensure client request cannot override n_predict if set

* server: fix print usage LF in new --n-predict option
 2024-02-18 18:30:09 +02:00