Xuan-Son NguyenandGitHub decaf508bb server: refactor + correctness fixes for metrics (#26920) ...

* server: refactor metrics

* move most fields to server_slot_stats

* cont

* rm result_timings

* tie stats to batch

* cont

* nits: move place in code

* exclude first generated token

* more accurate batch metrics tracking

* n_predict --> n_gen

* metrics_on_prediction

* metrics_flush_idle

* metrics: seperate cache/processed prompt tokens

* refactor server_task_result_metrics

* add test

* nits

* fix flush before reset()

* cont

* rm dead code

* nits

2026-08-13 10:02:01 +02:00

..

batched-bench

cmake : add install() for impl libraries + fix apple builds (#23511)

2026-05-22 11:46:26 +03:00

cli

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

completion

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

cvector-generator

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

export-lora

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

2026-06-18 16:46:17 +02:00

fit-params

cmake : add install() for impl libraries + fix apple builds (#23511)

2026-05-22 11:46:26 +03:00

gguf-split

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

imatrix

imatrix.cpp: Move finite check and only check touched experts (#26861)

2026-08-11 11:18:19 -04:00

llama-bench

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

mtmd

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

parser

chat : enable tool call in thinking for DS4 (#26269)

2026-08-01 00:13:07 -05:00

perplexity

perplexity : fix format specifier in LOG_ERR (#23788)

2026-05-28 10:34:58 +03:00

quantize

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

results

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

rpc

binaries : Improve rpc-server and export-graph-ops names. (#25045)

2026-06-27 10:31:29 +03:00

server

server: refactor + correctness fixes for metrics (#26920)

2026-08-13 10:02:01 +02:00

tokenize

tokenize : drop --stdin mutual-exclusion check (#25672)

2026-07-15 18:41:51 +02:00

tts

mtmd: support pocket-tts (#26871)

2026-08-11 14:18:30 +02:00

ui

ui: Clean up contexts, remove prop drilling from Chat Form Actions (#26951)

2026-08-13 08:21:15 +02:00

CMakeLists.txt

cmake: skip cvector-generator and export-lora when CPU backend is disabled (#24053)

2026-06-04 13:13:19 +03:00