Oliver Simons 29995854dc Add FP8 KV-cache support

2026-10-09 21:07:43 +02:00

..

batched-bench

batch: migrate the rest of examples to llama_batch_ext (#29601)

2026-09-30 18:08:43 +02:00

cli

server: use port 9931 by default (#30159)

2026-10-09 10:40:03 +02:00

completion

llama: support MoE cache over multiple GPUs (#30112)

2026-10-08 15:50:49 +05:30

cvector-generator

batch: migrate the rest of examples to llama_batch_ext (#29601)

2026-09-30 18:08:43 +02:00

export-lora

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

2026-06-18 16:46:17 +02:00

fit-params

server: use port 9931 by default (#30159)

2026-10-09 10:40:03 +02:00

gguf-split

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

imatrix

imatrix : include clocale for std::setlocale (#30079)

2026-10-07 10:58:22 +02:00

llama-bench

Add FP8 KV-cache support

2026-10-09 21:07:43 +02:00

mtmd

model : add LiquidAI/d1-omni-600M decision model (#30114)

2026-10-08 02:07:49 +02:00

perplexity

batch: migrate the rest of examples to llama_batch_ext (#29601)

2026-09-30 18:08:43 +02:00

quantize

quantize: cap working memory size to avoid loading big tensors onto RAM (#27795)

2026-08-27 18:31:13 +02:00

results

batch: migrate the rest of examples to llama_batch_ext (#29601)

2026-09-30 18:08:43 +02:00

rpc

common,rpc : fix cache dir creation through symlinks on buggy libstdc++ (#29816)

2026-10-01 20:15:02 +02:00

server

ui: Models Manager Follow-up Improvements (#30228)

2026-10-09 19:28:54 +02:00

tokenize

tokenize : drop --stdin mutual-exclusion check (#25672)

2026-07-15 18:41:51 +02:00

tts

args: add --video-* CLI arguments (#24318)

2026-08-27 12:11:12 +02:00

tuning

metal : key the fa-vec tuned table by family instead of SKU (#29075)

2026-09-23 19:23:15 +08:00

ui

ui: Models Manager Follow-up Improvements (#30228)

2026-10-09 19:28:54 +02:00

CMakeLists.txt

metal : per-device tuned (Q, NE) for flash-attn vec (#26570)

2026-08-24 19:22:27 +03:00