Oliver Simons 29995854dc Add FP8 KV-cache support

2026-10-09 21:07:43 +02:00

..

jinja

model : add K2 Horizon dense and MoVA support (#29535)

2026-10-06 18:42:24 +02:00

parsers

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

arg.cpp

Add FP8 KV-cache support

2026-10-09 21:07:43 +02:00

arg.h

server : improve startup log messages (#29125)

2026-09-19 15:37:13 +03:00

base64.hpp

llava : expose as a shared library for downstream projects (#3613)

2023-11-07 00:36:23 +03:00

build-info.cpp.in

common : make build info output stream configurable (#28322)

2026-09-04 09:13:20 +03:00

build-info.h

common : make build info output stream configurable (#28322)

2026-09-04 09:13:20 +03:00

chat-auto-parser-generator.cpp

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

chat-auto-parser-helpers.cpp

common: add json.h abstraction (#27511)

2026-08-22 16:28:28 +02:00

chat-auto-parser-helpers.h

chat : avoid including json in chat.h (#21306)

2026-04-03 09:07:59 +03:00

chat-auto-parser.h

common: add json.h abstraction (#27511)

2026-08-22 16:28:28 +02:00

chat-diff-analyzer.cpp

common: add json.h abstraction (#27511)

2026-08-22 16:28:28 +02:00

chat-peg-parser.cpp

chat : name tool and argument parser rules by index (#30088)

2026-10-07 22:37:51 +02:00

chat-peg-parser.h

common: add json.h abstraction (#27511)

2026-08-22 16:28:28 +02:00

chat.cpp

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

chat.h

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

CMakeLists.txt

cmake : remove precompiled headers (#28892)

2026-09-14 16:07:28 +02:00

common.cpp

ui: Models Manager Follow-up Improvements (#30228)

2026-10-09 19:28:54 +02:00

common.h

ui: Models Manager Follow-up Improvements (#30228)

2026-10-09 19:28:54 +02:00

console.cpp

cli: exit on stdin EOF and drop the console wide Ctrl+C broadcast (#29722)

2026-09-30 16:24:46 +02:00

console.h

cli : add command and file auto-completion (#19985)

2026-03-05 10:47:28 +01:00

debug.cpp

common: fix missing exports in llama-common (#22340)

2026-04-27 08:06:39 +03:00

debug.h

common: fix missing exports in llama-common (#22340)

2026-04-27 08:06:39 +03:00

download.cpp

common : add common_is_tty() helper and fix deprecated warnings on Windows (#29860)

2026-10-03 15:48:24 +02:00

download.h

server: add dedup-cache-models preset option (#27346)

2026-08-19 11:04:26 +02:00

fit.cpp

Revert "Change max context length for auto-fitting with unified KV (#28849)" (#29437)

2026-09-26 07:59:15 -07:00

fit.h

fit: also take into account n_streams (#27496)

2026-08-22 16:16:06 +02:00

hf-cache.cpp

common : add fs_write_atomic() (#29642)

2026-09-29 13:46:53 +02:00

hf-cache.h

server : improve startup log messages (#29125)

2026-09-19 15:37:13 +03:00

http.h

cli : move to HTTP-based implementation (#24948)

2026-07-08 14:52:43 +02:00

imatrix-loader.cpp

imatrix: calculate activation-based statistics for new format (GGUF) imatrices (#14891)

2026-10-04 11:24:53 +02:00

imatrix-loader.h

imatrix: calculate activation-based statistics for new format (GGUF) imatrices (#14891)

2026-10-04 11:24:53 +02:00

json-schema-to-grammar.cpp

json-schema : accept escaped hyphen in regex patterns (#29127)

2026-09-19 14:11:13 +02:00

json-schema-to-grammar.h

common : implement common_schema internal representation for JSON schemas (#28736)

2026-09-12 16:14:50 -05:00

json-schema.cpp

common : implement common_schema internal representation for JSON schemas (#28736)

2026-09-12 16:14:50 -05:00

json-schema.h

common : implement common_schema internal representation for JSON schemas (#28736)

2026-09-12 16:14:50 -05:00

json.cpp

common: json.h: fix clang lto (#27575)

2026-08-23 01:11:10 +02:00

json.h

json: Fixed json enum handling (#28518)

2026-09-21 10:32:07 +02:00

llguidance.cpp

llama : support multi-output backend sampling (#25532)

2026-08-10 16:58:56 +03:00

log.cpp

log, server: self contained colors, split child commands from logs in router mode (#29895)

2026-10-05 01:59:37 +02:00

log.h

log, server: self contained colors, split child commands from logs in router mode (#29895)

2026-10-05 01:59:37 +02:00

ngram-cache.cpp

spec : add self‑speculative decoding (no draft model required) + refactor (#18471)

2026-01-28 19:42:42 +02:00

ngram-cache.h

spec : add self‑speculative decoding (no draft model required) + refactor (#18471)

2026-01-28 19:42:42 +02:00

ngram-map.cpp

speculative : fix out-of-bounds read in ngram-map on prompt shrink (#23936)

2026-07-07 10:25:04 +03:00

ngram-map.h

fix: correct misspellings in code comments (#21217)

2026-03-31 13:50:51 +02:00

ngram-mod.cpp

ngram-mod : Add missing include (#23857)

2026-05-29 09:21:37 +03:00

ngram-mod.h

ngram-mod : fix build [no ci] (#19216)

2026-01-30 21:27:27 +02:00

peg-parser.cpp

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

peg-parser.h

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

preset.cpp

common : prepare load_from_models_dir() for path conversion (#29674)

2026-10-04 11:35:33 +03:00

preset.h

common : use fs::path for config dir (#29649)

2026-09-29 17:22:49 +02:00

reasoning-budget.cpp

llama : support multi-output backend sampling (#25532)

2026-08-10 16:58:56 +03:00

reasoning-budget.h

common : add support for multiple end sequences in the reasoning budget sampler (#25544)

2026-07-25 11:58:09 +02:00

sampling.cpp

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

sampling.h

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

speculative.cpp

llama : add a GPU cache for MoE experts kept in host memory (#29887)

2026-10-07 21:07:45 +03:00

speculative.h

imatrix: calculate activation-based statistics for new format (GGUF) imatrices (#14891)

2026-10-04 11:24:53 +02:00

subproc.cpp

common: add subproc.h wrapper, disabled on android/ios (#26102)

2026-07-26 20:54:25 +02:00

subproc.h

common: add subproc.h wrapper, disabled on android/ios (#26102)

2026-07-26 20:54:25 +02:00

trie.cpp

common : add support for multiple end sequences in the reasoning budget sampler (#25544)

2026-07-25 11:58:09 +02:00

trie.h

common : add support for multiple end sequences in the reasoning budget sampler (#25544)

2026-07-25 11:58:09 +02:00

unicode.cpp

common/peg : handle invalid utf-8 sequences in the AST (#29161)

2026-09-20 06:51:40 -05:00

unicode.h

common/peg : handle invalid utf-8 sequences in the AST (#29161)

2026-09-20 06:51:40 -05:00