mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-11 00:52:23 +02:00
Code Issues Packages Projects Releases Wiki Activity
2,283 Commits 780 Branches 7,393 Tags
7c4263d4261d6ee6f0539d53eb9e1b4d120ba8af
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
compiladeandGitHub f7625019c5 server : fix crash when system prompt is bigger than batch size (#5714) 
The system prompt is now decoded in batches.

* server : fix off-by-one n_past when start of prompt matches whole cache

The tokens right after the matching part would otherwise skip a pos value.
 2024-02-25 20:43:50 +02:00
compiladeandGitHub d6bd4d46dd llama : support StableLM 2 1.6B (#5052) 
* llama : support StableLM 2 1.6B

* convert : fix Qwen's set_vocab wrongly naming all special tokens [PAD{id}]

* convert : refactor Qwen's set_vocab to use it for StableLM 2 too

* nix : add tiktoken to llama-python-extra

* convert : use presence of tokenizer.json to determine StableLM tokenizer loader

It's a less arbitrary heuristic than the vocab size.
 2024-01-22 13:21:52 +02:00