mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-05 06:02:19 +02:00
Code Issues Packages Projects Releases Wiki Activity
344 Commits 770 Branches 7,331 Tags
c14e0d2f23e6d1e785255f4da8c253c1b4723659
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
RonsorandGitHub d7def1a752 Warn user if a context size greater than 2048 tokens is specified (#274) 
LLaMA doesn't support more than 2048 token context sizes, and going above that produces terrible results.
 2023-03-18 20:10:47 -04:00
RonsorandGitHub 956dfda8ad Use tokenizer.vocab_size() instead of hardcoding 32000 in convert-pth-to-ggml.py (#142) 
There are ways that special tokens or other new tokens could be added to the tokenizer; therefore it's probably best not to assume the vocabulary is only 32000 tokens.
 2023-03-15 21:37:50 +02:00
RonsorGitHubGeorgi Gerganov
 		47857e564c Don't use vdotq_s32 if it's not available (#139) 
* Don't use vdotq_s32 if it's not available

`dotprod` extensions aren't available on some ARM CPUs (e.g. Raspberry Pi 4), so check for them and only use them if they're available.

Reintroduces the code removed in 84d9015 if `__ARM_FEATURE_DOTPROD` isn't defined.

* Update ggml.c

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-14 21:34:37 +02:00