mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-12 09:23:00 +02:00
Code Issues Packages Projects Releases Wiki Activity
1,418 Commits 784 Branches 7,403 Tags
9d02956443e5c1ded29b7b5ed8a21bc01ba6f563
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
GalunidandGitHub 69a6735087 Update special token handling in conversion scripts for gpt2 derived tokenizers (#3746) 
We still have the heads up in `README.md` regarding `bpe` tokenizers and this patch is needed for 

- a couple of tokenizer tests
- some more `special` and `non-special` added tokens handling (as far as I understand it)

* Update special token handling

* Add mpt
 2023-10-23 21:46:00 +02:00
GalunidandGitHub 6336701c93 Fix baichuan convert script not detecing model (#3739) 
It seems nobody objects.
 2023-10-23 17:47:03 +02:00
GalunidandGitHub 9f6ede19f3 Add MPT model to supported models in README.md (#3574) 2023-10-10 19:02:49 -04:00