mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-29 10:42:18 +02:00
Code Issues Packages Projects Releases Wiki Activity
196 Commits 737 Branches 7,226 Tags
ab77d7631211b299cb734bea6ad1f74324154150
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Gary LinscottandGitHub 40ea807a97 Add details on perplexity to README.md (#395) 2023-03-22 08:53:54 -07:00
Gary LinscottandGitHub 486ae645fd Compute perplexity over prompt (#270) 
* Compute perplexity over prompt

* More accurate perplexity calculation - over all logits in the context window (so 512x more tokens!)

* Output all perplexitiies

* Add timing/ETA
 2023-03-21 18:27:42 +02:00
Gary LinscottandGitHub a81d0c2a17 Fix n^2 loop in tokenization (#254) 
This causes long prompts to parse very slowly.
 2023-03-18 11:17:19 +00:00