mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-11-04 18:17:59 +01:00
Code Issues Packages Projects Releases Wiki Activity
8,135 Commits 951 Branches 8,343 Tags
72b44c0d212d53acd49b3fb344979e4adb2ade32
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
beillerBill HamiltonGeorgi Gerganov
 		02f0c6fe7f Add back top_k (#56) 
* Add back top_k

* Update utils.cpp

* Update utils.h

---------

Co-authored-by: Bill Hamilton <bill.hamilton@shopify.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-12 22:23:15 +02:00
beillerandGeorgi Gerganov 129c7d1ea8 Add repetition penalty (#20) 
* Adding repeat penalization

* Update utils.h

* Update utils.cpp

* Numeric fix

Should probably still scale by temp even if penalized

* Update comments, more proper application

I see that numbers can go negative so a fix from a referenced commit

* Minor formatting

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-12 11:27:42 +02:00