mozempk/ggml-org-llama-cpp-mirror
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-03 05:02:21 +02:00
Code Issues Packages Projects Releases Wiki Activity
1,287 Commits 756 Branches 7,307 Tags
0e76a8992c8200237bbc6471a53fb8796b3872f7
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Bach LeandGitHub 7cdd30bf1f cuda : allocate all temporary ggml_tensor_extra_gpu from a fixed-size buffer (#2220) 2023-07-14 22:00:58 +03:00
Bach LeandGitHub 7513b7b0a1 llama : add functions that work directly on model (#2197) 
* Remove vocab reference from context

* Add functions that works directly with model
 2023-07-14 21:55:24 +03:00
Bach LeandGitHub c9c74b4e3f llama : add classifier-free guidance (#2135) 
* Initial implementation

* Remove debug print

* Restore signature of llama_init_from_gpt_params

* Free guidance context

* Make freeing of guidance_ctx conditional

* Make Classifier-Free Guidance a sampling function

* Correct typo. CFG already means context-free grammar.

* Record sampling time in llama_sample_classifier_free_guidance

* Shift all values by the max value before applying logsoftmax

* Fix styling based on review
 2023-07-11 19:18:43 +03:00