3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
3 people	b9ec82d262	grammar : check the full vocab only if necessary (opt) (#4306) ... * Check the full vocab for grammar only if necessary * Fix missing logit restoration step (?) Does this matter, actually? * Fix whitespace / formatting * Adjust comment * Didn't mean to push test gbnf * Split sampling into the helper function (?) And also revert the changes made to the header * common : fix final newline --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2023-12-23 11:27:07 +02:00
kalomazeandGitHub	fecac45658	server : tweak default sampling parameters (#4367) ... * Set a more typical Top P setting as the default * Update temp max	2023-12-12 12:12:35 +02:00
4 people	238657db23	samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841) ... * Introduce the new Min-P sampler by @kalomaze The Min-P sampling method was designed as an alternative to Top-P, and aims to ensure a balance of quality and variety. The parameter *p* represents the minimum probability for a token to be considered, relative to the probability of the most likely token. * Min-P enabled and set to 0.05 default --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> Co-authored-by: cebtenzzre <cebtenzzre@gmail.com>	2023-10-31 20:44:49 +01:00