3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
bosh	6184e92c57	model : use exact GELU for ModernBERT encoders (#30108) ... * model : use exact GELU for ModernBERT encoders Assisted-by: Codex * model : keep tanh GELU aliases on ggml_geglu Assisted-by: Claude Opus 5.5 * model : map gelu_python to ggml_geglu_erf Assisted-by: Claude Opus 5.5	2026-10-09 23:26:56 +08:00
bosh	37ac634566	model : support classifier_activation for rerankers (#29692) ... * model : support classifier_activation for rerankers Assisted-by: Claude Opus 5.5 * model : map classifier gelu to gelu_erf and accept tanh Assisted-by: Claude Opus 5.5 * model : default act_cls to tanh, ModernBERT falls back to gelu_erf Assisted-by: Claude Opus 5.5	2026-10-08 09:29:20 +03:00
bosh	48de2a1bcb	model : support classifier_pooling for rerankers (#29627) ... * model : support classifier_pooling for ModernBERT rerankers Assisted-by: Claude Opus 5.5 * model : read classifier pooling type in load_hparams Write classifier.pooling_type from _try_set_pooling_type whenever the config has classifier_pooling, and read it in llama_model_base::load_hparams. ModernBERT falls back to mean when it is unspecified. Assisted-by: Claude Opus 5.5 * conversion : only accept cls and mean for classifier_pooling Assisted-by: Claude Opus 5.5 * model : rename classifier_pooling_type to pooling_type_cls Assisted-by: Claude Opus 5.5	2026-09-29 22:33:05 +02:00