mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2026-10-11 07:20:33 +02:00
* CUDA: fuse copy of updated state snapshots into recurrent cache with ssm_scan * CUDA: remove redundant cuda copies with K==1 (non spec-dec) scenario as well