Aman Gupta 9f682fb640 ggml-cpu: FA split across kv for faster TG (#19209) ...

* ggml-cpu: split across kv for faster TG

* simplify sinks application

* add ref impl

2026-02-03 01:19:55 +08:00

..

amx

ggml : fix unaligned access in AMX code (#16315)

2025-10-06 16:05:27 +03:00

arch

ggml-cpu: arm64: Q4_K scale unroll and vectorization (#19108)

2026-01-28 09:15:56 +02:00

cmake

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

kleidiai

kleidiai: add and integrate SVE 256-bit vector-length kernel (#18458)

2025-12-30 14:04:53 +02:00

llamafile

ggml-cpu: Enable FP16 MMA kernels on PPC (#19060)

2026-01-27 11:52:34 +08:00

spacemit

ggml : fix SpaceMit IME array out-of-bounds in task assignment (#16629)

2025-10-17 13:01:23 +03:00

arch-fallback.h

ggml-cpu: aarm64: q6_K repack gemm and gemv (and generic) implementations (i8mm) #18860 (#18888)

2026-01-27 11:08:10 +02:00

binary-ops.cpp

cpu: de-duplicate some of the operators and refactor (ggml/1144)

2025-03-30 08:33:31 +03:00

binary-ops.h

cpu: de-duplicate some of the operators and refactor (ggml/1144)

2025-03-30 08:33:31 +03:00

CMakeLists.txt

kleidiai: add and integrate SVE 256-bit vector-length kernel (#18458)

2025-12-30 14:04:53 +02:00

common.h

ggml-cpu: Use tiled FA for prompt-processing (#19012)

2026-01-25 23:25:58 +08:00

ggml-cpu-impl.h

ggml-cpu: FA split across kv for faster TG (#19209)

2026-02-03 01:19:55 +08:00

ggml-cpu.c

ggml-cpu: FA split across kv for faster TG (#19209)

2026-02-03 01:19:55 +08:00

ggml-cpu.cpp

ggml-cpu: FA split across kv for faster TG (#19209)

2026-02-03 01:19:55 +08:00

hbm.cpp

ggml-cpu : split arch-specific implementations (#13892)

2025-06-09 16:47:13 +02:00

hbm.h

ggml-cpu : split arch-specific implementations (#13892)

2025-06-09 16:47:13 +02:00

ops.cpp

ggml-cpu: FA split across kv for faster TG (#19209)

2026-02-03 01:19:55 +08:00

ops.h

ggml : add ggml_top_k (#17365)

2025-11-25 15:31:43 +02:00

quants.c

llama : add gpt-oss (#15091)

2025-08-05 22:10:36 +03:00

quants.h

llama : add gpt-oss (#15091)

2025-08-05 22:10:36 +03:00

repack.cpp

ggml-cpu: aarm64: q6_K repack gemm and gemv (and generic) implementations (i8mm) #18860 (#18888)

2026-01-27 11:08:10 +02:00

repack.h

ggml-cpu: aarm64: q6_K repack gemm and gemv (and generic) implementations (i8mm) #18860 (#18888)

2026-01-27 11:08:10 +02:00

simd-mappings.h

ggml-cpu: optimize ggml_vec_dot_bf16 for Power9 (#18837)

2026-01-15 17:31:18 +08:00

traits.cpp

ggml : fix fallback to CPU for ununsupported ops (#15118)

2025-08-06 14:37:35 +02:00

traits.h

ggml : fix fallback to CPU for ununsupported ops (#15118)

2025-08-06 14:37:35 +02:00

unary-ops.cpp

ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (#17063)

2025-11-13 20:54:47 +02:00

unary-ops.h

ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (#17063)

2025-11-13 20:54:47 +02:00

vec.cpp

ggml-cpu: optimize ggml_vec_dot_bf16 for Power9 (#18837)

2026-01-15 17:31:18 +08:00

vec.h

ggml-cpu: extend support for RVV floating-point kernels (#17318)

2025-12-18 16:02:09 +02:00