4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Anav PrasadandJohannes Gäßler	88458164c7	CUDA: Add Flash Attention Support for Head Dimension 512 (#20998) ... * flash attention support for head dimension 512 added * FA D=512 - match 576 configs, limit ncols2, revert vec cap * fix HIP tile kernel build for D=512 * fix HIP tile kernel occupancy for D=512 on AMD * Apply suggestions from code review Co-authored-by: Johannes Gäßler <johannesg@5d6.de> * fix tile FA compilation --------- Co-authored-by: Johannes Gäßler <johannesg@5d6.de>	2026-04-01 09:07:24 +02:00
Anav Prasad	01d8eaa28d	mtmd : Add Nemotron Nano 12B v2 VL support (#19547) ... * nemotron nano v2 vlm support added * simplified code; addressed reviews * pre-downsample position embeddings during GGUF conversion for fixed input size	2026-02-14 14:07:00 +01:00
Anav Prasad	5b6913c47b	cuda : remove legacy copy-op pointer indirection code (#16485) ... * remove legacy copy-op pointer indirection code * further removal of copy-op indirection code * renamed check_node_graph_compatibility_and_refresh_copy_ops function	2025-10-14 11:53:49 +02:00
anavp-nvidia	a014310374	cuda : Enable CUDA Graph usage for Nemotron Nano v2 (NemotronH) (#16328) ... * Fix Nemotron Nano v2 9B not executing as CUDA Graph on NVIDIA GPUs * fix to ensure test-backend-ops check passes	2025-09-30 11:13:22 +03:00