SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling
-
Updated
Aug 14, 2025 - Python
#
block-sparse-attention
Here are 4 public repositories matching this topic...
a high-performance Block Sparse Attention kernel in Triton
-
Updated
Nov 14, 2025 - Python
Pre-compiled custom CUDA extension for Block Sparse Attention (Python 3.11 / PyTorch 2.6.0+cu124).
python machine-learning cuda pytorch pytorch-extension llm-optimization cuda-12 block-sparse-attention precompiled-wheel
-
Updated
May 4, 2026
Intent-aware KV execution prototype for agentic long-context inference: semantic block selection, dynamic scoring, KV quantization modeling, speculative prefetch simulation, CPU references, and future Triton/CUDA kernels.
cost-model triton memory-bandwidth gpu-kernels mixed-precision prefetching inference-optimization kv-cache sparse-attention long-context paged-attention semantic-routing agentic-ai block-sparse-attention kernel-research block-attention semantic-attention kv-quantization paged-kv kv-cache-optimization
-
Updated
May 29, 2026 - Python
Improve this page
Add a description, image, and links to the block-sparse-attention topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the block-sparse-attention topic, visit your repo's landing page and select "manage topics."