Recent posts
- /822026-02-08
Swift On-the-fly Self-speculative Decoding For LLM Inference Acceleration
- /812026-02-08
Draft & Verify Lossless Large Language Model Acceleration via Self-Speculative Decoding
- /802026-02-07
Hierarchical Speculative Decoding with Dynamic Windows for Efficient Language Model Inference
- /792026-02-07
CAS-Spec Cascade Adaptive Self-Speculative Decoding for On-the-Fly Lossless Inference Acceleration of LLMs
- /782026-02-05
Revati Transparent GPU-Free Time-Warp Emulation for LLM Serving
- /772026-02-05
AIConfigurator Lightning-Fast Configuration Optimization for Multi-Framework LLM Serving
- /762026-02-02
R-Stitch Dynamic Trajectory Stitching for Efficient Reasoning
- /752026-02-02
Estimating LLM Uncertainty with Evidence
- /742026-01-29
XAttention Block Sparse Attention with Antidiagonal Scoring
- /732026-01-29
FlexPrefill A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference