KKKZOZ's Blog
Recent posts
  1. /62
    2025-11-13

    Efficient Streaming Language Models with Attention Sinks

    ICLR-24KVCacheLong-Context
  2. /61
    2025-11-13

    DuoAttention Efficient Long-Context LLM Inference with Retrieval and Streaming Heads

    LLM-InferenceLong-ContextKVCache
  3. /60
    2025-11-11

    Dynamic Sparse Attention on Mobile SoCs

    arXiv-25Edge-Devices
  4. /59
    2025-11-11

    A dynamic parallel method for performance optimization on hybrid CPUs

    arXiv-24
  5. /58
    2025-11-10

    EAGLE Speculative Sampling Requires Rethinking Feature Uncertainty

    ICML-24LLM-Inference
  6. /57
    2025-11-03

    Splitwise Efficient Generative LLM Inference Using Phase Splitting

    ISCA24LLM-Serving
  7. /56
    2025-11-03

    DistServe Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving

    OSDI-24LLM-Serving
  8. /55
    2025-11-01

    Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve

    OSDI-24LLM-Serving
  9. /54
    2025-09-01

    Scaling Up On-Device LLMs via Active-Weight Swapping Between DRAM and Flash

    arXiv-25LLM-InferenceEdge-DevicesSparsity
  10. /53
    2025-08-27

    ELMS Elasticized Large Language Models On Mobile Devices

    arXiv-24LLM-InferenceEdge-Devices