KKKZOZ's Blog
Recent posts
  1. /42
    2025-08-17

    KV-Runahead Scalable Causal LLM Inference by Parallel Key-Value Cache Generation

    ICML-24Tensor-Parallelism
  2. /41
    2025-08-12

    LLM.int8() 8-bit Matrix Multiplication for Transformers at Scale

    NIPS2022Quantization
  3. /40
    2025-08-08

    LLM Generated Content

    Misc.
  4. /39
    2025-08-04

    LLM Preliminaries

    LLM-Inference
  5. /38
    2025-08-04

    Fast On-device LLM Inference with NPUs

    LLM-InferenceEdge-DevicesNPU
  6. /37
    2025-08-04

    Deja Vu Contextual Sparsity for Efficient LLMs at Inference Time

    arXiv-23LLM-InferenceTheoretical
  7. /36
    2025-08-01

    Transactions Papers Index

  8. /35
    2025-08-01

    Distributed Papers Index

  9. /34
    2025-07-30

    LLM in a flash Efficient Large Language Model Inference with Limited Memory

    ACL-24LLM-InferenceCommodity-GPU
  10. /33
    2025-07-29

    PowerInfer-2 Fast Large Language Model Inference on a Smartphone

    arXiv-24LLM-InferenceEdge-Devices