KKKZOZ's Blog
Recent posts
  1. /32
    2025-07-28

    PowerInfer Fast Large Language Model Serving with a Consumer-grade GPU

    SOSP-24LLM-InferenceCommodity-GPU
  2. /31
    2025-07-28

    LLM Inference Papers Index

  3. /30
    2025-07-28

    AWQ Activation-aware Weight Quantization for LLM Compression and Acceleration

    arXiv-23LLM-InferenceQuantization
  4. /29
    2025-07-25

    SpecInfer Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification

    ASPLOS-24LLM-InferenceSpeculative-Decoding
  5. /28
    2025-07-25

    LoRA Low-Rank Adaptation of Large Language Models

    arXiv-21LLM-Tuning
  6. /27
    2025-07-25

    FlexGen High-Throughput Generative Inference of Large Language Models with a Single GPU

    ICML-23LLM-InferenceCommodity-GPU
  7. /26
    2025-07-23

    Efficient Memory Management for Large Language Model Serving with PagedAttention

    arXiv-23LLM-InferenceMemory-Management
  8. /25
    2025-07-23

    EdgeLLM Fast On-Device LLM Inference With Speculative Decoding

    IEEE-TMC-25LLM-InferenceSpeculative-DecodingEdge-Devices
  9. /24
    2025-07-20

    A Survey on Efficient Inference for Large Language Models

    arXiv-24LLM-InferenceSurvey
  10. /23
    2025-07-13

    Sonata Multi-Database Transactions Made Fast and Serializable

    VLDB-25Distributed-Transactions