KKKZOZ's Blog
Recent posts
  1. /52
    2025-08-25

    STI Turbocharge NLP Inference at the Edge via Elastic Pipelining

    ASPLOS-23LLM-Inference
  2. /51
    2025-08-25

    SmallThinker A Family of Efficient Large Language Models Natively Trained for Local Deployment

    arXiv-25Edge-Devices
  3. /50
    2025-08-24

    HeteroLLM Accelerating Large Language Model Inference on Mobile SoCs with Heterogeneous AI Accelerators

    arXiv-25LLM-InferenceGPUNPU
  4. /49
    2025-08-24

    EdgeMoE Empowering Sparse Large Language Models on Mobile Devices

    IEEE-TMC-25LLM-InferenceMoE
  5. /48
    2025-08-21

    H2O Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models

    NIPS-23KVCache
  6. /47
    2025-08-21

    A Survey of Resource-efficient LLM and Multimodal Foundation Models

    arXiv-24Survey
  7. /46
    2025-08-18

    LLM as a System Service on Mobile Devices

    arXiv-24
  8. /45
    2025-08-17

    TPI-LLM Serving 70B-scale LLMs Efficiently on Low-resource Mobile Devices

    TSC-24LLM-InferenceTensor-Parallelism
  9. /44
    2025-08-17

    Striped Attention Faster Ring Attention for Causal Transformers

    arXiv-24Tensor-Parallelism
  10. /43
    2025-08-17

    Ring Attention with Blockwise Transformers for Near-Infinite Context

    arXiv-23Sequence-Parallelism