Archives

2025 ⁵⁹

August ²⁰

SmallThinker A Family of Efficient Large Language Models Natively Trained for Local Deployment

August 25, 2025 · Last updated on August 26, 2025 · 2 min · KKKZOZ

STI Turbocharge NLP Inference at the Edge via Elastic Pipelining

August 25, 2025 · Last updated on August 26, 2025 · 2 min · KKKZOZ

EdgeMoE Empowering Sparse Large Language Models on Mobile Devices

August 24, 2025 · Last updated on August 26, 2025 · 2 min · KKKZOZ

HeteroLLM Accelerating Large Language Model Inference on Mobile SoCs with Heterogeneous AI Accelerators

August 24, 2025 · Last updated on August 26, 2025 · 4 min · KKKZOZ

A Survey of Resource-efficient LLM and Multimodal Foundation Models

August 21, 2025 · Last updated on August 26, 2025 · 3 min · KKKZOZ

H2O Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models

August 21, 2025 · Last updated on August 26, 2025 · 1 min · KKKZOZ

LLM as a System Service on Mobile Devices

August 18, 2025 · Last updated on August 26, 2025 · 4 min · KKKZOZ

KV-Runahead Scalable Causal LLM Inference by Parallel Key-Value Cache Generation

August 17, 2025 · Last updated on August 25, 2025 · 2 min · KKKZOZ

Ring Attention with Blockwise Transformers for Near-Infinite Context

August 17, 2025 · Last updated on August 25, 2025 · 7 min · KKKZOZ

Striped Attention Faster Ring Attention for Causal Transformers

August 17, 2025 · Last updated on August 19, 2025 · 3 min · KKKZOZ

TPI-LLM Serving 70B-scale LLMs Efficiently on Low-resource Mobile Devices

August 17, 2025 · Last updated on August 26, 2025 · 2 min · KKKZOZ

LLM.int8() 8-bit Matrix Multiplication for Transformers at Scale

August 12, 2025 · Last updated on August 25, 2025 · 2 min · KKKZOZ

Git Essentials

August 8, 2025 · Last updated on August 25, 2025 · 12 min · KKKZOZ

LLM Generated Content

August 8, 2025 · Last updated on August 12, 2025 · 4 min · KKKZOZ

VSCode Essentials

August 6, 2025 · Last updated on August 10, 2025 · 4 min · KKKZOZ

Deja Vu Contextual Sparsity for Efficient LLMs at Inference Time

August 4, 2025 · Last updated on August 26, 2025 · 3 min · KKKZOZ

Fast On-device LLM Inference with NPUs

August 4, 2025 · Last updated on August 19, 2025 · 3 min · KKKZOZ

LLM Preliminaries

August 4, 2025 · Last updated on August 25, 2025 · 12 min · KKKZOZ

[Pinned] Transactions Papers Index

August 1, 2025 · Last updated on August 3, 2025 · 1 min · KKKZOZ

[Pinned] Distributed Papers Index

August 1, 2025 · Last updated on August 3, 2025 · 1 min · KKKZOZ

July ¹⁵

LLM in a flash Efficient Large Language Model Inference with Limited Memory

July 30, 2025 · Last updated on August 19, 2025 · 3 min · KKKZOZ

PowerInfer-2 Fast Large Language Model Inference on a Smartphone

July 29, 2025 · Last updated on August 19, 2025 · 4 min · KKKZOZ

[Pinned] LLM Inference Papers Index

July 28, 2025 · Last updated on August 26, 2025 · 2 min · KKKZOZ

AWQ Activation-aware Weight Quantization for LLM Compression and Acceleration

July 28, 2025 · Last updated on August 25, 2025 · 2 min · KKKZOZ

PowerInfer Fast Large Language Model Serving with a Consumer-grade GPU

July 28, 2025 · Last updated on August 26, 2025 · 3 min · KKKZOZ

FlexGen High-Throughput Generative Inference of Large Language Models with a Single GPU

July 25, 2025 · Last updated on August 19, 2025 · 3 min · KKKZOZ

LoRA Low-Rank Adaptation of Large Language Models

July 25, 2025 · Last updated on August 19, 2025 · 3 min · KKKZOZ

SpecInfer Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification

July 25, 2025 · Last updated on August 19, 2025 · 2 min · KKKZOZ

EdgeLLM Fast On-Device LLM Inference With Speculative Decoding

July 23, 2025 · Last updated on August 25, 2025 · 3 min · KKKZOZ

Efficient Memory Management for Large Language Model Serving with PagedAttention

July 23, 2025 · Last updated on August 19, 2025 · 3 min · KKKZOZ

A Survey on Efficient Inference for Large Language Models

July 20, 2025 · Last updated on August 25, 2025 · 21 min · KKKZOZ

Sonata Multi-Database Transactions Made Fast and Serializable

July 13, 2025 · Last updated on August 1, 2025 · 6 min · KKKZOZ

Concurrency Control as a Service

July 11, 2025 · Last updated on August 1, 2025 · 5 min · KKKZOZ

Orca A Distributed Serving System for Transformer-Based Generative Models

July 2, 2025 · Last updated on August 19, 2025 · 5 min · KKKZOZ

EdgeShard Efficient LLM Inference via Collaborative Edge Computing

July 1, 2025 · Last updated on August 19, 2025 · 1 min · KKKZOZ

June ¹

ServerlessLLM Locality-Enhanced Serverless Inference for Large Language Models

June 28, 2025 · Last updated on August 19, 2025 · 3 min · KKKZOZ

May ⁴

Deep Learning Basic

May 27, 2025 · Last updated on August 1, 2025 · 4 min · KKKZOZ

NumPy Notes

May 26, 2025 · Last updated on August 1, 2025 · 5 min · KKKZOZ

Build a Large Language Model (From Scratch) Reading Note

May 20, 2025 · Last updated on August 18, 2025 · 9 min · KKKZOZ

Useful Websites

May 19, 2025 · Last updated on August 25, 2025 · 1 min · KKKZOZ

April ⁵

Common Golang Mistakes

April 23, 2025 · Last updated on August 3, 2025 · 1 min · KKKZOZ

Effective MacOS Shortcuts

April 19, 2025 · Last updated on August 3, 2025 · 3 min · KKKZOZ

Dev Operations

April 17, 2025 · Last updated on August 10, 2025 · 9 min · KKKZOZ

jj-vcs Tutorial

April 4, 2025 · Last updated on August 10, 2025 · 8 min · KKKZOZ

Chrome Plugin Recommendations

April 1, 2025 · Last updated on August 4, 2025 · 2 min · KKKZOZ

March ⁹

Tips and guidance for writing

March 31, 2025 · Last updated on August 1, 2025 · 12 min · KKKZOZ

Pass The Wall

March 30, 2025 · Last updated on August 1, 2025 · 2 min · KKKZOZ

Docker Network Introduction

March 29, 2025 · Last updated on August 1, 2025 · 3 min · KKKZOZ

Using Rust

March 26, 2025 · Last updated on August 1, 2025 · 8 min · KKKZOZ

100 Mistakes in Golang: Chapter 8 & 9

March 19, 2025 · Last updated on August 1, 2025 · 4 min · KKKZOZ

100 Exercises to Learn Rust Note

March 13, 2025 · Last updated on August 1, 2025 · 5 min · KKKZOZ

100 Mistakes in Golang: Chapter 7

March 7, 2025 · Last updated on August 1, 2025 · 2 min · KKKZOZ

100 Mistakes in Golang: Chapter 6

March 4, 2025 · Last updated on August 1, 2025 · 5 min · KKKZOZ

100 Mistakes in Golang: Chapter 5

March 3, 2025 · Last updated on August 1, 2025 · 3 min · KKKZOZ

February ⁴

100 Mistakes in Golang: Chapter 2

February 20, 2025 · Last updated on August 1, 2025 · 7 min · KKKZOZ

100 Mistakes in Golang: Chapter 3

February 20, 2025 · Last updated on August 1, 2025 · 12 min · KKKZOZ

100 Mistakes in Golang: Chapter 4

February 20, 2025 · Last updated on August 1, 2025 · 3 min · KKKZOZ

Handling Golang Errors

February 4, 2025 · Last updated on August 3, 2025 · 4 min · KKKZOZ

January ¹

Golang Struct and Interfaces

January 28, 2025 · Last updated on August 1, 2025 · 2 min · KKKZOZ

2024 ¹⁹

December ²

Rustlings Note

December 26, 2024 · Last updated on August 1, 2025 · 10 min · KKKZOZ

Aerospace

December 24, 2024 · Last updated on August 1, 2025 · 2 min · KKKZOZ

November ²

From Clicks to Commands: A Windows User’s Survival Guide

November 26, 2024 · Last updated on August 1, 2025 · 3 min · KKKZOZ

Mac Development Environment Setup

November 21, 2024 · Last updated on August 1, 2025 · 3 min · KKKZOZ

October ⁶

A Piece Of: Golang Profile

October 23, 2024 · Last updated on August 1, 2025 · 4 min · KKKZOZ

About Me

October 23, 2024 · Last updated on July 28, 2025 · 1 min · KKKZOZ

Missing Semester - Lecture 5

October 17, 2024 · Last updated on August 1, 2025 · 4 min · KKKZOZ

Missing Semester - Lecture 4

October 15, 2024 · Last updated on August 1, 2025 · 7 min · KKKZOZ

Missing Semester - Lecture 2

October 11, 2024 · Last updated on August 1, 2025 · 5 min · KKKZOZ

Missing Semester - Lecture 1

October 9, 2024 · Last updated on August 1, 2025 · 2 min · KKKZOZ

August ¹

Watchdogs in OpenFaaS

August 25, 2024 · Last updated on August 1, 2025 · 7 min · KKKZOZ

May ¹

A Piece Of: Logs

May 13, 2024 · Last updated on August 1, 2025 · 5 min · KKKZOZ

April ¹

Data Management in Microservices: State of the Practice, Challenges, and Research Directions

April 15, 2024 · Last updated on August 1, 2025 · 5 min · KKKZOZ

March ³

Transaction Anomalies

March 31, 2024 · Last updated on August 1, 2025 · 2 min · KKKZOZ

Paper Note: Taking Omid to the Clouds: Fast, Scalable Transactions for Real-Time Cloud Analytics

March 25, 2024 · Last updated on August 1, 2025 · 2 min · KKKZOZ

Paper Note: Omid, Reloaded: Scalable and Highly-Available Transaction Processing

March 22, 2024 · Last updated on August 1, 2025 · 2 min · KKKZOZ

February ¹

Programming Rust Book Note

February 10, 2024 · Last updated on August 1, 2025 · 46 min · KKKZOZ

January ²

Paper Note: Towards Transaction as a Service

January 22, 2024 · Last updated on August 1, 2025 · 6 min · KKKZOZ

A Piece Of: Go Tests

January 21, 2024 · Last updated on August 1, 2025 · 1 min · KKKZOZ

2023 ²⁹

December ⁴

Paper Note: Scalable Distributed Transactions across Heterogeneous Stores

December 9, 2023 · Last updated on August 1, 2025 · 5 min · KKKZOZ

Paper Note: GRIT: Consistent Distributed Transactions across Polyglot Microservices with Multiple Databases

December 8, 2023 · Last updated on August 1, 2025 · 4 min · KKKZOZ

Paper Note: How to Read a Paper

December 5, 2023 · Last updated on April 5, 2025 · 3 min · KKKZOZ

Talk about Postgres Visibility Check Rules

December 4, 2023 · Last updated on August 1, 2025 · 2 min · KKKZOZ

November ¹⁵

Paper Note: Ad Hoc Transactions in Web Applications: The Good, the Bad, and the Ugly

November 30, 2023 · Last updated on August 1, 2025 · 9 min · KKKZOZ

A Piece Of: ThreadLocal

November 29, 2023 · Last updated on August 1, 2025 · 2 min · KKKZOZ

Note: WSL2 Mirrored 网络模式下异常情况总结

November 25, 2023 · Last updated on August 1, 2025 · 3 min · KKKZOZ

Paper Note: Cobra: Making Transactional Key-Value Stores Verifiably Serializable

November 23, 2023 · Last updated on August 1, 2025 · 2 min · KKKZOZ

Paper Note: Epoxy: ACID Transactions Across Diverse Data Stores

November 22, 2023 · Last updated on August 1, 2025 · 1 min · KKKZOZ

Paper Note: Zab: High-performance broadcast for primary-backup systems

November 15, 2023 · Last updated on August 1, 2025 · 4 min · KKKZOZ

DDIA: Chapter 9 Consistency and Consensus

November 13, 2023 · Last updated on August 1, 2025 · 28 min · KKKZOZ

Paper Note: CAP Twelve Years Later: How the “Rules” have Changed

November 12, 2023 · Last updated on August 1, 2025 · 8 min · KKKZOZ

Research: 6.824 Lab2B 中异常情况的分析

November 8, 2023 · Last updated on August 1, 2025 · 5 min · KKKZOZ

Talk about Consistency and Consensus

November 7, 2023 · Last updated on August 1, 2025 · 2 min · KKKZOZ

About CAP

November 6, 2023 · Last updated on August 1, 2025 · 1 min · KKKZOZ

Paper Note: Chain Replication

November 6, 2023 · Last updated on August 1, 2025 · 5 min · KKKZOZ

Paper Note: Time, clocks, and the ordering

November 4, 2023 · Last updated on August 1, 2025 · 3 min · KKKZOZ

DDIA: Chapter 8 The Trouble with Distributed Systems

November 2, 2023 · Last updated on August 1, 2025 · 16 min · KKKZOZ

Talk about Redlock

November 2, 2023 · Last updated on August 1, 2025 · 5 min · KKKZOZ

October ¹⁰

Paper Note: Chubby

October 31, 2023 · Last updated on August 1, 2025 · 6 min · KKKZOZ

Paper Note: BigTable

October 30, 2023 · Last updated on August 1, 2025 · 5 min · KKKZOZ

Paper Note: MapReduce

October 30, 2023 · Last updated on August 1, 2025 · 2 min · KKKZOZ

Paper Note: ZooKeeper

October 30, 2023 · Last updated on August 1, 2025 · 1 min · KKKZOZ

DDIA: Chapter 7 Transactions

October 29, 2023 · Last updated on August 1, 2025 · 18 min · KKKZOZ

DDIA: Chapter 6 Partioning

October 24, 2023 · Last updated on August 1, 2025 · 7 min · KKKZOZ

DDIA: Chapter 5 Replication

October 23, 2023 · Last updated on August 1, 2025 · 14 min · KKKZOZ

DDIA: Chapter 4 Encoding and Evolution

October 21, 2023 · Last updated on August 1, 2025 · 9 min · KKKZOZ

DDIA: Chapter 2 Data Models and Query Languages

October 20, 2023 · Last updated on August 1, 2025 · 7 min · KKKZOZ

DDIA: Chapter 3 Storage and Retrieval

October 20, 2023 · Last updated on August 1, 2025 · 9 min · KKKZOZ

2025 59

August 20