Large Language Models · Efficient AI · Model Compression
KV Cache Quantization for Efficient Large Language Model Inference
Role-aware INT4 quantization and sensitivity-based allocation for long-context LLM inference.
My work. Independent calibration, cache implementation, Triton integration, and cross-model evaluation.
Project period: Jan 2026 – May 2026
Explore project
