InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization

InfoQuant uses quantizer-facing activation-distribution design to improve low-bit LLM quantization without retraining.

Paper · Code