Double quantization compresses model weights in two stages: it quantizes weights to 4-bit precision, then quantizes their scaling factors and zero points. section 3.5.2
By compressing quantization constants that would otherwise use higher precision, the technique reduces memory overhead while preserving the quality of weight representations. section 3.5.2
QLoRA sentiment classification
A Rotten Tomatoes classifier loads bert-base-uncased in 4-bit precision with double quantization, applies LoRA, and trains with paged AdamW 8-bit optimization.


