Q6_K stores 256 weights in a 210-byte superblock. It splits each weight’s 6-bit code between low-nibble and high-pair byte regions, then applies a 16-weight sub-scale and a super-scale to reconstruct the weight. section 10.2.5
To reconstruct a weight:
- Extract its low 4 bits and high 2 bits, combine them into a 6-bit code, then subtract 32 to obtain a signed value. section 10.2.5
- Multiply the signed value by its 16-weight chunk’s INT8 sub-scale and the FP16 super-scale. section 10.2.5
Reconstructing weight 0
The example combines low bits 1101 with high bits 01 to get 29; subtracting 32 gives −3. With sub-scale 94 and super-scale about −1.14 × 10⁻⁵, the reconstructed weight is about +3.21 × 10⁻³. section 10.2.5
