Tensor Cores are specialized GPU units that perform matrix multiplication on tiles. For FP16, a Tensor Core can process a 16×16 block in one clock cycle. section 5.2.6
Width pruning can better utilize Tensor Cores when the resulting intermediate size is divisible by values such as 32, 64, 128, or 256. Misaligned dimensions may require padding. Alignment helps most in compute-bound workloads; on a T4, memory-bandwidth limits may leave Tensor Cores idle. section 5.2.6
pruned_model, stats = prune_model(
model=model,
pruning_type="MLP_GLU",
neuron_selection_method="PPM",
pruning_percentage=20,
expansion_divisor=64, #A
dataloader=dataloaderwiki,
show_progress=True
)
The pruning call sets expansion_divisor to 64 to align the resulting intermediate size. section 5.2.6



