From Layers to Submodules: Rethinking Granularity in Replacement-Based LLM Compression
SubFit introduces non-contiguous submodule replacement in LLMs, achieving superior compression with 84.6% accuracy at 25% sparsity, using residual fitting without retraining.
Elia Cunegatti, Marcus Vukojevic, Erik Nielsen et al.