2025 "representation collapse" Papers
3 papers found
Addressing Representation Collapse in Vector Quantized Models with One Linear Layer
Yongxin Zhu, Bocheng Li, Yifei Xin et al.
ICCV 2025posterarXiv:2411.02038
44
citations
Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning
Md Rifat Arefin, Gopeshh Raaj Subbaraj, Nicolas Gontier et al.
ICLR 2025posterarXiv:2411.02344
4
citations
What Happens During the Loss Plateau? Understanding Abrupt Learning in Transformers
Pulkit Gopalani, Wei Hu
NeurIPS 2025posterarXiv:2506.13688
1
citations