Shikai Qiu

3

Papers

9

Total Citations

Papers (3)

Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks

Transferring Knowledge From Large Foundation Models to Small Downstream Models

Compute Better Spent: Replacing Dense Layers with Structured Matrices