Mansheej Paul

5

Papers

233

Total Citations

Papers (5)

LoRA Learns Less and Forgets Less

Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel

Deep Learning on a Data Diet: Finding Important Examples Early in Training

Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks

Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression