Jonathan Frankle

8

Papers

233

Total Citations

Papers (8)

LoRA Learns Less and Forgets Less

CommonCanvas: Open Diffusion Models Trained on Creative-Commons Images

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

The Lottery Tickets Hypothesis for Supervised and Self-Supervised Pre-Training in Computer Vision Models

The Lottery Ticket Hypothesis for Pre-trained BERT Networks

Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks

Pruning’s Effect on Generalization Through the Lens of Training and Regularization

MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining