2024 "activation functions" Papers
6 papers found
A sampling theory perspective on activations for implicit neural representations
Hemanth Saratchandran, Sameera Ramasinghe, Violetta Shevchenko et al.
ICML 2024poster
Initial Guessing Bias: How Untrained Networks Favor Some Classes
Emanuele Francazi, Aurelien Lucchi, Marco Baity-Jesi
ICML 2024poster
Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?
Huy Nguyen, Pedram Akbarian, Nhat Ho
ICML 2024poster
On dimensionality of feature vectors in MPNNs
César Bravo, Alexander Kozachinskiy, Cristobal Rojas
ICML 2024poster
ReLU Network with Width $d+\mathcal{O}(1)$ Can Achieve Optimal Approximation Rate
Chenghao Liu, Minghua Chen
ICML 2024poster
Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context
Xiang Cheng, Yuxin Chen, Suvrit Sra
ICML 2024poster