"activation functions" Papers
8 papers found
From Kolmogorov to Cauchy: Shallow XNet Surpasses KANs
Xin Li, Xiaotao Zheng, Zhihong Xia
NeurIPS 2025poster
Separation Power of Equivariant Neural Networks
Marco Pacini, Xiaowen Dong, Bruno Lepri et al.
ICLR 2025posterarXiv:2406.08966
1
citations
A sampling theory perspective on activations for implicit neural representations
Hemanth Saratchandran, Sameera Ramasinghe, Violetta Shevchenko et al.
ICML 2024poster
Initial Guessing Bias: How Untrained Networks Favor Some Classes
Emanuele Francazi, Aurelien Lucchi, Marco Baity-Jesi
ICML 2024poster
Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?
Huy Nguyen, Pedram Akbarian, Nhat Ho
ICML 2024poster
On dimensionality of feature vectors in MPNNs
César Bravo, Alexander Kozachinskiy, Cristobal Rojas
ICML 2024poster
ReLU Network with Width $d+\mathcal{O}(1)$ Can Achieve Optimal Approximation Rate
Chenghao Liu, Minghua Chen
ICML 2024poster
Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context
Xiang Cheng, Yuxin Chen, Suvrit Sra
ICML 2024poster