arXiv cs.LG
· Papers
SmartMixed: A Two-Phase Training Strategy for Adaptive Activation Function Learning in Neural Networks
arXiv:2510.22450v4 Announce Type: replace Abstract: The choice of activation function plays a critical role in neural networks, yet most architectures still rely on fixed, uniform activation functions across all neurons. We introduce SmartMixed, a novel two-phase training strategy that allows networks to learn optimal