`infinite-norm` Related Article Results

Adamax is a generalized version of the Adam algorithm, distinguished by its operation over the infinity norm (∞-norm). Introduced by Kingma and Ba in 2015 alongside Adam, this algorithm aims to provide more stable and effective updates, particularly in high-dimensional parameter spaces. By replacing the L2 norm in Adam with the infinity norm, Adamax controls the influence of large gradients and delivers a more stable learning process. Adamax Optimization Algorithm Key Difference Between Adam and