Abstract: The training algorithm is a determining factor in the success of artificial neural networks. Until now, first-order optimizers based on gradient descent are the most used in neural network ...