RMSprop - Keras
https://keras.io/api/optimizers/rmspropOptimizer that implements the RMSprop algorithm. The gist of RMSprop is to: Maintain a moving (discounted) average of the square of gradients. Divide the gradient by the root of this average. This implementation of RMSprop uses plain momentum, not Nesterov momentum. The centered version additionally maintains a moving average of the gradients ...