[2112.15392] High Dimensional Optimization through the Lens ...
arxiv.org › abs › 2112Dec 31, 2021 · This thesis reviews numerical optimization methods with machine learning problems in mind. Since machine learning models are highly parametrized, we focus on methods suited for high dimensional optimization. We build intuition on quadratic models to figure out which methods are suited for non-convex optimization, and develop convergence proofs on convex functions for this selection of methods ...
Optimizers - Keras
https://keras.io/api/optimizersOptimizers Usage with compile() & fit() An optimizer is one of the two arguments required for compiling a Keras model: from tensorflow import keras from tensorflow.keras import layers model = keras. Sequential model. add (layers. Dense (64, kernel_initializer = 'uniform', input_shape = (10,))) model. add (layers.