torch-optimizer · PyPI
https://pypi.org/project/torch-optimizer30.10.2021 · Each optimizer performs 501 optimization steps. Learning rate is best one found by hyper parameter search algorithm, rest of tuning parameters are default. It is very easy to extend script and tune other optimizer parameters. python examples/viz_optimizers.py.