[1709.05011v1] ImageNet Training in 24 Minutes
arxiv.org › abs › 1709Sep 14, 2017 · We finish the 100-epoch ImageNet training with AlexNet in 24 minutes, which is the world record. Same as Facebook's result (Goyal et al 2017, arXiv:1706.02677), we finish the 90-epoch ImageNet training with ResNet-50 in one hour. However, our hardware budget is only 1.2 million USD, which is 3.4 times lower than Facebook's 4.1 million USD.
[1709.05011] ImageNet Training in Minutes - arXiv
https://arxiv.org/abs/1709.0501114.09.2017 · Download PDF Abstract: Finishing 90-epoch ImageNet-1k training with ResNet-50 on a NVIDIA M40 GPU takes 14 days. This training requires 10^18 single precision operations in total. On the other hand, the world's current fastest supercomputer can finish 2 * 10^17 single precision operations per second (Dongarra et al 2017, this https URL).If we can make full use of the …
[1709.05011] ImageNet Training in Minutes - arXiv
arxiv.org › abs › 1709Sep 14, 2017 · About three times faster than Facebook's result (Goyal et al 2017, arXiv:1706.02677 ), we finish the 90-epoch ImageNet training with ResNet-50 in 20 minutes on 2048 KNLs without losing accuracy. State-of-the-art ImageNet training speed with ResNet-50 is 74.9% top-1 test accuracy in 15 minutes. We got 74.9% top-1 test accuracy in 64 epochs ...