PyTorch Lightning
https://www.pytorchlightning.aiLightning makes coding complex networks simple. Spend more time on research, less on engineering. It is fully flexible to fit any use case and built on pure PyTorch so there is no need to learn a new language. A quick refactor will allow you to: Run your code on any hardware Performance & bottleneck profiler Model checkpointing 16-bit precision