vxlabs.com
Improving fastai’s mixed precision support with NVIDIA’s Automatic Mixed Precision.
TL;DR: For best results with mixed precision training, use NVIDIA’s Automatic Mixed Precision together with fastai, and remember to set any epsilons, for example in the optimizer, correctly. …