The rise of deep learning ran in parallel with advancements in GPU technology. As GPUs got faster, mostly fueled by the high demand for powerful graphics cards in the world of gaming, researchers started to train the high-capacity neural networks that quickly evolved into the well known CNN architectures of