The introduction of convolutional layers greatly advanced the performance of
neural networks on image tasks due to innately capturing a way of encoding and
learning translation-invariant operations, matching one of the underlying
symmetries of the image domain. In comparison, there are