Superior performance and ease of implementation have fostered the adoption of convolutional neural networks (CNNs) for a wide array of inference and reconstruction tasks. CNNs implement three basic blocks: convolution, pooling and pointwise nonlinearity. Since the two first operations