Implicit Neural Representation (INR) is an innovative approach for
representing complex shapes or objects without explicitly defining their
geometry or surface structure. Instead, INR represents objects as continuous
functions. Previous research has demonstrated the effectiveness of using neural
networks as INR for image compression, showcasing comparable performance to
traditional methods such as JPEG. However, INR holds potential for various
applications beyond image compression. This paper introduces Rapid-INR, a novel
approach that utilizes INR for encoding and compressing images, thereby
accelerating neural network training in computer vision tasks. Our methodology
involves storing the whole dataset directly in INR format on a GPU, mitigating
the significant data communication overhead between the CPU and GPU during
training. Additionally, the decoding process from INR to RGB format is highly
parallelized and executed on-the-fly. To further enhance compression, we
propose iterative and dynamic pruning, as well as layer-wise quantization,
building upon previous work. We evaluate our framework on the image
classification task, utilizing the ResNet-18 backbone network and three
commonly used datasets with varying image sizes. Rapid-INR reduces memory
consumption to only 5% of the original dataset size and achieves a maximum
6$\times$ speedup over the PyTorch training pipeline, as well as a maximum 1.2x
speedup over the DALI training pipeline, with only a marginal decrease in
accuracy. Importantly, Rapid-INR can be readily applied to other computer
vision tasks and backbone networks with reasonable engineering efforts. Our
implementation code is publicly available at
this https URL

本文提出了一种名为 Rapid-INR 的创新方法，利用 INR 对图像进行编码和压缩，从而加速计算机视觉任务中的神经网络训练；该方法可以将整个数据集直接存储在 GPU 上，并提出了迭代动态剪枝和逐层量化来进一步增强压缩效果，并在图像分类任务中证明了其可行性。