Deep implicit functions have been found to be an effective tool for
efficiently encoding all manner of natural signals. Their attractiveness stems
from their ability to compactly represent signals with little to no off-line
training data. Instead, they leverage the implicit bias of deep networks to
decouple hidden redundancies within the signal. In this paper, we explore the
hypothesis that additional compression can be achieved by leveraging the
redundancies that exist between layers. We propose to use a novel run-time
decoder-only hypernetwork - that uses no offline training data - to better
model this cross-layer parameter redundancy. Previous applications of
hyper-networks with deep implicit functions have applied feed-forward
encoder/decoder frameworks that rely on large offline datasets that do not
generalize beyond the signals they were trained on. We instead present a
strategy for the initialization of run-time deep implicit functions for
single-instance signals through a Decoder-Only randomly projected Hypernetwork
(D'OH). By directly changing the dimension of a latent code to approximate a
target implicit neural architecture, we provide a natural way to vary the
memory footprint of neural representations without the costly need for neural
architecture search on a space of alternative low-rate structures.

通过运行时解码器的超网络 (D'OH) 在单个实例信号中初始化深度隐式函数的策略，提供了一种自然的方法来改变神经表示的内存占用，而无需在备选低速率结构空间上进行昂贵的神经架构搜索。