Pre-training has shown promising results on various image restoration tasks,
which is usually followed by full fine-tuning for each specific downstream task
(e.g., image denoising). However, such full fine-tuning usually suffers from
the problems of heavy computational cost in practice, due to the massive
parameters of pre-trained restoration models, thus limiting its real-world
applications. Recently, Parameter Efficient Transfer Learning (PETL) offers an
efficient alternative solution to full fine-tuning, yet still faces great
challenges for pre-trained image restoration models, due to the diversity of
different degradations. To address these issues, we propose AdaptIR, a novel
parameter efficient transfer learning method for adapting pre-trained
restoration models. Specifically, the proposed method consists of a
multi-branch inception structure to orthogonally capture local spatial, global
spatial, and channel interactions. In this way, it allows powerful
representations under a very low parameter budget. Extensive experiments
demonstrate that the proposed method can achieve comparable or even better
performance than full fine-tuning, while only using 0.6% parameters. Code is
available at this https URL

提出了 AdaptIR，一种适应预训练恢复模型的新型参数高效迁移学习方法，通过采用多分支入射结构来正交地捕捉局部空间、全局空间和通道交互，以实现在非常低的参数预算下的强大表示。实验证明，该方法仅使用 0.6% 的参数就能达到与全微调相当甚至更好的性能。