We present a new additive image factorization technique that treats images to
be composed of multiple latent specular components which can be simply
estimated recursively by modulating the sparsity during decomposition. Our
model-driven {\em RSFNet} estimates these factors by unrolling the optimization
into network layers requiring only a few scalars to be learned. The resultant
factors are interpretable by design and can be fused for different image
enhancement tasks via a network or combined directly by the user in a
controllable fashion. Based on RSFNet, we detail a zero-reference Low Light
Enhancement (LLE) application trained without paired or unpaired supervision.
Our system improves the state-of-the-art performance on standard benchmarks and
achieves better generalization on multiple other datasets. We also integrate
our factors with other task specific fusion networks for applications like
deraining, deblurring and dehazing with negligible overhead thereby
highlighting the multi-domain and multi-task generalizability of our proposed
RSFNet. The code and data is released for reproducibility on the project
homepage.

我们提出了一种新的加法图像因子分解技术，通过在分解过程中调制稀疏性来估计由多个潜在的镜面成分组成的图像。我们的基于模型驱动的 RSFNet 通过将优化展开为网络层来估计这些因子，只需要学习少量的标量。由设计可解释的结果因子可以通过网络进行不同的图像增强任务融合，也可以由用户以可控的方式直接组合。基于 RSFNet，我们详细介绍了一个无需成对或非成对监督训练的零参考低光照增强（LLE）应用。我们的系统在标准基准测试上改善了最先进的性能，并在多个其他数据集上实现了更好的泛化性能。我们还将我们的因子与其他任务特定的融合网络集成，用于去雨、去模糊和去雾等应用，几乎没有额外开销，从而彰显了我们提出的 RSFNet 在多领域和多任务上的泛化能力。项目主页上发布了代码和数据，以便复现。

低光增强的镜面分解

Specularity Factorization for Low-Light Enhancement

If the video has long been mentioned as a widespread visualization form, the
animation sequence in the video is mentioned as storytelling for people.
Producing an animation requires intensive human labor from skilled professional
artists to obtain plausible animation in both content and motion direction,
incredibly for animations with complex content, multiple moving objects, and
dense movement. This paper presents an interactive framework to generate new
sequences according to the users' preference on the starting frame. The
critical contrast of our approach versus prior work and existing commercial
applications is that novel sequences with arbitrary starting frame are produced
by our system with a consistent degree in both content and motion direction. To
achieve this effectively, we first learn the feature correlation on the
frameset of the given video through a proposed network called RSFNet. Then, we
develop a novel path-finding algorithm, SDPF, which formulates the knowledge of
motion directions of the source video to estimate the smooth and plausible
sequences. The extensive experiments show that our framework can produce new
animations on the cartoon and natural scenes and advance prior works and
commercial applications to enable users to obtain more predictable results.

该研究论文提出了一种交互式框架，通过用户对起始帧的偏好生成新的序列，与之前的方法和现有商业应用相比，我们的方法在内容和运动方向上生成具有一致程度的任意起始帧的新序列。通过提出的网络 RSFNet 在给定视频的帧集上学习特征相关性，并开发了一种新的路径查找算法 SDPF，将源视频的运动方向知识建模，估计平滑可信的序列。广泛的实验表明，我们的框架能够在卡通和自然场景上生成新的动画，并推动以前的工作和商业应用以获得更可预测的结果。