High dynamic range (HDR) video reconstruction aims to generate HDR videos
from low dynamic range (LDR) frames captured with alternating exposures. Most
existing works solely rely on the regression-based paradigm, leading to adverse
effects such as ghosting artifacts and missing details in saturated regions. In
this paper, we propose a diffusion-promoted method for HDR video
reconstruction, termed HDR-V-Diff, which incorporates a diffusion model to
capture the HDR distribution. As such, HDR-V-Diff can reconstruct HDR videos
with realistic details while alleviating ghosting artifacts. However, the
direct introduction of video diffusion models would impose massive
computational burden. Instead, to alleviate this burden, we first propose an
HDR Latent Diffusion Model (HDR-LDM) to learn the distribution prior of single
HDR frames. Specifically, HDR-LDM incorporates a tonemapping strategy to
compress HDR frames into the latent space and a novel exposure embedding to
aggregate the exposure information into the diffusion process. We then propose
a Temporal-Consistent Alignment Module (TCAM) to learn the temporal information
as a complement for HDR-LDM, which conducts coarse-to-fine feature alignment at
different scales among video frames. Finally, we design a Zero-Init
Cross-Attention (ZiCA) mechanism to effectively integrate the learned
distribution prior and temporal information for generating HDR frames.
Extensive experiments validate that HDR-V-Diff achieves state-of-the-art
results on several representative datasets.

提出了一种名为 HDR-V-Diff 的高动态范围（HDR）视频重建方法，结合扩散模型以实现 HDR 分布，通过 HDR Latent Diffusion Model（HDR-LDM）学习单个 HDR 帧的分布先验知识，通过 Temporal-Consistent Alignment Module（TCAM）学习时序信息，使用 Zero-Init Cross-Attention（ZiCA）机制整合先验分布和时序信息，从而生成具有真实细节的 HDR 帧。经过广泛实验证明，HDR-V-Diff 在多个代表性数据集上实现了最先进的结果。