Traditional cameras face a trade-off between low-light performance and
high-speed imaging: longer exposure times to capture sufficient light results
in motion blur, whereas shorter exposures result in Poisson-corrupted noisy
images. While burst photography techniques help mitigate this tradeoff,
conventional cameras are fundamentally limited in their sensor noise
characteristics. Event cameras and single-photon avalanche diode (SPAD) sensors
have emerged as promising alternatives to conventional cameras due to their
desirable properties. SPADs are capable of single-photon sensitivity with
microsecond temporal resolution, and event cameras can measure brightness
changes up to 1 MHz with low bandwidth requirements. We show that these
properties are complementary, and can help achieve low-light, high-speed image
reconstruction with low bandwidth requirements. We introduce a sensor fusion
framework to combine SPADs with event cameras to improves the reconstruction of
high-speed, low-light scenes while reducing the high bandwidth cost associated
with using every SPAD frame. Our evaluation, on both synthetic and real sensor
data, demonstrates significant enhancements ( > 5 dB PSNR) in reconstructing
low-light scenes at high temporal resolution (100 kHz) compared to conventional
cameras. Event-SPAD fusion shows great promise for real-world applications,
such as robotics or medical imaging.

传统相机在低光性能和高速成像之间存在权衡，长曝光时间捕捉足够的光会导致运动模糊，而短曝光时间会导致泊松受损噪声图像。我们介绍了一种传感器融合框架，将单光子雪崩二极管（SPAD）传感器与事件相机相结合，以实现低带宽要求下对高速低光场景的重建。我们的评估在合成和真实的传感器数据上表明，相比传统相机，在高的时间分辨率（100 kHz）下重建低光场景方面，事件 - SPAD 融合显示出了显著的提升（> 5 dB PSNR）。事件 - SPAD 融合在机器人技术或医学成像等实际应用中具有巨大潜力。