Imaging depth and spectrum have been extensively studied in isolation from
each other for decades. Recently, hyperspectral-depth (HS-D) imaging emerges to
capture both information simultaneously by combining two different imaging
systems; one for depth, the other for spectrum. While being accurate, this
combinational approach induces increased form factor, cost, capture time, and
alignment/registration problems. In this work, departing from the combinational
principle, we propose a compact single-shot monocular HS-D imaging method. Our
method uses a diffractive optical element (DOE), the point spread function of
which changes with respect to both depth and spectrum. This enables us to
reconstruct spectrum and depth from a single captured image. To this end, we
develop a differentiable simulator and a neural-network-based reconstruction
that are jointly optimized via automatic differentiation. To facilitate
learning the DOE, we present a first HS-D dataset by building a benchtop HS-D
imager that acquires high-quality ground truth. We evaluate our method with
synthetic and real experiments by building an experimental prototype and
achieve state-of-the-art HS-D imaging results.

提出了一种压缩的单拍摄单目全光谱成像方法，使用衍射光学元件，通过深度和谱信息的点扩散函数的变化来同时恢复谱和深度，利用神经网络和可微分的模拟器实现优化，提供了第一个 HS-D 数据集，实验结果达到了最先进的全光谱深度成像效果。

学习衍射光学的单次高光谱深度成像

Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics

Imaging with optical resolution through and inside complex samples is a
difficult challenge with important applications in many fields. The fundamental
problem is that inhomogeneous samples, such as biological tissues, randomly
scatter and diffuse light, impeding conventional image formation. Despite many
advancements, no current method enables to noninvasively image in real-time
using diffused light. Here, we show that owing to the memory-effect for speckle
correlations, a single image of the scattered light, captured with a standard
high-resolution camera, encodes all the information that is required to image
through the medium or around a corner. We experimentally demonstrate
single-shot imaging through scattering media and around corners using
incoherent light and various samples, from white paint to dynamic biological
samples. Our lensless technique is simple, does not require laser sources,
wavefront-shaping, nor time-gated detection, and is realized here using a
camera-phone. It has the potential to enable imaging in currently inaccessible
scenarios.

利用散射光的单张图像在不需激光和时间门控检测的情况下，通过电脑摄像头来实现透过散射介质和检测散射光在物体周围的成像。