We propose a method to remotely verify the authenticity of Optically Variable
Devices (OVDs), often referred to as ``holograms'', in identity documents. Our
method processes video clips captured with smartphones under common lighting
conditions, and is evaluated on two public datasets: MIDV-HOLO and MIDV-2020.
Thanks to a weakly-supervised training, we optimize a feature extraction and
decision pipeline which achieves a new leading performance on MIDV-HOLO, while
maintaining a high recall on documents from MIDV-2020 used as attack samples.
It is also the first method, to date, to effectively address the photo
replacement attack task, and can be trained on either genuine samples, attack
samples, or both for increased performance. By enabling to verify OVD shapes
and dynamics with very little supervision, this work opens the way towards the
use of massive amounts of unlabeled data to build robust remote identity
document verification systems on commodity smartphones. Code is available at
this https URL

提出一种方法，通过在普通光照条件下处理智能手机捕捉的视频片段，远程验证身份文件中的光变设备（常称为 “全息图”），并在两个公共数据集上进行评估。该方法采用弱监督训练，优化特征提取和决策流程，实现了对 MIDV-HOLO 的新领先性能，并在作为攻击样本使用的 MIDV-2020 文档上保持了高召回率。这也是首个有效解决照片替换攻击任务的方法，可以根据需要训练真实样本、攻击样本或二者兼而有之，以提高性能。通过能够在很少的监督下验证 OVD 的形状和动态，这项工作为在普通智能手机上构建具有鲁棒性的远程身份文件验证系统提供了新途径。

身份证件全息图验证的弱监督训练

Weakly Supervised Training for Hologram Verification in Identity  Documents

This study presents a novel approach for generating holograms based on the
neural radiance fields (NeRF) technique. Generating three-dimensional (3D) data
is difficult in hologram computation. NeRF is a state-of-the-art technique for
3D light-field reconstruction from 2D images based on volume rendering. The
NeRF can rapidly predict new-view images that do not include a training
dataset. In this study, we constructed a rendering pipeline directly from a 3D
light field generated from 2D images by NeRF for hologram generation using deep
neural networks within a reasonable time. The pipeline comprises three main
components: the NeRF, a depth predictor, and a hologram generator, all
constructed using deep neural networks. The pipeline does not include any
physical calculations. The predicted holograms of a 3D scene viewed from any
direction were computed using the proposed pipeline. The simulation and
experimental results are presented.

该研究提出了一种基于神经辐射场（NeRF）技术的生成全息图的新方法。使用深度神经网络在合理的时间内构建了从 2D 图像生成的 3D 光场的渲染流程，包括 NeRF、深度预测器和全息图生成器，而不需要任何物理计算。通过该流程，可以计算从任意方向观看的 3D 场景的预测全息图。研究还展示了仿真和实验结果。