Human matting is a foundation task in image and video processing, where human
foreground pixels are extracted from the input. Prior works either improve the
accuracy by additional guidance or improve the temporal consistency of a single
instance across frames. We propose a new framework MaGGIe, Masked Guided
Gradual Human Instance Matting, which predicts alpha mattes progressively for
each human instances while maintaining the computational cost, precision, and
consistency. Our method leverages modern architectures, including transformer
attention and sparse convolution, to output all instance mattes simultaneously
without exploding memory and latency. Although keeping constant inference costs
in the multiple-instance scenario, our framework achieves robust and versatile
performance on our proposed synthesized benchmarks. With the higher quality
image and video matting benchmarks, the novel multi-instance synthesis approach
from publicly available sources is introduced to increase the generalization of
models in real-world scenarios.

我们提出了一种新的框架 MaGGIe，即遮蔽引导逐渐人物实例抠图（Masked Guided Gradual Human Instance Matting），该框架能够在保持计算成本、精确度和一致性的同时逐步预测每个人物实例的透明度抠图。我们的方法利用现代架构，如 Transformer 注意力和稀疏卷积，同时输出所有实例的抠图，而不会发生内存和延迟问题。尽管在多实例情景下保持恒定的推理成本，我们的框架在我们提出的综合基准测试中实现了稳健而灵活的性能。通过使用更高质量的图像和视频抠图基准，引入了来自公开可用源的新型多实例综合方法，以增加模型在现实世界场景中的泛化能力。

MaGGIe: 掩码引导渐进式人体实例抠图

MaGGIe: Masked Guided Gradual Human Instance Matting

In video surveillance as well as automotive applications, so-called fisheye
cameras are often employed to capture a very wide angle of view. As such
cameras depend on projections quite different from the classical perspective
projection, the resulting fisheye image and video data correspondingly exhibits
non-rectilinear image characteristics. Typical image and video processing
algorithms, however, are not designed for these fisheye characteristics. To be
able to develop and evaluate algorithms specifically adapted to fisheye images
and videos, a corresponding test data set is therefore introduced in this
paper. The first of those sequences were generated during the authors' own work
on motion estimation for fish-eye videos and further sequences have gradually
been added to create a more extensive collection. The data set now comprises
synthetically generated fisheye sequences, ranging from simple patterns to more
complex scenes, as well as fisheye video sequences captured with an actual
fisheye camera. For the synthetic sequences, exact information on the lens
employed is available, thus facilitating both verification and evaluation of
any adapted algorithms. For the real-world sequences, we provide calibration
data as well as the settings used during acquisition. The sequences are freely
available via www.lms.lnt.de/fisheyedataset/.

本文介绍了一个包含了合成和真实鱼眼图像以及相应的校准数据和测试设置的数据集，以便能够开发和评估适用于鱼眼图像和视频的专门算法。