We present an automated technique for computing a map between two genus-zero
shapes, which matches semantically corresponding regions to one another. Lack
of annotated data prohibits direct inference of 3D semantic priors; instead,
current State-of-the-art methods predominantly optimize geometric properties or
require varying amounts of manual annotation. To overcome the lack of annotated
training data, we distill semantic matches from pre-trained vision models: our
method renders the pair of 3D shapes from multiple viewpoints; the resulting
renders are then fed into an off-the-shelf image-matching method which
leverages a pretrained visual model to produce feature points. This yields
semantic correspondences, which can be projected back to the 3D shapes,
producing a raw matching that is inaccurate and inconsistent between different
viewpoints. These correspondences are refined and distilled into an
inter-surface map by a dedicated optimization scheme, which promotes
bijectivity and continuity of the output map. We illustrate that our approach
can generate semantic surface-to-surface maps, eliminating manual annotations
or any 3D training data requirement. Furthermore, it proves effective in
scenarios with high semantic complexity, where objects are non-isometrically
related, as well as in situations where they are nearly isometric.

我们提出了一种自动化技术，用于计算两个零层面的形状之间的映射，将语义对应的区域互相匹配。我们的方法通过多个视点渲染一对 3D 形状，然后将生成的渲染输入到一个现成的图像匹配方法中，以利用预训练的视觉模型生成特征点。这产生了语义对应，可以投射回 3D 形状，生成不准确且在不同视点之间不一致的原始匹配。这些对应通过专门的优化方案进行精炼和提炼，形成了一个表面间映射，促进了输出映射的双射性和连续性。我们证明了我们的方法可以生成语义表面到表面的映射，消除了手动注释或任何 3D 训练数据的需求。此外，它在具有高语义复杂性的情景中也证明了有效性，在这些情景下，物体是非等距的关系，以及在几乎等距的情况下。