Exemplar-based portrait stylization is widely attractive and highly desired.
Despite recent successes, it remains challenging, especially when considering
both texture and geometric styles. In this paper, we present the first
framework for one-shot 3D portrait style transfer, which can generate 3D face
models with both the geometry exaggerated and the texture stylized while
preserving the identity from the original content. It requires only one
arbitrary style image instead of a large set of training examples for a
particular style, provides geometry and texture outputs that are fully
parameterized and disentangled, and enables further graphics applications with
the 3D representations. The framework consists of two stages. In the first
geometric style transfer stage, we use facial landmark translation to capture
the coarse geometry style and guide the deformation of the dense 3D face
geometry. In the second texture style transfer stage, we focus on performing
style transfer on the canonical texture by adopting a differentiable renderer
to optimize the texture in a multi-view framework. Experiments show that our
method achieves robustly good results on different artistic styles and
outperforms existing methods. We also demonstrate the advantages of our method
via various 2D and 3D graphics applications. Project page is
this https URL

本文介绍了一个用于一次性 3D 肖像样式转移的框架，可以在仅需要一幅不同样式图像的情况下，生成具有几何和纹理风格的 3D 面部模型，而不是一整套相关样例。本文探索了两个阶段，以利用三位面部关键点转换来捕捉粗略的几何样式，并利用差分渲染器，在多视角框架下 对规范纹理进行样式转移。实验表明，我们的方法在不同的艺术风格上取得了稳健的结果，并优于现有的方法。