Generating realistic images from arbitrary views based on a single source
image remains a significant challenge in computer vision, with broad
applications ranging from e-commerce to immersive virtual experiences. Recent
advancements in diffusion models, particularly the Zero-1-to-3 model, have been
widely adopted for generating plausible views, videos, and 3D models. However,
these models still struggle with inconsistencies and implausibility in new
views generation, especially for challenging changes in viewpoint. In this
work, we propose Zero-to-Hero, a novel test-time approach that enhances view
synthesis by manipulating attention maps during the denoising process of
Zero-1-to-3. By drawing an analogy between the denoising process and stochastic
gradient descent (SGD), we implement a filtering mechanism that aggregates
attention maps, enhancing generation reliability and authenticity. This process
improves geometric consistency without requiring retraining or significant
computational resources. Additionally, we modify the self-attention mechanism
to integrate information from the source view, reducing shape distortions.
These processes are further supported by a specialized sampling schedule.
Experimental results demonstrate substantial improvements in fidelity and
consistency, validated on a diverse set of out-of-distribution objects.

利用 Zero-1-to-3 模型生成真实的图像，通过增强关注图和自我注意机制集成源视图信息，改善视图合成的几何一致性和可靠性。