Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch
into a diverse set of 2D images and 3D prototypes through sketch-to-text,
text-to-image, and image-to-3D stages. This framework, shown across various
sketches, rapidly generates text, image, and 3D modalities for enhanced
early-stage design exploration. We show that using text as an intermediate
modality outperforms direct sketch-to-3D baselines for generating diverse and
manufacturable 3D models. We find limitations in current image-to-3D
techniques, while noting the value of the text modality for user-feedback and
iterative design augmentation.

Sketch2Prototype 是一个基于人工智能的框架，通过手绘草图到文本、文本到图像、图像到 3D 的转换过程，快速生成文本、图像和 3D 模型，用于提升早期设计阶段的探索。研究表明，使用文本作为中间模态可以比直接将草图转换为 3D 模型的基准方法产生更加多样且可制造的 3D 模型。同时，发现了现有图像到 3D 技术的局限性，并强调了文本模态在用户反馈和迭代设计中的价值。