Designing 3D indoor layouts is a crucial task with significant applications
in virtual reality, interior design, and automated space planning. Existing
methods for 3D layout design either rely on diffusion models, which utilize
spatial relationship priors, or heavily leverage the inferential capabilities
of proprietary Large Language Models (LLMs), which require extensive prompt
engineering and in-context exemplars via black-box trials. These methods often
face limitations in generalization and dynamic scene editing. In this paper, we
introduce LLplace, a novel 3D indoor scene layout designer based on lightweight
fine-tuned open-source LLM Llama3. LLplace circumvents the need for spatial
relationship priors and in-context exemplars, enabling efficient and credible
room layout generation based solely on user inputs specifying the room type and
desired objects. We curated a new dialogue dataset based on the 3D-Front
dataset, expanding the original data volume and incorporating dialogue data for
adding and removing objects. This dataset can enhance the LLM's spatial
understanding. Furthermore, through dialogue, LLplace activates the LLM's
capability to understand 3D layouts and perform dynamic scene editing, enabling
the addition and removal of objects. Our approach demonstrates that LLplace can
effectively generate and edit 3D indoor layouts interactively and outperform
existing methods in delivering high-quality 3D design solutions. Code and
dataset will be released.

LLplace 是一种基于轻量级精细调整的开源 LLM Llama3 的新颖的 3D 室内场景布局设计工具，通过用户输入指定房间类型和所需对象来有效生成和编辑 3D 室内布局，并在提供高质量的 3D 设计解决方案方面优于现有方法。