We present RealityTalk, a system that augments real-time live presentations with speech-driven interactive virtual elements. Augmented presentations leverage embedded visuals and animation for engaging and expressive storytelling. However, existing tools for live presentations often lack interactivity and improvisation, while creating such effects in video editing tools require significant time and expertise. RealityTalk enables users to create live augmented presentations with real-time speech-driven interactions. The user can interactively prompt, move, and manipulate graphical elements through real-time speech and supporting modalities. Based on our analysis of 177 existing video-edited augmented presentations, we propose a novel set of interaction techniques and then incorporated them into RealityTalk. We evaluate our tool from a presenter's perspective to demonstrate the effectiveness of our system.

RealityTalk系统是一种利用语音驱动的交互式虚拟元素增强实时演示的工具，它支持实时语音和其他支持型输入方式来互动地提示、移动和操作图形元素，商业提出了一组新颖的交互技术并进行了评估。

RealityTalk: AR 实时说话驱动的增强展示技术在现场讲故事中的应用