BriefGPT.xyz
Jan, 2023
面向目标驱动的二元交流的情感面孔
Affective Faces for Goal-Driven Dyadic Communication
HTML
PDF
Scott Geng, Revant Teotia, Purva Tendulkar, Sachit Menon, Carl Vondrick
TL;DR
本研究介绍了一种视频框架,用于建模双人对话中口头和非口头交流之间的关联,提出了一种通过大型语言模型和视觉-语言模型构成的对话建模方法,并提出了一种新的无剧本对话视频数据集,实验和可视化结果表明,该方法能够生成显著更具社交适切性的监听者。
Abstract
We introduce a
video framework
for modeling the association between
verbal and non-verbal communication
during dyadic conversation. Given the input speech of a speaker, our approach retrieves a video of a listene
→