The ultimate goal of dialog research is to develop systems that can be effectively used in interactive settings by real users. To this end, we introduced the Interactive Evaluation of Dialog Track at the 9th Dialog System Technology Challenge. This track consisted of two sub-tasks. The first sub-task involved building knowledge-grounded response generation models. The second sub-task aimed to extend dialog models beyond static datasets by assessing them in an interactive setting with real users. Our track challenges participants to develop strong response generation models and explore strategies that extend them to back-and-forth interactions with real users. The progression from static corpora to interactive evaluation introduces unique challenges and facilitates a more thorough assessment of open-domain dialog systems. This paper provides an overview of the track, including the methodology and results. Furthermore, it provides insights into how to best evaluate open-domain dialog models

该论文介绍了针对开放领域对话系统的交互式评估方法，为开发基于知识的响应生成模型，探索将其扩展到与真实用户的交互中提供挑战，从而介绍了从静态语料库到交互式评估的进展，以及如何最好评估开放领域对话模型的见解。

DSTC9中的对话跟踪交互式评估