In this paper, we study the task of instructional dialogue and focus on the
cooking domain. Analyzing the generated output of the GPT-J model, we reveal
that the primary challenge for a recipe-grounded dialog system is how to
provide the instructions in the correct order. We hypothesize that this is due
to the model's lack of understanding of user intent and inability to track the
instruction state (i.e., which step was last instructed). Therefore, we propose
to explore two auxiliary subtasks, namely User Intent Detection and Instruction
State Tracking, to support Response Generation with improved instruction
grounding. Experimenting with our newly collected dataset, ChattyChef, shows
that incorporating user intent and instruction state information helps the
response generation model mitigate the incorrect order issue. Furthermore, to
investigate whether ChatGPT has completely solved this task, we analyze its
outputs and find that it also makes mistakes (10.7% of the responses), about
half of which are out-of-order instructions. We will release ChattyChef to
facilitate further research in this area at:
this https URL

通过探索辅助子任务：用户意图检测和指令状态追踪，以支持响应生成，从而提高指令基础的对话系统的性能，实验结果表明它能够缓解生成错误顺序的问题，并在分析 ChatGPT 的输出时发现其仍存在错误。