Previous research on scanpath prediction has mainly focused on group models,
disregarding the fact that the scanpaths and attentional behaviors of
individuals are diverse. The disregard of these differences is especially
detrimental to social human-robot interaction, whereby robots commonly emulate
human gaze based on heuristics or predefined patterns. However, human gaze
patterns are heterogeneous and varying behaviors can significantly affect the
outcomes of such human-robot interactions. To fill this gap, we developed a
deep learning-based social cue integration model for saliency prediction to
instead predict scanpaths in videos. Our model learned scanpaths by recursively
integrating fixation history and social cues through a gating mechanism and
sequential attention. We evaluated our approach on gaze datasets of dynamic
social scenes, observed under the free-viewing condition. The introduction of
fixation history into our models makes it possible to train a single unified
model rather than the resource-intensive approach of training individual models
for each set of scanpaths. We observed that the late neural integration
approach surpasses early fusion when training models on a large dataset, in
comparison to a smaller dataset with a similar distribution. Results also
indicate that a single unified model, trained on all the observers' scanpaths,
performs on par or better than individually trained models. We hypothesize that
this outcome is a result of the group saliency representations instilling
universal attention in the model, while the supervisory signal guides it to
learn personalized attentional behaviors, providing the unified model a benefit
over individual models due to its implicit representation of universal
attention.

通过深度学习的社交线索整合模型，我们开发了一个视频中注视预测的模型，通过递归地整合注视历史和社交线索来学习注视路径，以填补以往只关注群体模型而忽视了个体差异的研究空白。我们观察到这种单一统一的模型通过整合普遍关注和个体化注意力行为的方式在注视数据集上表现出色，优于个别训练的模型。