Visual recognition inside the vehicle cabin leads to safer driving and more
intuitive human-vehicle interaction but such systems face substantial obstacles
as they need to capture different granularities of driver behaviour while
dealing with highly limited body visibility and changing illumination.
Multimodal recognition mitigates a number of such issues: prediction outcomes
of different sensors complement each other due to different modality-specific
strengths and weaknesses. While several late fusion methods have been
considered in previously published frameworks, they constantly feature
different architecture backbones and building blocks making it very hard to
isolate the role of the chosen late fusion strategy itself. This paper presents
an empirical evaluation of different paradigms for decision-level late fusion
in video-based driver observation. We compare seven different mechanisms for
joining the results of single-modal classifiers which have been both popular,
(e.g. score averaging) and not yet considered (e.g. rank-level fusion) in the
context of driver observation evaluating them based on different criteria and
benchmark settings. This is the first systematic study of strategies for fusing
outcomes of multimodal predictors inside the vehicles, conducted with the goal
to provide guidance for fusion scheme selection.

本文通过对视频驾驶员观察中的决策级别融合策略进行比较和评估，从视觉识别和多模态识别角度提出决策级别融合的方案，旨在指导融合策略的选择。