Most existing simultaneous machine translation (SiMT) systems are trained and evaluated on offline translation corpora. We argue that SiMT systems should be trained and tested on real interpretation data. To illustrate this argument, we propose an interpretation test set and conduct a realistic evaluation of SiMT trained on offline translations. Our results, on our test set along with 3 existing smaller scale language pairs, highlight the difference of up-to 13.83 BLEU score when SiMT models are evaluated on translation vs interpretation data. In the absence of interpretation training data, we propose a translation-to-interpretation (T2I) style transfer method which allows converting existing offline translations into interpretation-style data, leading to up-to 2.8 BLEU improvement. However, the evaluation gap remains notable, calling for constructing large-scale interpretation corpora better suited for evaluating and developing SiMT systems.

该研究旨在证明同时机器翻译系统应该使用实际口译数据进行训练和测试，对使用离线翻译数据进行训练的同时机器翻译系统进行评估，结果表明使用口译数据评估时，BLEU分数可提高多达13.83，提出了一种将离线翻译转换为口译风格数据的解决方法，并建议构建更适合评估和开发同时机器翻译系统的大规模口译语料库。 

评估同声传译数据上的同时机器翻译表现