Current TSA evaluation in a cross-domain setup is restricted to the small set
of review domains available in existing datasets. Such an evaluation is
limited, and may not reflect true performance on sites like Amazon or Yelp that
host diverse reviews from many domains. To address this gap, we present YASO -
a new TSA evaluation dataset of open-domain user reviews. YASO contains 2,215
English sentences from dozens of review domains, annotated with target terms
and their sentiment. Our analysis verifies the reliability of these
annotations, and explores the characteristics of the collected data. Benchmark
results using five contemporary TSA systems show there is ample room for
improvement on this challenging new dataset. YASO is available at
this https URL

本文介绍了一个新的 TSA 评估数据集 YASO，它包含来自多个评论领域的 2,215 个有标注情感倾向的英语句子，旨在解决现有数据集中领域集合小的限制，能够更真实地反映像 Amazon 或 Yelp 这样拥有许多领域不同的评论网站的表现情况，同时对该数据集进行了 5 个 TSA 系统的基准测试，结果表明仍有改进空间。