The prevailing practice in the academia is to evaluate the model performance
on in-domain evaluation data typically set aside from the training corpus.
However, in many real world applications the data on which the model is applied
may very substantially differ from the characteristics of the training data. In
this paper, we focus on Finnish out-of-domain parsing by introducing a novel UD
Finnish-OOD out-of-domain treebank including five very distinct data sources
(web documents, clinical, online discussions, tweets, and poetry), and a total
of 19,382 syntactic words in 2,122 sentences released under the Universal
Dependencies framework. Together with the new treebank, we present extensive
out-of-domain parsing evaluation utilizing the available section-level
information from three different Finnish UD treebanks (TDT, PUD, OOD). Compared
to the previously existing treebanks, the new Finnish-OOD is shown include
sections more challenging for the general parser, creating an interesting
evaluation setting and yielding valuable information for those applying the
parser outside of its training domain.

本研究针对芬兰文超领域分析，提出了一个包含五个不同数据源的 UD Finnish-OOD 超领域树库和大量的超领域分析评估。其中新的 Finnish-OOD 树库比之前的树库更具挑战性，为超领域应用提供了有价值的信息。

芬兰语依存句法分析的跨领域评估

Out-of-Domain Evaluation of Finnish Dependency Parsing

The annotation guidelines for Universal Dependencies (UD) stipulate that the
basic units of dependency annotation are syntactic words, but it is not clear
what are syntactic words in Japanese. Departing from the long tradition of
using phrasal units called bunsetsu for dependency parsing, the current UD
Japanese treebanks adopt the Short Unit Words. However, we argue that they are
not syntactic word as specified by the annotation guidelines. Although we find
non-mainstream attempts to linguistically define Japanese words, such
definitions have never been applied to corpus annotation. We discuss the costs
and benefits of adopting the rather unfamiliar criteria.

本研究讨论了当前 Universal Dependencies 在日语依存句法分析中使用 Short Unit Words 作为基础单元的问题，提出其并非传统意义上的句法单词，探讨采用其作为标注准则的成本和收益。