Semitic languages can be highly ambiguous, having several interpretations of
the same surface forms, and morphologically rich, having many morphemes that
realize several morphological features. This is further exacerbated for
dialectal content, which is more prone to noise and lacks a standard
orthography. The morphological features can be lexicalized, like lemmas and
diacritized forms, or non-lexicalized, like gender, number, and part-of-speech
tags, among others. Joint modeling of the lexicalized and non-lexicalized
features can identify more intricate morphological patterns, which provide
better context modeling, and further disambiguate ambiguous lexical choices.
However, the different modeling granularity can make joint modeling more
difficult. Our approach models the different features jointly, whether
lexicalized (on the character-level), where we also model surface form
normalization, or non-lexicalized (on the word-level). We use Arabic as a test
case, and achieve state-of-the-art results for Modern Standard Arabic, with 20%
relative error reduction, and Egyptian Arabic (a dialectal variant of Arabic),
with 11% reduction.

该研究使用阿拉伯语探讨了联合建模的方法，具体包括字符级别的词汇化特征和字词级别的非词汇化特征，可以更好地将模糊的语言特征解模糊，进一步提高模型的效果和词义的准确性。该方法在现代标准阿拉伯语和阿拉伯埃及话方言的翻译中都取得了相对较好的实验结果。