The quality of natural language texts in fine-tuning datasets plays a critical role in the performance of generative models, particularly in computational creativity tasks such as poem or song lyric generation. Fluency defects in generated poems significantly reduce their value. However, training texts are often sourced from internet-based platforms without stringent quality control, posing a challenge for data engineers to manage defect levels effectively. To address this issue, we propose the use of automated linguistic anomaly detection to identify and filter out low-quality texts from training datasets for creative models. In this paper, we present a comprehensive comparison of unsupervised and supervised text anomaly detection approaches, utilizing both synthetic and human-labeled datasets. We also introduce the RUPOR dataset, a collection of Russian-language human-labeled poems designed for cross-sentence grammatical error detection, and provide the full evaluation code. Our work aims to empower the community with tools and insights to improve the quality of training datasets for generative models in creative domains.

本研究解决了生成模型训练集中自然语言文本质量不足的问题，尤其是在诗歌创作中。我们提出了一种自动语言异常检测的方法，能够有效识别和过滤低质量文本，进而提升生成模型的输出质量。最重要的发现是，通过引入RUPOR数据集和比较多种异常检测方法，本研究为提高创意领域训练数据集的质量提供了有效工具和见解。

检测俄语诗歌文本中的拼写和语法异常