We present GlotScript, an open resource and tool for low resource writing system identification. GlotScript-R is a resource that provides the attested writing systems for more than 7,000 languages. It is compiled by aggregating information from existing writing system resources. GlotScript-T is a writing system identification tool that covers all 161 Unicode 15.0 scripts. For an input text, it returns its script distribution where scripts are identified by ISO 15924 codes. We also present two use cases for GlotScript. First, we demonstrate that GlotScript supports cleaning multilingual corpora such as mC4 and OSCAR. Second, we analyze the tokenization of a number of language models such as GPT-4 using GlotScript and provide insights on the coverage of low resource scripts and languages by each language model. We hope that GlotScript will become a useful resource for work on low resource languages in the NLP community. GlotScript-R and GlotScript-T are available at https://github.com/cisnlp/GlotScript.

GlotScript是一个开放资源和工具，用于低资源写作系统识别，提供了超过7000种语言的已验证写作系统，并且通过整合现有写作系统资源编制。GlotScript-T是一个涵盖了161个Unicode 15.0脚本的写作系统识别工具，用ISO 15924代码标识脚本，以输入文本返回其脚本分布。该研究还展示了GlotScript的两个用例，支持清理多语言语料库和分析语言模型的标记化，希望成为NLP社区中低资源语言研究的有用资源。

GlotScript: 低资源书写系统识别的资源与工具