This technical report introduces Aya 23, a family of multilingual language models. Aya 23 builds on the recent release of the Aya model (\"Ust\"un et al., 2024), focusing on pairing a highly performant pre-trained model with the recently released Aya collection (Singh et al., 2024). The result is a powerful multilingual large language model serving 23 languages, expanding state-of-art language modeling capabilities to approximately half of the world's population. The Aya model covered 101 languages whereas Aya 23 is an experiment in depth vs breadth, exploring the impact of allocating more capacity to fewer languages that are included during pre-training. Aya 23 outperforms both previous massively multilingual models like Aya 101 for the languages it covers, as well as widely used models like Gemma, Mistral and Mixtral on an extensive range of discriminative and generative tasks. We release the open weights for both the 8B and 35B models as part of our continued commitment for expanding access to multilingual progress.

Aya 23是一种多语言语言模型，在扩展接近全球人口一半的23种语言的同时，通过将更多容量分配给预训练阶段包含的少量语言，Aya 23在其涵盖的语言上表现较好，超过了Aya 101等大规模多语言模型以及Gemma、Mistral和Mixtral等广泛使用的模型，在广泛的区别性和生成性任务上有着出色的表现。

Aya 23: 开放权重发布以促进多语言进展