We introduce HyperCLOVA X, a family of large language models (LLMs) tailored to the Korean language and culture, along with competitive capabilities in English, math, and coding. HyperCLOVA X was trained on a balanced mix of Korean, English, and code data, followed by instruction-tuning with high-quality human-annotated datasets while abiding by strict safety guidelines reflecting our commitment to responsible AI. The model is evaluated across various benchmarks, including comprehensive reasoning, knowledge, commonsense, factuality, coding, math, chatting, instruction-following, and harmlessness, in both Korean and English. HyperCLOVA X exhibits strong reasoning capabilities in Korean backed by a deep understanding of the language and cultural nuances. Further analysis of the inherent bilingual nature and its extension to multilingualism highlights the model's cross-lingual proficiency and strong generalization ability to untargeted languages, including machine translation between several language pairs and cross-lingual inference tasks. We believe that HyperCLOVA X can provide helpful guidance for regions or countries in developing their sovereign LLMs.

介绍了HyperCLOVA X，这是一种针对韩语和文化进行优化的大型语言模型，具有在英语、数学和编码方面的竞争能力。该模型经过平衡的韩语、英语和代码数据训练，并通过高质量的人工标注数据进行指导，遵守严格的安全准则，体现了我们对负责任人工智能的承诺。在韩语和英语中，HyperCLOVA X在各种基准测试中展现出强大的推理能力，以及对语言和文化细微差异的深刻理解。分析了其固有的双语性质及其在多语言环境下的扩展，突显了该模型的跨语言熟练度和强大的泛化能力，包括多种语言对之间的机器翻译和跨语言推理任务。我们相信，HyperCLOVA X可以为各区域或国家开发其主权语言模型提供有益的指导。

HyperCLOVA X 技术报告