LLMs are increasingly being deployed for multilingual applications and have
demonstrated impressive translation capabilities between several low and high
resource languages. An aspect of translation that often gets overlooked is that
of cultural adaptation, or modifying source culture references to suit the
target culture. Cultural adaptation has applications across several creative
industries and requires intimate knowledge of source and target cultures during
translation. While specialized translation models still outperform LLMs on the
machine translation task when viewed from the lens of correctness, they are not
sensitive to cultural differences often requiring manual correction. LLMs on
the other hand have a rich reservoir of cultural knowledge embedded within its
parameters that can be potentially exploited for such applications. In this
paper we define the task of cultural adaptation and create an evaluation
framework to benchmark different models for this task. We evaluate the
performance of modern LLMs for cultural adaptation and analyze their cross
cultural knowledge while connecting related concepts across different cultures.
We also analyze possible issues with automatic adaptation including cultural
biases and stereotypes. We hope that this task will offer more insight into the
cultural understanding of LLMs and their creativity in cross-cultural
scenarios.

该研究定义了文化适应的任务，并创建了一个评估框架来评估不同模型在这个任务上的性能。研究评估了现代 LLMs 在文化适应方面的表现，分析了它们在不同文化之间连接相关概念时的跨文化知识，并分析了自动适应中可能存在的文化偏见和刻板印象。希望该任务能够更深入地了解 LLMs 在跨文化情境中的文化理解和创造力。