As an effective alternative to the direct fine-tuning on target tasks in
specific languages, cross-lingual transfer addresses the challenges of limited
training data by decoupling ''task ability'' and ''language ability'' by
fine-tuning on the target task in the source language and another selected task
in the target language, respectively. However, they fail to fully separate the
task ability from the source language or the language ability from the chosen
task. In this paper, we acknowledge the mutual reliance between task ability
and language ability and direct our attention toward the gap between the target
language and the source language on tasks. As the gap removes the impact of
tasks, we assume that it remains consistent across tasks. Based on this
assumption, we propose a new cross-lingual transfer method called
$\texttt{AdaMergeX}$ that utilizes adaptive adapter merging. By introducing a
reference task, we can determine that the divergence of adapters fine-tuned on
the reference task in both languages follows the same distribution as the
divergence of adapters fine-tuned on the target task in both languages. Hence,
we can obtain target adapters by combining the other three adapters.
Furthermore, we propose a structure-adaptive adapter merging method. Our
empirical results demonstrate that our approach yields new and effective
cross-lingual transfer, outperforming existing methods across all settings.

我们提出了一种新的跨语言转移方法 $\texttt {AdaMergeX}$，利用自适应适配器合并，在引入参考任务的基础上，结合其他三个适配器可以获得目标适配器，实验证明该方法在各种设置下都能提供新的有效的跨语言转移，优于现有方法。

AdaMergeX: 透过自适应适配器合并实现大型语言模型的跨语言迁移

AdaMergeX: Cross-Lingual Transfer with Large Language Models via  Adaptive Adapter Merging

The emergence of ChatGPT has generated much speculation in the press about
its potential to disrupt social and economic systems. Its astonishing language
ability has aroused strong curiosity among scholars about its performance in
different domains. There have been many studies evaluating the ability of
ChatGPT and GPT-4 in different tasks and disciplines. However, a comprehensive
review summarizing the collective assessment findings is lacking. The objective
of this survey is to thoroughly analyze prior assessments of ChatGPT and GPT-4,
focusing on its language and reasoning abilities, scientific knowledge, and
ethical considerations. Furthermore, an examination of the existing evaluation
methods is conducted, offering several recommendations for future research in
evaluating large language models.

对 ChatGPT 和 GPT-4 的语言能力、科学知识和伦理考虑进行全面评估的研究，包括现有评估方法的探讨和未来研究中对大型语言模型的评估建议。