This literature review gives an overview of current approaches to perform
domain adaptation in a low-resource and approaches to perform multilingual
semantic search in a low-resource setting. We developed a new typology to
cluster domain adaptation approaches based on the part of dense textual
information retrieval systems, which they adapt, focusing on how to combine
them efficiently. We also explore the possibilities of combining multilingual
semantic search with domain adaptation approaches for dense retrievers in a
low-resource setting.

该文献综述提供了对于在低资源环境中进行领域适应以及低资源环境中进行多语义搜索的当前方法的概述。我们开发了一种新的分类方法，将领域适应方法基于对于密集文本信息检索系统的部分适应进行聚类，并重点关注如何高效地进行组合。同时，我们还探讨了将多语义搜索与领域适应方法相结合应用于低资源环境中的密集检索器的可能性。

跨语种多语义搜索的领域适应 - 文献综述

Domain Adaptation of Multilingual Semantic Search - Literature Review

Multilingual semantic search is the task of retrieving relevant contents to a
query expressed in different language combinations. This requires a better
semantic understanding of the user's intent and its contextual meaning.
Multilingual semantic search is less explored and more challenging than its
monolingual or bilingual counterparts, due to the lack of multilingual parallel
resources for this task and the need to circumvent "language bias". In this
work, we propose an alignment approach: MAML-Align, specifically for
low-resource scenarios. Our approach leverages meta-distillation learning based
on MAML, an optimization-based Model-Agnostic Meta-Learner. MAML-Align distills
knowledge from a Teacher meta-transfer model T-MAML, specialized in
transferring from monolingual to bilingual semantic search, to a Student model
S-MAML, which meta-transfers from bilingual to multilingual semantic search. To
the best of our knowledge, we are the first to extend meta-distillation to a
multilingual search application. Our empirical results show that on top of a
strong baseline based on sentence transformers, our meta-distillation approach
boosts the gains provided by MAML and significantly outperforms naive
fine-tuning methods. Furthermore, multilingual meta-distillation learning
improves generalization even to unseen languages.

在本研究中，我们提出了一种面向低资源场景的对齐方法：MAML-Align，利用基于优化的模型无关元学习器 MAML 进行元蒸馏学习，从面向单语和双语语义搜索的 Teacher 元迁移模型 T-MAML 中提取知识，再将其转移到面向多语言语义搜索的 Student 模型 S-MAML 中。我们的实证结果表明，相对于朴素微调方法，我们的元蒸馏方法不仅提升了基于句子转换器的强基线的效果，而且显著超过了 MAML 所提供的增益。此外，多语言元蒸馏学习还提高了对未知语言的泛化能力。