Although existing neural retrieval models reveal promising results when
training data is abundant and the performance keeps improving as training data
increases, collecting high-quality annotated data is prohibitively costly. To
this end, we introduce a novel noisy self-training framework combined with
synthetic queries, showing that neural retrievers can be improved in a
self-evolution manner with no reliance on any external models. Experimental
results show that our method improves consistently over existing methods on
both general-domain (e.g., MS-MARCO) and out-of-domain (i.e., BEIR) retrieval
benchmarks. Extra analysis on low-resource settings reveals that our method is
data efficient and outperforms competitive baselines, with as little as 30% of
labelled training data. Further extending the framework for reranker training
demonstrates that the proposed method is general and yields additional gains on
tasks of diverse domains.\footnote{Source code is available at
https://github.com/Fantabulous-J/Self-Training-DPR}

使用新颖的带有合成查询的嘈杂自我训练框架，证明了神经检索器可以在没有依赖任何外部模型的情况下以自我进化的方式得到改进，实验证明我们的方法在常见领域（如 MS-MARCO）和领域外（即 BEIR）的检索基准上持续改进。进一步扩展该框架来进行 reranker 训练表明所提出的方法是通用的，在各个领域的任务上都能产生额外的收益。

噪声自训练与合成查询的密集检索

Noisy Self-Training with Synthetic Queries for Dense Retrieval

We present a novel semi-supervised approach for sequence transduction and
apply it to semantic parsing. The unsupervised component is based on a
generative model in which latent sentences generate the unpaired logical forms.
We apply this method to a number of semantic parsing tasks focusing on domains
with limited access to labelled training data and extend those datasets with
synthetically generated logical forms.

我们提出了一种新颖的半监督方法，应用于序列转换和语义分析。该方法包含基于生成模型的无监督成分，在该模型中，潜在的句子生成不成对的逻辑形式，我们将此方法应用于许多语义解析任务，重点关注训练数据标记不足的领域，并使用合成逻辑形式扩充这些数据集。