Search engines operate under a strict time constraint as a fast response is
paramount to user satisfaction. Thus, neural re-ranking models have a limited
time-budget to re-rank documents. Given the same amount of time, a faster
re-ranking model can incorporate more documents than a less efficient one,
leading to a higher effectiveness. To utilize this property, we propose TK
(Transformer-Kernel): a neural re-ranking model for ad-hoc search using an
efficient contextualization mechanism. TK employs a very small number of
Transformer layers (up to three) to contextualize query and document word
embeddings. To score individual term interactions, we use a document-length
enhanced kernel-pooling, which enables users to gain insight into the model. TK
offers an optimal ratio between effectiveness and efficiency: under realistic
time constraints (max. 200 ms per query) TK achieves the highest effectiveness
in comparison to BERT and other re-ranking models. We demonstrate this on three
large-scale ranking collections: MSMARCO-Passage, MSMARCO-Document, and TREC
CAR. In addition, to gain insight into TK, we perform a clustered query
analysis of TK's results, highlighting its strengths and weaknesses on queries
with different types of information need and we show how to interpret the cause
of ranking differences of two documents by comparing their internal scores.

提出了一种名为 TK（Transformer-Kernel）的神经再排序模型，利用一种高效的上下文化机制来进行广告搜索。在最大每次查询 200 毫秒的实际时间限制下，TK 比 BERT 和其他排序模型实现了最高的有效性，通过对 TK 的结果进行聚类查询分析，突出了它在具有不同信息需求类型的查询中的优势和劣势，并展示了通过比较两个文档的内部分数来解释排名差异的原因。

可解释性与时间预算限制下的上下文重新排序

Interpretable & Time-Budget-Constrained Contextualization for Re-Ranking

The usage of neural network models puts multiple objectives in conflict with
each other: Ideally we would like to create a neural model that is effective,
efficient, and interpretable at the same time. However, in most instances we
have to choose which property is most important to us. We used the opportunity
of the TREC 2019 Deep Learning track to evaluate the effectiveness of a
balanced neural re-ranking approach. We submitted results of the TK
(Transformer-Kernel) model: a neural re-ranking model for ad-hoc search using
an efficient contextualization mechanism. TK employs a very small number of
lightweight Transformer layers to contextualize query and document word
embeddings. To score individual term interactions, we use a document-length
enhanced kernel-pooling, which enables users to gain insight into the model.
Our best result for the passage ranking task is: 0.420 MAP, 0.671 nDCG, 0.598
P@10 (TUW19-p3 full). Our best result for the document ranking task is: 0.271
MAP, 0.465 nDCG, 0.730 P@10 (TUW19-d3 re-ranking).

本文介绍了使用 Transformer-Kernel 模型进行文档重排序的方法，并通过 TREC 2019 深度学习赛道的评价来表明其有效性。