Motivated by recent commentary that has questioned today's pursuit of
ever-more complex models and mathematical formalisms in applied machine
learning and whether meaningful empirical progress is actually being made, this
paper tries to tackle the decades-old problem of pseudo-relevance feedback with
"the simplest thing that can possibly work". I present a technique based on
training a document relevance classifier for each information need using
pseudo-labels from an initial ranked list and then applying the classifier to
rerank the retrieved documents. Experiments demonstrate significant
improvements across a number of newswire collections, with initial rankings
supplied by "bag of words" BM25 as well as from a well-tuned query expansion
model. While this simple technique draws elements from several well-known
threads in the literature, to my knowledge this exact combination has not
previously been proposed and evaluated.

本文提出了一种基于文档相关性分类器的技术，使用来自经过排序的初始列表的伪标签，然后将分类器应用于重新排列检索到的文档，以解决伪相关反馈的问题。该技术可以显著提高多个新闻集合的结果，包括使用词袋模型 BM25 以及精调查询扩展模型。