Discretizing multi-dimensional data distributions is a fundamental step of
modern indexing methods. State-of-the-art techniques learn parameters of
quantizers on training data for optimal performance, thus adapting quantizers
to the data. In this work, we propose to reverse this paradigm and adapt the
data to the quantizer: we train a neural net which last layer forms a fixed
parameter-free quantizer, such as pre-defined points of a hyper-sphere. As a
proxy objective, we design and train a neural network that favors uniformity in
the spherical latent space, while preserving the neighborhood structure after
the mapping. We propose a new regularizer derived from the Kozachenko--Leonenko
differential entropy estimator to enforce uniformity and combine it with a
locality-aware triplet loss. Experiments show that our end-to-end approach
outperforms most learned quantization methods, and is competitive with the
state of the art on widely adopted benchmarks. Furthermore, we show that
training without the quantization step results in almost no difference in
accuracy, but yields a generic catalyzer that can be applied with any
subsequent quantizer.

该研究提出了一种基于神经网络的反向数据量化策略，通过在神经网络最后一层形成预定义超球体点的无参数量化器，训练神经网络来实现对数据进行适配的目标；通过 Kozachenko-Leonenko 差分熵估计器导出新的正则化项来强制实现数据空间内的均匀性，并进行本地特性感知的 Triplet Loss，实验结果表明这种方法的性能优于大多数方法，与现有的最佳方法相当。