We consider the problem of distributed feature quantization, where the goal
is to enable a pretrained classifier at a central node to carry out its
classification on features that are gathered from distributed nodes through
communication constrained channels. We propose the design of distributed
quantization schemes specifically tailored to the classification task: unlike
quantization schemes that help the central node reconstruct the original signal
as accurately as possible, our focus is not reconstruction accuracy, but
instead correct classification. Our work does not make any apriori
distributional assumptions on the data, but instead uses training data for the
quantizer design. Our main contributions include: we prove NP-hardness of
finding optimal quantizers in the general case; we design an optimal scheme for
a special case; we propose quantization algorithms, that leverage discrete
neural representations and training data, and can be designed in
polynomial-time for any number of features, any number of classes, and
arbitrary division of features across the distributed nodes. We find that
tailoring the quantizers to the classification task can offer significant
savings: as compared to alternatives, we can achieve more than a factor of two
reduction in terms of the number of bits communicated, for the same
classification accuracy.

本文提出了一种分布式量化方案，旨在用训练数据为分类器设计量化器，不需要先验数据假设，而是专注于正确分类，可在任何特征数、任何类别数和任意特征分布的情况下进行多项式时间量化算法的设计。结果表明，将量化器适应于分类任务可以获得显着的节省，并可在保持预测精度不变的情况下将比特通信数量减少超过两倍。