We describe federated reconnaissance, a class of learning problems in which
distributed clients learn new concepts independently and communicate that
knowledge efficiently. In particular, we propose an evaluation framework and
methodological baseline for a system in which each client is expected to learn
a growing set of classes and communicate knowledge of those classes efficiently
with other clients, such that, after knowledge merging, the clients should be
able to accurately discriminate between classes in the superset of classes
observed by the set of clients. We compare a range of learning algorithms for
this problem and find that prototypical networks are a strong approach in that
they are robust to catastrophic forgetting while incorporating new information
efficiently. Furthermore, we show that the online averaging of prototype
vectors is effective for client model merging and requires only a small amount
of communication overhead, memory, and update time per class with no
gradient-based learning or hyperparameter tuning. Additionally, to put our
results in context, we find that a simple, prototypical network with four
convolutional layers significantly outperforms complex, state of the art
continual learning algorithms, increasing the accuracy by over 22% after
learning 600 Omniglot classes and over 33% after learning 20 mini-ImageNet
classes incrementally. These results have important implications for federated
reconnaissance and continual learning more generally by demonstrating that
communicating feature vectors is an efficient, robust, and effective means for
distributed, continual learning.

在分布式客户端独立地学习新概念并高效地交流知识的计算机学习问题中，我们提出了一种评估框架和方法基线，比较了学习算法并发现原型网络是一种强大的方法，其对灾难性遗忘具有鲁棒性，并高效地合并新信息。我们证明，原型向量的在线平均是有效的客户端模型合并，每个类别只需要很少的通信开销，内存和更新时间而无需梯度学习或超参数调整。