Federated medical relation extraction enables multiple clients to train a
deep network collaboratively without sharing their raw medical data. In order
to handle the heterogeneous label distribution across clients, most of the
existing works only involve enforcing regularization between local and global
models during optimization. In this paper, we fully utilize the models of all
clients and propose a novel concept of \textit{major classifier vectors}, where
a group of class vectors is obtained in an ensemble rather than the weighted
average method on the server. The major classifier vectors are then distributed
to all clients and the local training of each client is Contrasted with Major
Classifier vectors (FedCMC), so the local model is not prone to overfitting to
the local label distribution. FedCMC requires only a small amount of additional
transfer of classifier parameters without any leakage of raw data, extracted
representations, and label distributions. Our extensive experiments show that
FedCMC outperforms the other state-of-the-art FL algorithms on three medical
relation extraction datasets.

本文提出了一种称为 FedCMC 的方法，可以在不泄露原始数据、提取的表示和标签分布的情况下，仅通过转移分类器参数的少量附加传输，使多个客户端协同训练深度网络，其中使用了所提出的新概念 “Major Classifier Vectors” 来处理客户之间异构标签分布的问题，在三个医疗关系抽取数据集上的实验证实了该方法的有效性。