In a lot of real-world data mining and machine learning applications, data
are provided by multiple providers and each maintains private records of
different feature sets about common entities. It is challenging to train these
vertically partitioned data effectively and efficiently while keeping data
privacy for traditional data mining and machine learning algorithms. In this
paper, we focus on nonlinear learning with kernels, and propose a federated
doubly stochastic kernel learning (FDSKL) algorithm for vertically partitioned
data. Specifically, we use random features to approximate the kernel mapping
function and use doubly stochastic gradients to update the solutions, which are
all computed federatedly without the disclosure of data. Importantly, we prove
that FDSKL has a sublinear convergence rate, and can guarantee the data
security under the semi-honest assumption. Extensive experimental results on a
variety of benchmark datasets show that FDSKL is significantly faster than
state-of-the-art federated learning methods when dealing with kernels, while
retaining the similar generalization performance.

本论文提出了一种名为 FDSKL 的算法，该算法使用随机特征来近似内核映射函数并使用双随机梯度更新解决方案，旨在高效地学习垂直分割的数据而保持数据安全和隐私。实验结果表明，该算法在处理内核时比现有的联合学习方法更快，并保留了类似的泛化性能。