Recently, federated learning (FL) has emerged as a promising distributed
machine learning (ML) technology, owing to the advancing computational and
sensing capacities of end-user devices, however with the increasing concerns on
users' privacy. As a special architecture in FL, vertical FL (VFL) is capable
of constructing a hyper ML model by embracing sub-models from different
clients. These sub-models are trained locally by vertically partitioned data
with distinct attributes. Therefore, the design of VFL is fundamentally
different from that of conventional FL, raising new and unique research issues.
In this paper, we aim to discuss key challenges in VFL with effective
solutions, and conduct experiments on real-life datasets to shed light on these
issues. Specifically, we first propose a general framework on VFL, and
highlight the key differences between VFL and conventional FL. Then, we discuss
research challenges rooted in VFL systems under four aspects, i.e., security
and privacy risks, expensive computation and communication costs, possible
structural damage caused by model splitting, and system heterogeneity.
Afterwards, we develop solutions to addressing the aforementioned challenges,
and conduct extensive experiments to showcase the effectiveness of our proposed
solutions.

本文针对垂直联邦学习 (VFL) 这种特殊的架构设计，旨在解决 VFL 中关于安全隐私、大量计算和通信成本、模型分裂和系统异构等方面的研究挑战，提出有效的解决方案并在真实数据集上进行了实验，证明了我们的方案的有效性。