Secure Bilevel Asynchronous Vertical Federated Learning With Backward Updating

Authors

Qingsong Zhang, Xidian University & JD Tech, Beijing, ChinaFollow
Bin Gu, JD Finance America Corporation & Mohamed bin Zayed University of Artificial IntelligenceFollow
Cheng Deng, Xidian University, Xi'an, ChinaFollow
Heng Huang, JD Finance America Corporation, USA & University of PittsburghFollow

Document Type

Article

Publication Title

arXiv

Abstract

Vertical federated learning (VFL) attracts increasing attention due to the emerging demands of multi-party collaborative modeling and concerns of privacy leakage. In the real VFL applications, usually only one or partial parties hold labels, which makes it challenging for all parties to collaboratively learn the model without privacy leakage. Meanwhile, most existing VFL algorithms are trapped in the synchronous computations, which leads to inefficiency in their real-world applications. To address these challenging problems, we propose a novel VFL framework integrated with new backward updating mechanism and bilevel asynchronous parallel architecture (VFB2), under which three new algorithms, including VFB2-SGD, - SVRG, and -SAGA, are proposed. We derive the theoretical results of the convergence rates of these three algorithms under both strongly convex and nonconvex conditions. We also prove the security of VFB2 under semi-honest threat models. Extensive experiments on benchmark datasets demonstrate that our algorithms are efficient, scalable and lossless. Copyright © 2021, The Authors. All rights reserved.

DOI

10.48550/arXiv.2103.00958

Publication Date

3-1-2021

Comments

Preprint: arXiv

Recommended Citation

Q. Zhang, B. Gu, C. Deng, and H. Huang, "Secure bilevel asynchronous vertical federated learning with backward updating," 2021, arXiv:2103.00958