BriefGPT.xyz
Dec, 2023
DP-AdamBC: 您的DP-Adam实际上是DP-SGD（除非您应用偏差校正）
DP-AdamBC: Your DP-Adam Is Actually DP-SGD (Unless You Apply Bias Correction)
HTML
PDF
Qiaoyue Tang, Frederick Shpilevskiy, Mathias Lécuyer
TL;DR
提出一种修正Adam优化器中差分隐私偏差的算法DP-AdamBC，有效提高了图像、文本和图节点分类任务的最终准确度。
Abstract
The
adam optimizer
is a popular choice in contemporary deep learning, due to its strong empirical performance. However we observe that in privacy sensitive scenarios, the traditional use of
differential privacy
(
→