BriefGPT.xyz
Oct, 2020
通过即时编译和向量化实现快速差分私有 SGD
Enabling Fast Differentially Private SGD via Just-in-Time Compilation and Vectorization
HTML
PDF
Pranav Subramani, Nicholas Vadivelu, Gautam Kamath
TL;DR
该研究论文通过利用向量化、即时编译和静态图优化等语言基元,显著减少了执行DPSGD的运行时间开销,实现了与最佳非私有运行时间几乎相当的结果,从而实现多达50倍的加速和重要的内存和运行时改进。
Abstract
A common pain point in
differentially private machine learning
is the significant runtime overhead incurred when executing Differentially Private Stochastic Gradient Descent (
dpsgd
), which may be as large as two
→