BriefGPT.xyz
Dec, 2022
DP-RAFT: 加速微调的差分隐私配方
DP-RAFT: A Differentially Private Recipe for Accelerated Fine-Tuning
HTML
PDF
Ashwinee Panda, Xinyu Tang, Vikash Sehwag, Saeed Mahloujifar, Prateek Mittal
TL;DR
本文介绍了一种不同ially private fine-tuning的方法，通过关键超参数的选择来加快训练，从而在计算机视觉和自然语言处理的基准任务中获得了新的最好表现，具有巨大的实际应用前景。
Abstract
A major direction in
differentially private machine learning
is differentially private
fine-tuning
:
pretraining
a model on a source of "pu
→