Imagine training a machine learning model with Differentially Private
Stochastic Gradient Descent (DP-SGD), only to discover post-training that the
noise level was either too high, crippling your model's utility, or too low,
compromising privacy. The dreaded realization hits: you must start the lengthy
training process from scratch. But what if you could avoid this retraining
nightmare? In this study, we introduce a groundbreaking approach (to our
knowledge) that applies differential privacy noise to the model's weights after
training. We offer a comprehensive mathematical proof for this novel approach's
privacy bounds, use formal methods to validate its privacy guarantees, and
empirically evaluate its effectiveness using membership inference attacks and
performance evaluations. This method allows for a single training run, followed
by post-hoc noise adjustments to achieve optimal privacy-utility trade-offs. We
compare this novel fine-tuned model (DP-Weights model) to a traditional DP-SGD
model, demonstrating that our approach yields statistically similar performance
and privacy guarantees. Our results validate the efficacy of post-training
noise application, promising significant time savings and flexibility in
fine-tuning differential privacy parameters, making it a practical alternative
for deploying differentially private models in real-world scenarios.

使用差分隐私和加噪声的方法对机器学习模型进行训练，通过对模型的权重添加噪声来实现隐私和效用的平衡，并通过实验证明了该方法的有效性，为在实际场景中部署差分隐私模型提供了一种实用的替代方案。