In this work we address the practical challenges of training machine learning
models on privacy-sensitive datasets by introducing a modular approach that
minimizes changes to training algorithms, provides a variety of configuration
strategies for the privacy mechanism, and then isolates and simplifies the
critical logic that computes the final privacy guarantees. A key challenge is
that training algorithms often require estimating many different quantities
(vectors) from the same set of examples --- for example, gradients of different
layers in a deep learning architecture, as well as metrics and batch
normalization parameters. Each of these may have different properties like
dimensionality, magnitude, and tolerance to noise. By extending previous work
on the Moments Accountant for the subsampled Gaussian mechanism, we can provide
privacy for such heterogeneous sets of vectors, while also structuring the
approach to minimize software engineering challenges.

本文介绍了一种模块化方法，可以最小化对训练算法的更改，提供各种隐私机制的配置策略，并隔离和简化计算最终隐私保证的关键逻辑，以解决在隐私敏感数据集上训练机器学习模型所面临的实际挑战。