Within the context of hybrid quantum-classical optimization, gradient descent
based optimizers typically require the evaluation of expectation values with
respect to the outcome of parameterized quantum circuits. In this work, we
explore the consequences of the prior observation that estimation of these
quantities on quantum hardware results in a form of stochastic gradient descent
optimization. We formalize this notion, which allows us to show that in many
relevant cases, including VQE, QAOA and certain quantum classifiers, estimating
expectation values with $k$ measurement outcomes results in optimization
algorithms whose convergence properties can be rigorously well understood, for
any value of $k$. In fact, even using single measurement outcomes for the
estimation of expectation values is sufficient. Moreover, in many settings the
required gradients can be expressed as linear combinations of expectation
values -- originating, e.g., from a sum over local terms of a Hamiltonian, a
parameter shift rule, or a sum over data-set instances -- and we show that in
these cases $k$-shot expectation value estimation can be combined with sampling
over terms of the linear combination, to obtain "doubly stochastic" gradient
descent optimizers. For all algorithms we prove convergence guarantees,
providing a framework for the derivation of rigorous optimization results in
the context of near-term quantum devices. Additionally, we explore numerically
these methods on benchmark VQE, QAOA and quantum-enhanced machine learning
tasks and show that treating the stochastic settings as hyper-parameters allows
for state-of-the-art results with significantly fewer circuit executions and
measurements.

本文探索了在混合量子 - 经典优化的上下文中，利用量子硬件估计期望值所产生的随机梯度下降优化，证明了在很多相关算法，如 VQE、QAOA 和某些量子分类器中使用 $k$ 次测量结果估计期望值的优化算法的收敛性能可以得到严格的理解，本文证明了所有算法都有收敛保证，并在基准 VQE、QAOA 和量子增强机器学习任务上进行了数值探索。