Quantum computing (QC) in the current NISQ-era is still limited. To gain early insights and advantages, hybrid applications are widely considered mitigating those shortcomings. Hybrid quantum machine learning (QML) comprises both the application of QC to improve machine learning (ML), and the application of ML to improve QC architectures. This work considers the latter, focusing on leveraging reinforcement learning (RL) to improve current QC approaches. We therefore introduce various generic challenges arising from quantum architecture search and quantum circuit optimization that RL algorithms need to solve to provide benefits for more complex applications and combinations of those. Building upon these challenges we propose a concrete framework, formalized as a Markov decision process, to enable to learn policies that are capable of controlling a universal set of quantum gates. Furthermore, we provide benchmark results to assess shortcomings and strengths of current state-of-the-art algorithms.

该研究论文介绍了量子计算在当前NISQ时代的限制，并提出了通过混合量子机器学习来改善量子计算架构的方法，重点是利用强化学习来优化当前的量子计算方法，并介绍了由量子架构搜索和量子电路优化引起的各种挑战，以及提出的用于学习控制一组万能量子门的具体框架，并提供基准结果以评估当前最先进算法的优点和短处。

量子计算中强化学习的挑战