In face of the pressing need of decarbonization in the power sector, the
re-design of electricity market is necessary as a Marco-level approach to
accommodate the high penetration of renewable generations, and to achieve power
system operation security, economic efficiency, and environmental friendliness.
However, existing market design methodologies suffer from the lack of
coordination among energy spot market (ESM), ancillary service market (ASM) and
financial market (FM), i.e., the "joint market", and the lack of reliable
simulation-based verification. To tackle these deficiencies, this two-part
paper develops a paradigmatic theory and detailed methods of the joint market
design using reinforcement-learning (RL)-based simulation. In Part 1, the
theory and framework of this novel market design philosophy are proposed.
First, the controversial market design options while designing the joint market
are summarized as the targeted research questions. Second, the Markov game
model is developed to describe the bidding game in the joint market,
incorporating the market design options to be determined. Third, a framework of
deploying multiple types of RL algorithms to simulate the market model is
developed. Finally, several market operation performance indicators are
proposed to validate the market design based on the simulation results.

为了实现电力系统的去碳化和环境友好型，本文提出了重新设计电力市场作为一种宏观方法，以适应可再生发电的高渗透率，其中应用了强化学习技术，解决了能源现货市场、辅助服务市场和金融市场之间协调缺乏的问题，提出了多种市场运营绩效指标进行验证。