In this paper, a proactive dynamic spectrum sharing scheme between 4G and 5G
systems is proposed. In particular, a controller decides on the resource split
between NR and LTE every subframe while accounting for future network states
such as high interference subframes and multimedia broadcast single frequency
network (MBSFN) subframes. To solve this problem, a deep reinforcement learning
(RL) algorithm based on Monte Carlo Tree Search (MCTS) is proposed. The
introduced deep RL architecture is trained offline whereby the controller
predicts a sequence of future states of the wireless access network by
simulating hypothetical bandwidth splits over time starting from the current
network state. The action sequence resulting in the best reward is then
assigned. This is realized by predicting the quantities most directly relevant
to planning, i.e., the reward, the action probabilities, and the value for each
network state. Simulation results show that the proposed scheme is able to take
actions while accounting for future states instead of being greedy in each
subframe. The results also show that the proposed framework improves
system-level performance.

本文提出一种新型的动态频谱共享方案，并使用深度强化学习算法基于蒙特卡罗树搜索进行资源分配，该方案能够在考虑未来网络状态的情况下执行操作，比当前的其他方案表现更好。