We investigate the problem of supporting Industrial Internet of Things user
equipment (IIoT UEs) with intent (i.e., requested quality of service (QoS)) and
random traffic arrival. A deep reinforcement learning (DRL) based centralized
dynamic scheduler for time-frequency resources is proposed to learn how to
schedule the available communication resources among the IIoT UEs. The proposed
scheduler leverages an RL framework to adapt to the dynamic changes in the
wireless communication system and traffic arrivals. Moreover, a graph-based
reduction scheme is proposed to reduce the state and action space of the RL
framework to allow fast convergence and a better learning strategy. Simulation
results demonstrate the effectiveness of the proposed intelligent scheduler in
guaranteeing the expressed intent of IIoT UEs compared to several traditional
scheduling schemes, such as round-robin, semi-static, and heuristic approaches.
The proposed scheduler also outperforms the contention-free and
contention-based schemes in maximizing the number of successfully computed
tasks.

支持工业物联网用户设备（IIoT UEs）根据所需服务质量（QoS）和随机流量到达的问题进行调查，提出了一种基于深度强化学习（DRL）的集中式动态调度器，用于学习如何在可用通信资源之间安排 IIoT UEs 的通信资源，通过图形化的简化方案以实现快速收敛和更好的学习策略，模拟结果证明了所提出的智能调度器在保证 IIoT UEs 的期望意图方面的有效性，并与传统调度方案（如轮询、半静态和启发式方法）以及无冲突和基于竞争的方案相比具有更好的性能，可以最大化成功计算任务的数量。

面向意图感知的基于 DRL 的 5G-NR 上行动态调度器

Intent-Aware DRL-Based Uplink Dynamic Scheduler for 5G-NR

We consider the optimal packet scheduling problem in a single-user energy
harvesting wireless communication system. In this system, both the data packets
and the harvested energy are modeled to arrive at the source node randomly. Our
goal is to adaptively change the transmission rate according to the traffic
load and available energy, such that the time by which all packets are
delivered is minimized. Under a deterministic system setting, we assume that
the energy harvesting times and harvested energy amounts are known before the
transmission starts. For the data traffic arrivals, we consider two different
scenarios. In the first scenario, we assume that all bits have arrived and are
ready at the transmitter before the transmission starts. In the second
scenario, we consider the case where packets arrive during the transmissions,
with known arrival times and sizes. We develop optimal off-line scheduling
policies which minimize the time by which all packets are delivered to the
destination, under causality constraints on both data and energy arrivals.

本文研究了单用户能量收集无线通信系统中最优数据包调度问题，以适应流量负荷和可用能量，并开发了最优的离线调度策略，以最小化所有数据包被送达的时间.