This article explores the concepts of online protocol synthesis using Reinforcement Learning (RL). The study is performed in the context of sensor and IoT networks with ultra low complexity wireless transceivers. The paper introduces the use of RL and Multi Armed Bandit (MAB), a specific type of RL, for Medium Access Control (MAC) under different network and traffic conditions. It then introduces a novel learning based protocol synthesis framework that addresses specific difficulties and limitations in medium access for both random access and time slotted networks. The mechanism does not rely on carrier sensing, network time-synchronization, collision detection, and other low level complex operations, thus making it ideal for ultra simple transceiver hardware used in resource constrained sensor and IoT networks. Additionally, the ability of independent protocol learning by the nodes makes the system robust and adaptive to the changes in network and traffic conditions. It is shown that the nodes can be trained to learn to avoid collisions, and to achieve network throughputs that are comparable to ALOHA based access protocols in sensor and IoT networks with simplest transceiver hardware. It is also shown that using RL, it is feasible to synthesize access protocols that can sustain network throughput at high traffic loads, which is not feasible in the ALOHA-based systems. The ability of the system to provide throughput fairness under network and traffic heterogeneities are also experimentally demonstrated.

本文探讨了使用强化学习的在线协议合成的概念。 该研究在使用超低复杂度无线收发器的传感器和物联网网络的背景下进行。 该论文介绍了在不同的网络和流量条件下使用RL和Multi Armed Bandit（MAB）（一种特定类型的RL）来进行介质访问控制（MAC）。 该机制不依赖于载波感知、网络时间同步、碰撞检测和其他低级复杂操作，因此非常适合资源受限的传感器和物联网网络中使用的超简单收发器硬件。

资源受限的无线传感器和物联网网络中的协议合成增强学习