The coordination of robotic swarms and the remote wireless control of
industrial systems are among the major use cases for 5G and beyond systems: in
these cases, the massive amounts of sensory information that needs to be shared
over the wireless medium can overload even high-capacity connections.
Consequently, solving the effective communication problem by optimizing the
transmission strategy to discard irrelevant information can provide a
significant advantage, but is often a very complex task. In this work, we
consider a prototypal system in which an observer must communicate its sensory
data to an actor controlling a task (e.g., a mobile robot in a factory). We
then model it as a remote Partially Observable Markov Decision Process (POMDP),
considering the effect of adopting semantic and effective
communication-oriented solutions on the overall system performance. We split
the communication problem by considering an ensemble Vector Quantized
Variational Autoencoder (VQ-VAE) encoding, and train a Deep Reinforcement
Learning (DRL) agent to dynamically adapt the quantization level, considering
both the current state of the environment and the memory of past messages. We
tested the proposed approach on the well-known CartPole reference control
problem, obtaining a significant performance increase over traditional
approaches

本研究考虑了机器人群和远程无线控制任务中的有效通信问题，并提出使用基于 VQ-VAE 编码的 DRL 动态适应量化级别的方案来提高系统性能。