Resource allocation significantly impacts the performance of
vehicle-to-everything (V2X) networks. Most existing algorithms for resource
allocation are based on optimization or machine learning (e.g., reinforcement
learning). In this paper, we explore resource allocation in a V2X network under
the framework of federated reinforcement learning (FRL). On one hand, the usage
of RL overcomes many challenges from the model-based optimization schemes. On
the other hand, federated learning (FL) enables agents to deal with a number of
practical issues, such as privacy, communication overhead, and exploration
efficiency. The framework of FRL is then implemented by the inexact alternative
direction method of multipliers (ADMM), where subproblems are solved
approximately using policy gradients and accelerated by an adaptive step size
calculated from their second moments. The developed algorithm, PASM, is proven
to be convergent under mild conditions and has a nice numerical performance
compared with some baseline methods for solving the resource allocation problem
in a V2X network.

在车联网（V2X）网络中，我们通过联邦强化学习（FRL）框架探索资源分配，并使用非精确交替方向乘子法（ADMM）实现了算法 PASM，在 V2X 网络中解决资源分配问题，并与基线方法进行了比较。