Multi-Agent Reinforcement Learning currently focuses on implementations where
all data and training can be centralized to one machine. But what if local
agents are split across multiple tasks, and need to keep data private between
each? We develop the first application of Personalized Federated Hypernetworks
(PFH) to Reinforcement Learning (RL). We then present a novel application of
PFH to few-shot transfer, and demonstrate significant initial increases in
learning. PFH has never been demonstrated beyond supervised learning
benchmarks, so we apply PFH to an important domain: RL price-setting for energy
demand response. We consider a general case across where agents are split
across multiple microgrids, wherein energy consumption data must be kept
private within each microgrid. Together, our work explores how the fields of
personalized federated learning and RL can come together to make learning
efficient across multiple tasks while keeping data secure.

本文介绍了一种新型的多智能体强化学习模型 Personalized Federated Hypernetworks (PFH)，并将其应用于少样本迁移 (transfer) 学习和 RL 场景中的能源需求响应 (price-setting)，实验结果表明 PFH 能够在保持数据安全的前提下达到多个任务的高效学习。