Reinforcement Learning is a promising tool for learning complex policies even
in fast-moving and object-interactive domains where human teleoperation or
hard-coded policies might fail. To effectively reflect this challenging
category of tasks, we introduce a dynamic, interactive RL testbed based on
robot air hockey. By augmenting air hockey with a large family of tasks ranging
from easy tasks like reaching, to challenging ones like pushing a block by
hitting it with a puck, as well as goal-based and human-interactive tasks, our
testbed allows a varied assessment of RL capabilities. The robot air hockey
testbed also supports sim-to-real transfer with three domains: two simulators
of increasing fidelity and a real robot system. Using a dataset of
demonstration data gathered through two teleoperation systems: a virtualized
control environment, and human shadowing, we assess the testbed with behavior
cloning, offline RL, and RL from scratch.

机器人空中曲棍球动态交互的强化学习实验平台，包括从简单的任务到复杂的任务，支持模拟到真实世界的迁移，并使用演示数据评估了行为克隆、离线强化学习和从零开始的强化学习。