On April 13th, 2019, OpenAI Five became the first AI system to defeat the
world champions at an esports game. The game of Dota 2 presents novel
challenges for AI systems such as long time horizons, imperfect information,
and complex, continuous state-action spaces, all challenges which will become
increasingly central to more capable AI systems. OpenAI Five leveraged existing
reinforcement learning techniques, scaled to learn from batches of
approximately 2 million frames every 2 seconds. We developed a distributed
training system and tools for continual training which allowed us to train
OpenAI Five for 10 months. By defeating the Dota 2 world champion (Team OG),
OpenAI Five demonstrates that self-play reinforcement learning can achieve
superhuman performance on a difficult task.

2019 年 4 月 13 日，OpenAI Five 成为首个击败电子竞技游戏世界冠军的 AI 系统，通过对分布式训练和强化学习技术的不断完善，OpenAI Five 进行了 10 个月的自我训练，并证明了自我对战强化学习技术在困难任务上能够实现超人类表现。