Deep neural networks, and in particular recurrent networks, are promising
candidates to control autonomous agents that interact in real-time with the
physical world. However, this requires a seamless integration of temporal
features into the network's architecture. For the training of and inference
with recurrent neural networks, they are usually rolled out over time, and
different rollouts exist. Conventionally during inference, the layers of a
network are computed in a sequential manner resulting in sparse temporal
integration of information and long response times. In this study, we present a
theoretical framework to describe rollouts, the level of model-parallelization
they induce, and demonstrate differences in solving specific tasks. We prove
that certain rollouts, also for networks with only skip and no recurrent
connections, enable earlier and more frequent responses, and show empirically
that these early responses have better performance. The streaming rollout
maximizes these properties and enables a fully parallel execution of the
network reducing runtime on massively parallel devices. Finally, we provide an
open-source toolbox to design, train, evaluate, and interact with streaming
rollouts.

该研究提出了一种理论框架，描述了滚动操作，它们的模型并行化级别，证明了某些滚动操作的优越性，并通过经验证实这些滚动操作的性能于传统滚动操作更优，从而提高深度神经网络在控制自主代理方面的实用价值。