Recurrent Neural Networks excel at predicting and generating complex
high-dimensional temporal patterns. Due to their inherent nonlinear dynamics
and memory, they can learn unbounded temporal dependencies from data. In a
Machine Learning setting, the network's parameters are adapted during a
training phase to match the requirements of a given task/problem increasing its
computational capabilities. After the training, the network parameters are kept
fixed to exploit the learned computations. The static parameters thereby render
the network unadaptive to changing conditions, such as external or internal
perturbation. In this manuscript, we demonstrate how keeping parts of the
network adaptive even after the training enhances its functionality and
robustness. Here, we utilize the conceptor framework and conceptualize an
adaptive control loop analyzing the network's behavior continuously and
adjusting its time-varying internal representation to follow a desired target.
We demonstrate how the added adaptivity of the network supports the
computational functionality in three distinct tasks: interpolation of temporal
patterns, stabilization against partial network degradation, and robustness
against input distortion. Our results highlight the potential of adaptive
networks in machine learning beyond training, enabling them to not only learn
complex patterns but also dynamically adjust to changing environments,
ultimately broadening their applicability.

本文展示了通过将网络的某些部分保持适应性，即使在训练之后，增强了其功能和稳健性，并且展示了适应性网络在插值、网络部分退化稳定化和输入扭曲鲁棒性方面的计算功能，同时强调了适应性网络在机器学习中的潜力，使其不仅能学习复杂模式，还能动态调整以适应不断变化的环境，从而扩大其适用范围。