Contemporary artificial intelligence systems exhibit rapidly growing abilities accompanied by the growth of required resources, expansive datasets and corresponding investments into computing infrastructure. Although earlier successes predominantly focus on constrained settings, recent strides in fundamental research and applications aspire to create increasingly general systems. This evolving landscape presents a dual panorama of opportunities and challenges in refining the generalisation and transfer of knowledge - the extraction from existing sources and adaptation as a comprehensive foundation for tackling new problems. Within the domain of reinforcement learning (RL), the representation of knowledge manifests through various modalities, including dynamics and reward models, value functions, policies, and the original data. This taxonomy systematically targets these modalities and frames its discussion based on their inherent properties and alignment with different objectives and mechanisms for transfer. Where possible, we aim to provide coarse guidance delineating approaches which address requirements such as limiting environment interactions, maximising computational efficiency, and enhancing generalisation across varying axes of change. Finally, we analyse reasons contributing to the prevalence or scarcity of specific forms of transfer, the inherent potential behind pushing these frontiers, and underscore the significance of transitioning from designed to learned transfer.

当代人工智能系统的不断发展需要相应的资源、大量数据集和计算基础设施，特别是在限制环境下的基础研究和应用中，知识的表示通过各种模态呈现，包括动力学和奖励模型、价值函数、策略和原始数据。该论文系统地讨论了这些模态，并基于其固有属性和与不同目标和机制之间的相互关系来进行讨论，以实现知识的迁移和推广，并分析了特定形式的转移出现或稀缺的原因，并强调从设计到学习的转移的重要性。

强化学习中的迁移基础：知识模式分类