BriefGPT.xyz
Oct, 2023
关于联想记忆的缩放定律
Scaling Laws for Associative Memories
HTML
PDF
Vivien Cabannes, Elvis Dohmatob, Alberto Bietti
TL;DR
通过学习高维矩阵和内层变换器语言模型，研究关联记忆机制、标度定律和统计效率的优化算法，通过数值实验验证理论结果和存储记忆联想的细粒度可视化。
Abstract
learning
arguably involves the discovery and memorization of abstract rules. The aim of this paper is to study
associative memory mechanisms
. Our model is based on
→