BriefGPT.xyz
Jan, 2017
具有虫洞连接的记忆增强神经网络
Memory Augmented Neural Networks with Wormhole Connections
HTML
PDF
Caglar Gulcehre, Sarath Chandar, Yoshua Bengio
TL;DR
本文提出了一种名为“TARDIS”的新型记忆增强神经网络模型,利用记忆构建起到过去的虫洞连接,有效地缓解了梯度消失问题,提高了学习效率,并在不同的长期依赖任务中获得了竞争性结果。
Abstract
Recent empirical results on
long-term dependency tasks
have shown that neural networks augmented with an external memory can learn the
long-term dependency tasks
more easily and achieve better generalization than
→