BriefGPT.xyz
Nov, 2023
通过逐层特征压缩和差异化理解深度表示学习
Understanding Deep Representation Learning via Layerwise Feature Compression and Discrimination
HTML
PDF
Peng Wang, Xiao Li, Can Yaras, Zhihui Zhu, Laura Balzano...
TL;DR
通过研究深度线性网络的中间特征,本文量化揭示了特征在层级表示中的演化规律,证明线性网络的每一层以几何速率压缩类内特征,与通过数据的层数线性关系的方式区分类间特征,这不仅在深度非线性网络中得到验证,而且在迁移学习中具有实际应用意义。
Abstract
Over the past decade,
deep learning
has proven to be a highly effective tool for learning meaningful features from raw data. However, it remains an open question how deep networks perform
hierarchical feature learning
→