BriefGPT.xyz
May, 2024
深度神经网络学习过拟合特征的起始点解释:交互的两阶段动态
Two-Phase Dynamics of Interactions Explains the Starting Point of a DNN Learning Over-Fitted Features
HTML
PDF
Junpeng Zhang, Qing Li, Liang Lin, Quanshi Zhang
TL;DR
该研究探讨了深度神经网络(DNN)学习交互的动态。研究发现DNN学习交互的过程分为两个阶段,并验证了高阶交互相较于低阶交互有较弱的泛化能力,从而解释了DNN的泛化能力在训练过程中的变化。
Abstract
This paper investigates the dynamics of a
deep neural network
(DNN) learning
interactions
. Previous studies have discovered and mathematically proven that given each input sample, a well-trained DNN usually only
→