BriefGPT.xyz
Apr, 2024
探索神经网络空间：星状和测地连通性
Exploring Neural Network Landscapes: Star-Shaped and Geodesic Connectivity
HTML
PDF
Zhanran Lin, Puheng Li, Lei Wu
TL;DR
神经网络景观中的连接模式包括线性路径和中心连接，提供了从一个极小值到另一个极小值的连接途径，同时突显景观在超参数化情况下可能具有凸性。
Abstract
One of the most intriguing findings in the structure of
neural network landscape
is the phenomenon of
mode connectivity
: For two typical global minima, there exists a path connecting them without barrier. This co
→