BriefGPT.xyz
Mar, 2024
损失景观的灵敏度分析
Sensitivity Analysis On Loss Landscape
HTML
PDF
Salman Faroz
TL;DR
利用梯度进行敏感性分析,通过自动微分以及包含激活函数的损失函数探索损失空间中影响因变量的独立变量,利用二阶梯度可视化类似于Spearman相关系数结果的信息,同时一阶和三阶导数也揭示了独立变量对因变量的影响程度。
Abstract
gradients
can be employed for sensitivity analysis. Here, we leverage the advantages of the
loss landscape
to comprehend which independent variables impact the dependent variable. We seek to grasp the
→