BriefGPT.xyz
Jun, 2023
神经网络集成的输入梯度多样性
Input gradient diversity for neural network ensembles
HTML
PDF
Trung Trinh, Markus Heinonen, Luigi Acerbi, Samuel Kaski
TL;DR
本文提出了一种基于粒子变分推断方法的第一阶斥力深度集成方法FoRDE,通过在输入梯度空间中进行推力,保证算法具有功能差异性,并且能够提高算法的准确性和鲁棒性,实验证明其效果优于其他集成方法和深度集成。
Abstract
deep ensembles
(DEs) demonstrate improved accuracy, calibration and robustness to perturbations over single neural networks partly due to their functional diversity.
particle-based variational inference
(ParVI) m
→