BriefGPT.xyz
Mar, 2023
数据集选择和压缩的损失曲率匹配
Loss-Curvature Matching for Dataset Selection and Condensation
HTML
PDF
Seungjae Shin, Heesun Bae, Donghyeok Shin, Weonyoung Joo, Il-Chul Moon
TL;DR
使用新的LCMat目标函数,匹配神经网络模型参数空间中原始数据集和减小后的数据集的损失曲率,以提高数据集减小的泛化性能。实验结果表明,LCMat相较于现有基线算法具有更好的性能。
Abstract
Training
neural networks
on a large dataset requires substantial computational costs.
dataset reduction
selects or synthesizes data instances based on the large dataset, while minimizing the degradation in
→