BriefGPT.xyz
Dec, 2017
基于核采样的自适应采样Softmax
Adaptive Sampled Softmax with Kernel Based Sampling
HTML
PDF
Guy Blanc, Steffen Rendle
TL;DR
本文提出了基于核函数的采样方法并发展了高效的采样算法以减少对于大量样本情况下传统采样方法的偏倚问题。实验结果表明此方法相较于传统采样方法偏差较小并且需要的样本数更少。
Abstract
softmax
is the most commonly used output function for
multiclass problems
and is widely used in areas such as vision, natural language processing, and recommendation. A
→