BriefGPT.xyz
Jun, 2021
声学模型的缩放率
Scaling Laws for Acoustic Models
HTML
PDF
Jasha Droppo, Oguz Elibol
TL;DR
本文研究机器学习中的自回归生成模型和声学模型,探讨其性能和规模之间的比例关系,通过预测各项损失量,建立规模预测和性能选择间的联系,提出了几个调整性能的超参数的方案
Abstract
There is a recent trend in
machine learning
to increase model quality by growing models to sizes previously thought to be unreasonable. Recent work has shown that
autoregressive generative models
with cross-entro
→