Oct, 2022
长期持续训练的环境成本是否值得?受益的有限证据
Is It Worth the (Environmental) Cost? Limited Evidence for the Benefits of Diachronic Continuous Training
Giuseppe Attanasio, Debora Nozza, Federico Bianchi, Dirk Hovy
TL;DR本文提出增量学习语言模型存在环境费用,并呼吁对连续训练的使用进行反思和对增量学习的研究方向进行更多基准测试。