BriefGPT.xyz
Jul, 2021
知识蒸馏用于质量评估
Knowledge Distillation for Quality Estimation
HTML
PDF
Amit Gajbhiye, Marina Fomicheva, Fernando Alva-Manchego, Frédéric Blain, Abiola Obamuyide...
TL;DR
为了调整预先训练的质量评估模型的体积,将强质量评估教师模型的知识直接转移到体积更小的模型中,并结合数据增强,得到了具有8倍更少参数的轻量级质量评估模型。
Abstract
quality estimation
(QE) is the task of automatically predicting
machine translation
quality in the absence of reference translations, making it applicable in real-time settings, such as translating online social
→