BriefGPT.xyz
Nov, 2019
ConveRT: 基于变形金刚的高效和准确的对话表示
ConveRT: Efficient and Accurate Conversational Representations from Transformers
HTML
PDF
Matthew Henderson, Iñigo Casanueva, Nikola Mrkšić, Pei-Hao Su, Tsung-Hsien Wen...
TL;DR
提出了一种名为ConveRT的预训练框架用于对话任务,其采用一种检索式的响应选择任务来预训练轻量级双编码器,能够实现在显著提高性能的同时降低模型大小,进而应用于广泛的对话任务和意图分类任务中。
Abstract
General-purpose pretrained sentence encoders such as BERT are not ideal for real-world
conversational ai
applications; they are computationally heavy, slow, and expensive to train. We propose
convert
(Conversatio
→