BriefGPT.xyz
May, 2023
用于科学文献理解的预训练多任务对比学习模型
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding
HTML
PDF
Yu Zhang, Hao Cheng, Zhihong Shen, Xiaodong Liu, Ye-Yi Wang...
TL;DR
本文提出了一种多任务对比学习框架(SciMult),采用任务感知分化技术和指令调整技术,在多种科学文献的理解任务中优于现有科学语言模型。
Abstract
scientific literature understanding
tasks have gained significant attention due to their potential to accelerate scientific discovery.
pre-trained language models
(LMs) have shown effectiveness in these tasks, es
→