BriefGPT.xyz
Apr, 2024
MergeNet:跨异构模型、任务和模态的知识迁移
MergeNet: Knowledge Migration across Heterogeneous Models, Tasks, and Modalities
HTML
PDF
Kunxi Li, Tianyu Zhan, Shengyu Zhang, Kun Kuang, Jiwei Li...
TL;DR
本研究主要关注异构知识传输,通过MergeNet模型和参数适配器实现跨不同模型结构、任务和模式的知识交互和应用,以及在异构知识传输中取得显著改进的实验结果。
Abstract
In this study, we focus on
heterogeneous knowledge transfer
across entirely different
model architectures
, tasks, and modalities. Existing knowledge transfer methods (e.g., backbone sharing,
→