BriefGPT.xyz
Feb, 2021
LogME:预训练模型的实用评估与迁移学习
LogME: Practical Assessment of Pre-trained Models for Transfer Learning
HTML
PDF
Kaichao You, Yong Liu, Mingsheng Long, Jianmin Wang
TL;DR
本文提出了一种名为LogME的方法,用于评估预训练模型的转移学习性能,相对于基于粗暴的微调方法,LogME方法在时空效率和内存使用上都有很大的提升,而且适用于不同类型的模型和任务。
Abstract
This paper studies
task adaptive pre-trained model selection
, an \emph{underexplored} problem of assessing
pre-trained models
so that models suitable for the task can be selected from the model zoo without fine-t
→