BriefGPT.xyz
Feb, 2023
通过自蒸馏改进可微分架构搜索
Improving Differentiable Architecture Search via Self-Distillation
HTML
PDF
Xunyu Zhu, Jian Li, Yong Liu, Weiping Wang
TL;DR
本篇论文提出了一种基于自蒸馏不同的神经网络结构搜索方法,通过投票教师的方式引导折叠网络的训练,并且与现有最先进的神经网络结构搜索方法相比,实验结果表明了它的优越性。
Abstract
differentiable architecture search
(DARTS) is a simple yet efficient
neural architecture search
(NAS) method. During the search stage, DARTS trains a
→