BriefGPT.xyz
Nov, 2021
AdaViT: 自适应视觉Transformer用于高效图像识别
AdaViT: Adaptive Vision Transformers for Efficient Image Recognition
HTML
PDF
Lingchen Meng, Hengduo Li, Bor-Chun Chen, Shiyi Lan, Zuxuan Wu...
TL;DR
本文提出了AdaViT,一个自适应的计算框架,旨在提高视觉变换器的推理效率,而只有0.8%的准确率下降,并在不同的计算预算条件下实现了良好的效率/准确性平衡。
Abstract
Built on top of
self-attention mechanisms
,
vision transformers
have demonstrated remarkable performance on a variety of vision tasks recently. While achieving excellent performance, they still require relatively
→