BriefGPT.xyz
Mar, 2024
SpiralMLP:一种轻量级视觉MLP架构
SpiralMLP: A Lightweight Vision MLP Architecture
HTML
PDF
Haojie Mu, Burhan Ul Tayyab, Nicholas Chua
TL;DR
SpiralMLP是一种新颖的架构,通过将传统的Token Mixing方法替换为Spiral FC层,引入了螺旋状偏移量,实现了局部和全局特征的无缝集成,并在ImageNet-1k、COCO和ADE20K数据集上达到了与Transformers、CNNs以及其他MLPs相似的最先进性能。
Abstract
We present
spiralmlp
, a novel architecture that introduces a
spiral fc layer
as a replacement for the conventional Token Mixing approach. Differing from several existing MLP-based models that primarily emphasize
→