BriefGPT.xyz
Jul, 2022
2020年代更多的ConvNets:使用稀疏性将核心扩展到超过51x51
More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity
HTML
PDF
Shiwei Liu, Tianlong Chen, Xiaohan Chen, Xuxi Chen, Qiao Xiao...
TL;DR
本论文研究了在极端卷积核上训练和验证了能够光滑扩展卷积核的方法,提出了一种基于此方法的纯卷积神经网络结构SLaK,可以在图像分类和各种下游任务中实现与分层变压器和现代 ConvNet 结构相当甚至更好的性能表现。
Abstract
transformers
have quickly shined in the computer vision world since the emergence of Vision
transformers
(
vits
). The dominant role of conv
→