BriefGPT.xyz
Mar, 2024
重新思考用于多光谱卫星图像的Transformer预训练
Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagery
HTML
PDF
Mubashir Noman, Muzammal Naseer, Hisham Cholakkal, Rao Muhammad Anwar, Salman Khan...
TL;DR
SatMAE++是一种多尺度的远程感知图像预训练方法,通过利用多模态数据和卷积上采样块在不同尺度上重构图像,达到了光学和多光谱遥感数据的同等有效性,并在大规模数据集上实现了最先进性能。
Abstract
Recent advances in
unsupervised learning
have demonstrated the ability of large vision models to achieve promising results on downstream tasks by pre-training on large amount of unlabelled data. Such
pre-training techni
→