Deep learning for detecting objects in remotely sensed imagery can enable new
technologies for important applications including mitigating climate change.
However, these models often require large datasets labeled with bounding box
annotations which are expensive to curate, prohibiting the development of
models for new tasks and geographies. To address this challenge, we develop
weakly-semi-supervised object detection (WSSOD) models on remotely sensed
imagery which can leverage a small amount of bounding boxes together with a
large amount of point labels that are easy to acquire at scale in geospatial
data. We train WSSOD models which use large amounts of point-labeled images
with varying fractions of bounding box labeled images in FAIR1M and a wind
turbine detection dataset, and demonstrate that they substantially outperform
fully supervised models trained with the same amount of bounding box labeled
images on both datasets. Furthermore, we find that the WSSOD models trained
with 2-10x fewer bounding box labeled images can perform similarly to or
outperform fully supervised models trained on the full set of bounding-box
labeled images. We believe that the approach can be extended to other remote
sensing tasks to reduce reliance on bounding box labels and increase
development of models for impactful applications.

利用弱监督的深度学习模型和少量边界框标记图像，可以在遥感图像中检测物体，从而减少对边界框标记的依赖，提高模型性能。

遥感图像中的弱半监督目标检测

Weakly-semi-supervised object detection in remotely sensed imagery

Research in self-supervised learning (SSL) with natural images has progressed
rapidly in recent years and is now increasingly being applied to and
benchmarked with datasets containing remotely sensed imagery. A common
benchmark case is to evaluate SSL pre-trained model embeddings on datasets of
remotely sensed imagery with small patch sizes, e.g., 32x32 pixels, whereas
standard SSL pre-training takes place with larger patch sizes, e.g., 224x224.
Furthermore, pre-training methods tend to use different image normalization
preprocessing steps depending on the dataset. In this paper, we show, across
seven satellite and aerial imagery datasets of varying resolution, that by
simply following the preprocessing steps used in pre-training (precisely, image
sizing and normalization methods), one can achieve significant performance
improvements when evaluating the extracted features on downstream tasks -- an
important detail overlooked in previous work in this space. We show that by
following these steps, ImageNet pre-training remains a competitive baseline for
satellite imagery based transfer learning tasks -- for example we find that
these steps give +32.28 to overall accuracy on the So2Sat random split dataset
and +11.16 on the EuroSAT dataset. Finally, we report comprehensive benchmark
results with a variety of simple baseline methods for each of the seven
datasets, forming an initial benchmark suite for remote sensing imagery.

本研究发现，将预训练图像的预处理过程直接应用于卫星和航空图像数据集中可以显著提高下游任务的性能；特别是通过这种方式，ImageNet 预训练模型成为卫星图像转移学习任务的一个有竞争力的基准。