Animal populations worldwide are rapidly declining, and a technology that can
accurately count endangered species could be vital for monitoring population
changes over several years. This research focused on fine-tuning object
detection models for drone images to create accurate counts of animal species.
Hundreds of images taken using a drone and large, openly available drone-image
datasets were used to fine-tune machine learning models with the baseline
YOLOv8 architecture. We trained 30 different models, with the largest having
43.7 million parameters and 365 layers, and used hyperparameter tuning and data
augmentation techniques to improve accuracy. While the state-of-the-art YOLOv8
baseline had only 0.7% accuracy on a dataset of safari animals, our models had
95% accuracy on the same dataset. Finally, we deployed the models on the Jetson
Orin Nano for demonstration of low-power real-time species detection for easy
inference on drones.

动物种群数量急剧下降，精确计数濒危物种的技术对于长期监测种群变化至关重要。本研究侧重于优化用于无人机图像的目标检测模型，以创建准确的动物物种计数。通过使用无人机拍摄的数百张图片和大量可获取的无人机图像数据集，我们将传统的 YOLOv8 架构进行了优化。我们训练了 30 个不同的模型，其中最大的模型具有 4370 万个参数和 365 个层，并利用超参数调整和数据增强技术来提高准确性。尽管最先进的 YOLOv8 基线在野生动物数据集上只有 0.7％的准确性，但我们的模型在相同数据集上达到 95％的准确性。最后，我们将模型部署在 Jetson Orin Nano 上，演示了低功耗实时物种检测，便于在无人机上进行推断。

用于濒危动物种群监测的多物种目标检测无人机图像系统

Multi-Species Object Detection in Drone Imagery for Population  Monitoring of Endangered Animals

Recent advances in training vision-language models have demonstrated
unprecedented robustness and transfer learning effectiveness; however, standard
computer vision datasets are image-only, and therefore not well adapted to such
training methods. Our paper introduces a simple methodology for adapting any
fine-grained image classification dataset for distributed vision-language
pretraining. We implement this methodology on the challenging iNaturalist-2021
dataset, comprised of approximately 2.7 million images of macro-organisms
across 10,000 classes, and achieve a new state-of-the art model in terms of
zero-shot classification accuracy. Somewhat surprisingly, our model (trained
using a new method called locked-image text tuning) uses a pre-trained, frozen
vision representation, proving that language alignment alone can attain strong
transfer learning performance, even on fractious, long-tailed datasets. Our
approach opens the door for utilizing high quality vision-language pretrained
models in agriculturally relevant applications involving species detection.

该论文提出了一种适用于分布式视觉语言预训练的简单方法，并在具有挑战性的 iNaturalist-2021 数据集上实现了零样本分类精度，从而打开了在涉及物种检测的农业相关应用中利用高质量视觉 - 语言预训练模型的新途径。