Image cropping aims to improve the composition as well as aesthetic quality
of an image by removing extraneous content from it. Most of the existing image
cropping databases provide only one or several human-annotated bounding boxes
as the groundtruths, which can hardly reflect the non-uniqueness and
flexibility of image cropping in practice. The employed evaluation metrics such
as intersection-over-union cannot reliably reflect the real performance of a
cropping model, either. This work revisits the problem of image cropping, and
presents a grid anchor based formulation by considering the special properties
and requirements (e.g., local redundancy, content preservation, aspect ratio)
of image cropping. Our formulation reduces the searching space of candidate
crops from millions to no more than ninety. Consequently, a grid anchor based
cropping benchmark is constructed, where all crops of each image are annotated
and more reliable evaluation metrics are defined. To meet the practical demands
of robust performance and high efficiency, we also design an effective and
lightweight cropping model. By simultaneously considering the region of
interest and region of discard, and leveraging multi-scale information, our
model can robustly output visually pleasing crops for images of different
scenes. With less than 2.5M parameters, our model runs at a speed of 200 FPS on
one single GTX 1080Ti GPU and 12 FPS on one i7-6800K CPU. The code is available
at: https://github.com/HuiZeng/Grid-Anchor-based-Image-Cropping-Pytorch.

本研究提出了一种基于网格锚定的图像裁剪模型，通过考虑图像裁剪的特殊性质和要求，如本地冗余、内容保留、宽高比，构建了一个网格锚定裁剪基准，并定义了更可靠的评估指标。同时，该模型模型还采用了多尺度信息，可以为不同场景的图像稳健地输出视觉上令人愉悦的裁剪。