Many computer vision systems require low-cost segmentation algorithms based
on deep learning, either because of the enormous size of input images or
limited computational budget. Common solutions uniformly downsample the input
images to meet memory constraints, assuming all pixels are equally informative.
In this work, we demonstrate that this assumption can harm the segmentation
performance because the segmentation difficulty varies spatially. We combat
this problem by introducing a learnable downsampling module, which can be
optimised together with the given segmentation model in an end-to-end fashion.
We formulate the problem of training such downsampling module as optimisation
of sampling density distributions over the input images given their
low-resolution views. To defend against degenerate solutions (e.g.
over-sampling trivial regions like the backgrounds), we propose a
regularisation term that encourages the sampling locations to concentrate
around the object boundaries. We find the downsampling module learns to sample
more densely at difficult locations, thereby improving the segmentation
performance. Our experiments on benchmarks of high-resolution street view,
aerial and medical images demonstrate substantial improvements in terms of
efficiency-and-accuracy trade-off compared to both uniform downsampling and two
recent advanced downsampling techniques.

本文提出一种基于学习性下采样模块的图像分割算法来解决低成本语义分割，优化采样密度分布并通过规则项鼓励采样位置聚焦于对象边界，实验证明对图像分辨率高、计算资源限制的三组数据集均具有高效 - 准确性的优势。