Semantic segmentation is a critical task in computer vision that aims to
identify and classify individual pixels in an image, with numerous applications
for example autonomous driving and medical image analysis. However, semantic
segmentation can be super challenging particularly due to the need for large
amounts of annotated data. Annotating images is a time-consuming and costly
process, often requiring expert knowledge and significant effort. In this
paper, we propose a novel approach for semantic segmentation by eliminating the
need of ground-truth segmentation maps. Instead, our approach requires only the
rough information of individual semantic class proportions, shortened as
semantic proportions. It greatly simplifies the data annotation process and
thus will significantly reduce the annotation time and cost, making it more
feasible for large-scale applications. Moreover, it opens up new possibilities
for semantic segmentation tasks where obtaining the full ground-truth
segmentation maps may not be feasible or practical. Extensive experimental
results demonstrate that our approach can achieve comparable and sometimes even
better performance against the benchmark method that relies on the ground-truth
segmentation maps. Utilising semantic proportions suggested in this work offers
a promising direction for future research in the field of semantic
segmentation.

提出了一种新的语义分割方法，只需要语义类别比例的大致信息，大大简化了数据标注过程，可行性更强，并取得了可比甚至更好的性能表现，为未来的语义分割研究提供了一个有前途的方向。

语义比例下的语义分割

Semantic Segmentation by Semantic Proportions

In this paper, we address the semantic segmentation problem with a focus on
the context aggregation strategy. Our motivation is that the label of a pixel
is the category of the object that the pixel belongs to. We present a simple
yet effective approach, object-contextual representations, characterizing a
pixel by exploiting the representation of the corresponding object class.
First, we learn object regions under the supervision of ground-truth
segmentation. Second, we compute the object region representation by
aggregating the representations of the pixels lying in the object region. Last,
% the representation similarity we compute the relation between each pixel and
each object region and augment the representation of each pixel with the
object-contextual representation which is a weighted aggregation of all the
object region representations according to their relations with the pixel. We
empirically demonstrate that the proposed approach achieves competitive
performance on various challenging semantic segmentation benchmarks:
Cityscapes, ADE20K, LIP, PASCAL-Context, and COCO-Stuff. Cityscapes, ADE20K,
LIP, PASCAL-Context, and COCO-Stuff. Our submission "HRNet + OCR + SegFix"
achieves 1-st place on the Cityscapes leaderboard by the time of submission.
Code is available at: this https URL and this https URL We
rephrase the object-contextual representation scheme using the Transformer
encoder-decoder framework. The details are presented in~Section3.3.

本文探讨用上下文汇聚策略解决语义分割问题，提出了一种基于特定物体上下文表示的简单而有效的方案，并采用变压器编码器 - 解码器框架进行方案实现。