Global feature based Pedestrian Attribute Recognition (PAR) models are often
poorly localized when using Grad-CAM for attribute response analysis, which has
a significant impact on the interpretability, generalizability and performance.
Previous researches have attempted to improve generalization and interpretation
through meticulous model design, yet they often have neglected or underutilized
effective prior information crucial for PAR. To this end, a novel Scale and
Spatial Priors Guided Network (SSPNet) is proposed for PAR, which is mainly
composed of the Adaptive Feature Scale Selection (AFSS) and Prior Location
Extraction (PLE) modules. The AFSS module learns to provide reasonable scale
prior information for different attribute groups, allowing the model to focus
on different levels of feature maps with varying semantic granularity. The PLE
module reveals potential attribute spatial prior information, which avoids
unnecessary attention on irrelevant areas and lowers the risk of model
over-fitting. More specifically, the scale prior in AFSS is adaptively learned
from different layers of feature pyramid with maximum accuracy, while the
spatial priors in PLE can be revealed from part feature with different
granularity (such as image blocks, human pose keypoint and sparse sampling
points). Besides, a novel IoU based attribute localization metric is proposed
for Weakly-supervised Pedestrian Attribute Localization (WPAL) based on the
improved Grad-CAM for attribute response mask. The experimental results on the
intra-dataset and cross-dataset evaluations demonstrate the effectiveness of
our proposed method in terms of mean accuracy (mA). Furthermore, it also
achieves superior performance on the PCS dataset for attribute localization in
terms of IoU. Code will be released at this https URL

通过提出一种新的尺度和空间先验引导网络（SSPNet），利用自适应特征尺度选择（AFSS）和先验位置提取（PLE）模块，该方法实现了行人属性识别模型的精确定位和提高了解释性、泛化能力和性能。此外，通过改进的 Grad-CAM 结合基于 IoU 的弱监督行人属性定位指标，在各种评估中证明了该方法的有效性，并在属性定位的 IoU 方面在 PCS 数据集上取得了优越的性能。