Temporal action proposal generation is an important task, aiming to localize
the video segments containing human actions in an untrimmed video. In this
paper, we propose a multi-granularity generator (MGG) to perform the temporal
action proposal from different granularity perspectives, relying on the video
visual features equipped with the position embedding information. First, we
propose to use a bilinear matching model to exploit the rich local information
within the video sequence. Afterwards, two components, namely segment proposal
producer (SPP) and frame actionness producer (FAP), are combined to perform the
task of temporal action proposal at two distinct granularities. SPP considers
the whole video in the form of feature pyramid and generates segment proposals
from one coarse perspective, while FAP carries out a finer actionness
evaluation for each video frame. Our proposed MGG can be trained in an
end-to-end fashion. By temporally adjusting the segment proposals with
fine-grained frame actionness information, MGG achieves the superior
performance over state-of-the-art methods on the public THUMOS-14 and
ActivityNet-1.3 datasets. Moreover, we employ existing action classifiers to
perform the classification of the proposals generated by MGG, leading to
significant improvements compared against the competing methods for the video
detection task.

该论文提出了一种多粒度生成器（MGG），从不同的粒度角度利用视频视觉特征执行时间动作提议，将段提议生成器（SPP）和帧活性生产者（FAP）组合起来执行两个不同粒度的时间动作提议任务，可与现有的动作分类器一起用于视频检测任务，具有优于现有方法的性能表现。