In this paper, we investigate that the normalized coordinate expression is a
key factor as reliance on hand-crafted components in query-based detectors for
temporal action detection (TAD). Despite significant advancements towards an
end-to-end framework in object detection, query-based detectors have been
limited in achieving full end-to-end modeling in TAD. To address this issue, we
propose \modelname{}, a full end-to-end temporal action detection transformer
that integrates time-aligned coordinate expression. We reformulate coordinate
expression utilizing actual timeline values, ensuring length-invariant
representations from the extremely diverse video duration environment.
Furthermore, our proposed adaptive query selection dynamically adjusts the
number of queries based on video length, providing a suitable solution for
varying video durations compared to a fixed query set. Our approach not only
simplifies the TAD process by eliminating the need for hand-crafted components
but also significantly improves the performance of query-based detectors. Our
TE-TAD outperforms the previous query-based detectors and achieves competitive
performance compared to state-of-the-art methods on popular benchmark datasets.
Code is available at: this https URL

我们提出了一种全面的端到端时序动作检测变换器，它通过整合时间对齐的坐标表达式来解决依赖手工组件的查询型检测器在时序动作检测中的问题。我们的方法不仅简化了时序动作检测过程，而且显著改善了查询型检测器的性能。