Following the successful 2023 edition, we organised the Second Perception Test challenge as a half-day workshop alongside the IEEE/CVF European Conference on Computer Vision (ECCV) 2024, with the goal of benchmarking state-of-the-art video models and measuring the progress since last year using the Perception Test benchmark. This year, the challenge had seven tracks (up from six last year) and covered low-level and high-level tasks, with language and non-language interfaces, across video, audio, and text modalities; the additional track covered hour-long video understanding and introduced a novel video QA benchmark 1h-walk VQA. Overall, the tasks in the different tracks were: object tracking, point tracking, temporal action localisation, temporal sound localisation, multiple-choice video question-answering, grounded video question-answering, and hour-long video question-answering. We summarise in this report the challenge tasks and results, and introduce in detail the novel hour-long video QA benchmark 1h-walk VQA.

本文针对现有视频模型评估的不足，召开了2024年第二届感知测试挑战，通过引入新的1小时视频问答基准来推动视频理解的研究。该研究的关键成果在于设立了多个追踪和问答任务，通过比较各模型的表现，促进了视频理解领域的进一步发展。

2024年感知测试：挑战摘要与一种新颖的小时视频问答基准