Social navigation and pedestrian behavior research has shifted towards machine learning-based methods and converged on the topic of modeling inter-pedestrian interactions and pedestrian-robot interactions. For this, large-scale datasets that contain rich information are needed. We describe a portable data collection system, coupled with a semi-autonomous labeling pipeline. As part of the pipeline, we designed a label correction web app that facilitates human verification of automated pedestrian tracking outcomes. Our system enables large-scale data collection in diverse environments and fast trajectory label production. Compared with existing pedestrian data collection methods, our system contains three components: a combination of top-down and ego-centric views, natural human behavior in the presence of a socially appropriate "robot", and human-verified labels grounded in the metric space. To the best of our knowledge, no prior data collection system has a combination of all three components. We further introduce our ever-expanding dataset from the ongoing data collection effort -- the TBD Pedestrian Dataset and show that our collected data is larger in scale, contains richer information when compared to prior datasets with human-verified labels, and supports new research opportunities.

我们设计了一个便携的数据采集系统，结合了自主标注流水线，通过一个标签修正的网络应用来实现对自动行人跟踪结果的人工验证，在多个环境下实现大规模数据采集和快速轨迹标签生产。与现有行人数据采集方法相比，我们的系统具备了自上而下和自我中心视图的组合、在社交适宜的“机器人”情境下的自然人类行为以及基于度量空间的经过人工验证的标签，是第一个同时集成这三个组成部分的数据采集系统。我们进一步介绍了我们正在进行的数据采集工作的不断扩展的数据集——TBD行人数据集，并展示了与具有人工验证标签的先前数据集相比我们采集的数据更大规模、包含更丰富信息，并支持新的研究机会。

TBD行人数据收集：朝着丰富、便携和大规模的自然行人数据