Why do some streets attract more social activities than others? Is it due to
street design, or do land use patterns in neighborhoods create opportunities
for businesses where people gather? These questions have intrigued urban
sociologists, designers, and planners for decades. Yet, most research in this
area has remained limited in scale, lacking a comprehensive perspective on the
various factors influencing social interactions in urban settings. Exploring
these issues requires fine-level data on the frequency and variety of social
interactions on urban street. Recent advances in computer vision and the
emergence of the open-vocabulary detection models offer a unique opportunity to
address this long-standing issue on a scale that was previously impossible
using traditional observational methods. In this paper, we propose a new
benchmark dataset for Evaluating Localization of Social Activities (ELSA) in
urban street images. ELSA draws on theoretical frameworks in urban sociology
and design. While majority of action recognition datasets are collected in
controlled settings, we use in-the-wild street-level imagery, where the size of
social groups and the types of activities can vary significantly. ELSA includes
937 manually annotated images with more than 4,300 multi-labeled bounding boxes
for individual and group activities, categorized into three primary groups:
Condition, State, and Action. Each category contains various sub-categories,
e.g., alone or group under Condition category, standing or walking, which fall
under the State category, and talking or dining with regards to the Action
category. ELSA is publicly available for the research community.

为评估城市街道中社交活动的定位而提出了一个考察社交活动定位的新的基准数据集 (ELSA)，利用城市社会学和设计的理论框架，包含 937 张手动标注的图像和 4300 多个多标签边界框，用于个人和群体活动的分类，公开供研究社区使用。