Most existing multi-object tracking methods typically learn visual tracking
features via maximizing dis-similarities of different instances and minimizing
similarities of the same instance. While such a feature learning scheme
achieves promising performance, learning discriminative features solely based
on visual information is challenging especially in case of environmental
interference such as occlusion, blur and domain variance. In this work, we
argue that multi-modal language-driven features provide complementary
information to classical visual features, thereby aiding in improving the
robustness to such environmental interference. To this end, we propose a new
multi-object tracking framework, named LG-MOT, that explicitly leverages
language information at different levels of granularity (scene-and
instance-level) and combines it with standard visual features to obtain
discriminative representations. To develop LG-MOT, we annotate existing MOT
datasets with scene-and instance-level language descriptions. We then encode
both instance-and scene-level language information into high-dimensional
embeddings, which are utilized to guide the visual features during training. At
inference, our LG-MOT uses the standard visual features without relying on
annotated language descriptions. Extensive experiments on three benchmarks,
MOT17, DanceTrack and SportsMOT, reveal the merits of the proposed
contributions leading to state-of-the-art performance. On the DanceTrack test
set, our LG-MOT achieves an absolute gain of 2.2\% in terms of target object
association (IDF1 score), compared to the baseline using only visual features.
Further, our LG-MOT exhibits strong cross-domain generalizability. The dataset
and code will be available at ~https://github.com/WesLee88524/LG-MOT.

通过结合多模态的语言驱动特征和视觉特征，在多目标跟踪中提出了一种新的 LG-MOT 框架，它在不同层次上（场景和实例级）明确利用语言信息并且与标准视觉特征结合以获得判别性表示。通过在现有的 MOT 数据集中注释场景和实例级的语言描述，将语言信息编码到高维度嵌入中，并在训练过程中用于引导视觉特征。在三个基准测试集 MOT17、DanceTrack 和 SportsMOT 上进行了广泛实验，结果显示提出的方法在性能上达到了最先进水平，并在舞蹈跟踪测试集上相对于仅使用视觉特征的基线方法具有绝对增益 2.2％。此外，所提出的 LG-MOT 表现出良好的跨领域泛化能力。

多粒度语言指导的多目标追踪

Multi-Granularity Language-Guided Multi-Object Tracking

Electromagnetic waves undergo multiple uncontrollable alterations as they
propagate within a wireless environment. Free space path loss, signal
absorption, as well as reflections, refractions and diffractions caused by
physical objects within the environment highly affect the performance of
wireless communications. Currently, such effects are intractable to account for
and are treated as probabilistic factors. The paper proposes a radically
different approach, enabling deterministic, programmable control over the
behavior of the wireless environments. The key-enabler is the so-called
HyperSurface tile, a novel class of planar meta-materials which can interact
with impinging electromagnetic waves in a controlled manner. The HyperSurface
tiles can effectively re-engineer electromagnetic waves, including steering
towards any desired direction, full absorption, polarization manipulation and
more. Multiple tiles are employed to coat objects such as walls, furniture,
overall, any objects in the indoor and outdoor environments. An external
software service calculates and deploys the optimal interaction types per tile,
to best fit the needs of communicating devices. Evaluation via simulations
highlights the potential of the new concept.

该论文提出了一种新的方法，通过使用称为 HyperSurface tile 的新型平面超材料与电磁波交互以实现对无线环境中的干扰变化的可预测可控，其通过操纵电磁波，包括指向任何所需方向，全吸收，极化操纵等来实现优化无线通信的效果。