From human physiology to environmental evolution, important processes in
nature often exhibit meaningful and strong periodic or quasi-periodic changes.
Due to their inherent label scarcity, learning useful representations for
periodic tasks with limited or no supervision is of great benefit. Yet,
existing self-supervised learning (SSL) methods overlook the intrinsic
periodicity in data, and fail to learn representations that capture periodic or
frequency attributes. In this paper, we present SimPer, a simple contrastive
SSL regime for learning periodic information in data. To exploit the periodic
inductive bias, SimPer introduces customized augmentations, feature similarity
measures, and a generalized contrastive loss for learning efficient and robust
periodic representations. Extensive experiments on common real-world tasks in
human behavior analysis, environmental sensing, and healthcare domains verify
the superior performance of SimPer compared to state-of-the-art SSL methods,
highlighting its intriguing properties including better data efficiency,
robustness to spurious correlations, and generalization to distribution shifts.
Code and data are available at: this https URL.

本文提出 SimPer 自监督学习方法，针对自然界中周期变化的过程，通过定制增强、特征相似度度量和对比损失函数等手段，学习数据中的周期信息，并在人类行为分析、环境感知和医疗领域中的常见真实世界任务中得到了验证和应用。