Contrastive language-audio pretraining~(CLAP) has been developed to align the
representations of audio and language, achieving remarkable performance in
retrieval and classification tasks. However, current CLAP struggles to capture
temporal information within audio and text features, presenting substantial
limitations for tasks such as audio retrieval and generation. To address this
gap, we introduce T-CLAP, a temporal-enhanced CLAP model. We use Large Language
Models~(LLMs) and mixed-up strategies to generate temporal-contrastive captions
for audio clips from extensive audio-text datasets. Subsequently, a new
temporal-focused contrastive loss is designed to fine-tune the CLAP model by
incorporating these synthetic data. We conduct comprehensive experiments and
analysis in multiple downstream tasks. T-CLAP shows improved capability in
capturing the temporal relationship of sound events and outperforms
state-of-the-art models by a significant margin.

使用大型语言模型和混淆策略生成音频剪辑的时序对比性描述，并设计新的时序对比损失函数来改进对比性语音 - 文本预训练模型 (T-CLAP)，结果在多个下游任务中显示出更强的捕捉音频事件时序关系的能力并显著超越了最先进的模型。