The interplay between the image and comment on a social media post is one of
high importance for understanding its overall message. Recent strides in
multimodal embedding models, namely CLIP, have provided an avenue forward in
relating image and text. However the current training regime for CLIP models is
insufficient for matching content found on social media, regardless of site or
language. Current CLIP training data is based on what we call ``descriptive''
text: text in which an image is merely described. This is something rarely seen
on social media, where the vast majority of text content is ``commentative'' in
nature. The captions provide commentary and broader context related to the
image, rather than describing what is in it. Current CLIP models perform poorly
on retrieval tasks where image-caption pairs display a commentative
relationship. Closing this gap would be beneficial for several important
application areas related to social media. For instance, it would allow groups
focused on Open-Source Intelligence Operations (OSINT) to further aid efforts
during disaster events, such as the ongoing Russian invasion of Ukraine, by
easily exposing data to non-technical users for discovery and analysis. In
order to close this gap we demonstrate that training contrastive image-text
encoders on explicitly commentative pairs results in large improvements in
retrieval results, with the results extending across a variety of non-English
languages.

通过训练对比图像 - 文本编码器，利用明确的评论式对提高检索结果的准确性进行了大幅改进，并且这种改进可扩展至多种非英语语言。

C-CLIP：用于缩小描述性文字之间差距的对比图像 - 文本编码器

C-CLIP: Contrastive Image-Text Encoders to Close the  Descriptive-Commentative Gap

Comment on ``Microarrays, Empirical Bayes and the Two-Groups Model''
[arXiv:0808.0572]

这篇论文是关于对使用 Microarrays、经验贝叶斯和双组模型的文章 [arXiv:0808.0572] 进行评论的。

微阵列，经验贝叶斯和双组模型

Comment: Microarrays, Empirical Bayes and the Two-Groups Model

Comment on ``Understanding OR, PS and DR'' [arXiv:0804.2958]

评论关于 “理解 OR，PS 和 DR” [arXiv：0804.2958] 的研究论文。