Online user-generated content games (UGCGs) are increasingly popular among
children and adolescents for social interaction and more creative online
entertainment. However, they pose a heightened risk of exposure to explicit
content, raising growing concerns for the online safety of children and
adolescents. Despite these concerns, few studies have addressed the issue of
illicit image-based promotions of unsafe UGCGs on social media, which can
inadvertently attract young users. This challenge arises from the difficulty of
obtaining comprehensive training data for UGCG images and the unique nature of
these images, which differ from traditional unsafe content. In this work, we
take the first step towards studying the threat of illicit promotions of unsafe
UGCGs. We collect a real-world dataset comprising 2,924 images that display
diverse sexually explicit and violent content used to promote UGCGs by their
game creators. Our in-depth studies reveal a new understanding of this problem
and the urgent need for automatically flagging illicit UGCG promotions. We
additionally create a cutting-edge system, UGCG-Guard, designed to aid social
media platforms in effectively identifying images used for illicit UGCG
promotions. This system leverages recently introduced large vision-language
models (VLMs) and employs a novel conditional prompting strategy for zero-shot
domain adaptation, along with chain-of-thought (CoT) reasoning for contextual
identification. UGCG-Guard achieves outstanding results, with an accuracy rate
of 94% in detecting these images used for the illicit promotion of such games
in real-world scenarios.

该研究探讨了在线用户生成内容游戏的非法推广问题，通过收集现实世界的数据集并使用先进的视觉 - 语言模型与链式思维推理策略，开发了 UGCG-Guard 系统，在社交媒体平台上有效识别这些非法推广的图片，准确率达到 94%。