With recent advancements in visual synthesis, there is a growing risk of
encountering images with detrimental effects, such as hate, discrimination, or
privacy violations. The research on transforming harmful images into
responsible ones remains unexplored. In this paper, we formulate a new task,
responsible visual editing, which entails modifying specific concepts within an
image to render it more responsible while minimizing changes. However, the
concept that needs to be edited is often abstract, making it challenging to
locate what needs to be modified and plan how to modify it. To tackle these
challenges, we propose a Cognitive Editor (CoEditor) that harnesses the large
multimodal model through a two-stage cognitive process: (1) a perceptual
cognitive process to focus on what needs to be modified and (2) a behavioral
cognitive process to strategize how to modify. To mitigate the negative
implications of harmful images on research, we create a transparent and public
dataset, AltBear, which expresses harmful information using teddy bears instead
of humans. Experiments demonstrate that CoEditor can effectively comprehend
abstract concepts within complex scenes and significantly surpass the
performance of baseline models for responsible visual editing. We find that the
AltBear dataset corresponds well to the harmful content found in real images,
offering a consistent experimental evaluation, thereby providing a safer
benchmark for future research. Moreover, CoEditor also shows great results in
general editing. We release our code and dataset at
this https URL

本研究探索了将有害图像转化为负责任的图像的新任务，并提出了一种名为 Cognitive Editor 的模型，通过两个认知阶段的过程来提高其性能。研究还创建了一个名为 AltBear 的数据集，用泰迪熊代替人类来表达有害信息。实验结果表明，Cognitive Editor 在理解复杂场景中的抽象概念方面表现出色，并在负责任的视觉编辑方面明显优于基线模型。