News media structure their reporting of events or issues using certain
perspectives.
When describing an incident involving gun violence, for example, some
journalists may focus on mental health or gun regulation, while others may
emphasize the discussion of gun rights. Such perspectives are called
\say{frames} in communication research. We study, for the first time, the value
of combining lead images and their contextual information with text to identify
the frame of a given news article. We observe that using multiple modes of
information(article- and image-derived features) improves prediction of news
frames over any single mode of information when the images are relevant to the
frames of the headlines. We also observe that frame image relevance is related
to the ease of conveying frames via images, which we call frame concreteness.
Additionally, we release the first multimodal news framing dataset related to
gun violence in the U.S., curated and annotated by communication researchers.
The dataset will allow researchers to further examine the use of multiple
information modalities for studying media framing.

研究发现，通过使用多种信息模式（包括文章和图像派生特征）对新闻框架进行预测可以提高准确性，特别是当图像与标题的框架相关时。这也表明框架图像相关性与通过图像传递框架的便利程度相关。此外，作者还发布了美国枪支暴力相关的第一个多模式新闻框架数据集，供传播研究人员进一步研究多种信息模式在媒体框架研究中的应用。