There is amazing progress in Deep Learning based models for Image captioning
and Low Light image enhancement. For the first time in literature, this paper
develops a Deep Learning model that translates night scenes to sentences,
opening new possibilities for AI applications in the safety of visually
impaired women. Inspired by Image Captioning and Visual Question Answering, a
novel Interactive Image Captioning is developed. A user can make the AI focus
on any chosen person of interest by influencing the attention scoring.
Attention context vectors are computed from CNN feature vectors and
user-provided start word. The Encoder-Attention-Decoder neural network learns
to produce captions from low brightness images. This paper demonstrates how
women safety can be enabled by researching a novel AI capability in the
Interactive Vision-Language model for perception of the environment in the
night.

本文介绍了一种基于深度学习的图像字幕生成模型，该模型能够将夜晚场景转化为文字描述，为视障女性的安全开辟了新的 AI 应用空间，同时基于注意力机制的交互式图像字幕生成模型也被提出，能够通过用户提供的关注点，使 AI 关注任意人物并为其生成描述，该方法可以用于低照度环境下的图像字幕生成及为提高夜晚中的女性安全作出贡献。