Large Multimodal Models (LMMs) have demonstrated impressive performance
across various vision and language tasks, yet their potential applications in
recommendation tasks with visual assistance remain unexplored. To bridge this
gap, we present a preliminary case study investigating the recommendation
capabilities of GPT-4V(ison), a recently released LMM by OpenAI. We construct a
series of qualitative test samples spanning multiple domains and employ these
samples to assess the quality of GPT-4V's responses within recommendation
scenarios. Evaluation results on these test samples prove that GPT-4V has
remarkable zero-shot recommendation abilities across diverse domains, thanks to
its robust visual-text comprehension capabilities and extensive general
knowledge. However, we have also identified some limitations in using GPT-4V
for recommendations, including a tendency to provide similar responses when
given similar inputs. This report concludes with an in-depth discussion of the
challenges and research opportunities associated with utilizing GPT-4V in
recommendation scenarios. Our objective is to explore the potential of
extending LMMs from vision and language tasks to recommendation tasks. We hope
to inspire further research into next-generation multimodal generative
recommendation models, which can enhance user experiences by offering greater
diversity and interactivity. All images and prompts used in this report will be
accessible at this https URL

通过研究 GPT-4V (ison)，我们发现多模态模型在推荐任务中的潜力，并证明了 GPT-4V 具有出色的零 - shot 推荐能力，同时也发现了其在类似输入上提供相似响应的局限性。我们希望激发进一步研究下一代多模态生成式推荐模型，以提供更多样性和互动性，从而增强用户体验。