Developing a universal model that can effectively harness heterogeneous
resources and respond to a wide range of personalized needs has been a
longstanding community aspiration. Our daily choices, especially in domains
like fashion and retail, are substantially shaped by multi-modal data, such as
pictures and textual descriptions. These modalities not only offer intuitive
guidance but also cater to personalized user preferences. However, the
predominant personalization approaches mainly focus on the ID or text-based
recommendation problem, failing to comprehend the information spanning various
tasks or modalities. In this paper, our goal is to establish a Unified paradigm
for Multi-modal Personalization systems (UniMP), which effectively leverages
multi-modal data while eliminating the complexities associated with task- and
modality-specific customization. We argue that the advancements in foundational
generative modeling have provided the flexibility and effectiveness necessary
to achieve the objective. In light of this, we develop a generic and extensible
personalization generative framework, that can handle a wide range of
personalized needs including item recommendation, product search, preference
prediction, explanation generation, and further user-guided image generation.
Our methodology enhances the capabilities of foundational language models for
personalized tasks by seamlessly ingesting interleaved cross-modal user history
information, ensuring a more precise and customized experience for users. To
train and evaluate the proposed multi-modal personalized tasks, we also
introduce a novel and comprehensive benchmark covering a variety of user
requirements. Our experiments on the real-world benchmark showcase the model's
potential, outperforming competitive methods specialized for each task.

UniMP 是一种统一的多模式个性化系统的范式，通过使用多模态数据并消除任务和模态特定定制的复杂性，充分发挥了基础生成模型的灵活性和效力，以实现广泛的个性化需求，包括物品推荐、产品搜索、偏好预测、解释生成和用户引导的图像生成。