Humans inevitably develop a sense of the relationships between objects, some
of which are based on their appearance. Some pairs of objects might be seen as
being alternatives to each other (such as two pairs of jeans), while others may
be seen as being complementary (such as a pair of jeans and a matching shirt).
This information guides many of the choices that people make, from buying
clothes to their interactions with each other. We seek here to model this human
sense of the relationships between objects based on their appearance. Our
approach is not based on fine-grained modeling of user annotations but rather
on capturing the largest dataset possible and developing a scalable method for
uncovering human notions of the visual relationships within. We cast this as a
network inference problem defined on graphs of related images, and provide a
large-scale dataset for the training and evaluation of the same. The system we
develop is capable of recommending which clothes and accessories will go well
together (and which will not), amongst a host of other applications.

本文旨在通过建立一个基于图像的大规模数据集并开发一个可扩展的方法来揭示人类视觉关系方面的概念模型，该模型不是基于用户注释的细粒度建模，而是基于图像关系网络的网络推理问题。 其提供了一个用于训练和评估的大规模数据集，并可用于推荐衣物和配饰的搭配。