We develop a generative attention-based approach to modeling structured
entities comprising different property types, such as numerical, categorical,
string, and composite. This approach handles such heterogeneous data through a
mixed continuous-discrete diffusion process over the properties. Our flexible
framework can model entities with arbitrary hierarchical properties, enabling
applications to structured Knowledge Base (KB) entities and tabular data. Our
approach obtains state-of-the-art performance on a majority of cases across 15
datasets. In addition, experiments with a device KB and a nuclear physics
dataset demonstrate the model's ability to learn representations useful for
entity completion in diverse settings. This has many downstream use cases,
including modeling numerical properties with high accuracy - critical for
science applications, which also benefit from the model's inherent
probabilistic nature.

我们开发了一种生成式基于注意力的方法，用于对结构化实体进行建模，这些实体包括不同类型的属性，如数值、分类、字符串和组合。我们的方法可以处理这种异构数据，并通过连续 - 离散的扩散过程来对属性进行建模。我们的灵活框架可以对具有任意层次属性的实体进行建模，从而能够应用于结构化知识库实体和表格数据。我们的方法在 15 个数据集中的大多数情况下都获得了最先进的性能。此外，通过设备知识库和核物理数据集的实验，证明了该模型在各种环境中学习有用的实体补全表示的能力。这对模型的固有概率特性来说非常重要，在科学应用中对数值属性进行高准确性建模也有很大好处。

KBFormer：用于结构化实体补全的扩散模型

KBFormer: A Diffusion Model for Structured Entity Completion

Predicting interactions between structured entities lies at the core of
numerous tasks such as drug regimen and new material design. In recent years,
graph neural networks have become attractive. They represent structured
entities as graphs and then extract features from each individual graph using
graph convolution operations. However, these methods have some limitations: i)
their networks only extract features from a fix-sized subgraph structure (i.e.,
a fix-sized receptive field) of each node, and ignore features in substructures
of different sizes, and ii) features are extracted by considering each entity
independently, which may not effectively reflect the interaction between two
entities. To resolve these problems, we present MR-GNN, an end-to-end graph
neural network with the following features: i) it uses a multi-resolution based
architecture to extract node features from different neighborhoods of each
node, and, ii) it uses dual graph-state long short-term memory networks
(L-STMs) to summarize local features of each graph and extracts the interaction
features between pairwise graphs. Experiments conducted on real-world datasets
show that MR-GNN improves the prediction of state-of-the-art methods.

本文提出了 MR-GNN，这是一种具有多分辨率结构的图神经网络，能够从不同尺度的数据邻域中提取特征以及提取成对图之间的交互特征，相较于现有方法，显示出更好的预测效果。