Recent development of deep neural networks (DNNs) for tabular learning has
largely benefited from the capability of DNNs for automatic feature
interaction. However, the heterogeneity nature of tabular features makes such
features relatively independent, and developing effective methods to promote
tabular feature interaction still remains an open problem. In this paper, we
propose a novel Graph Estimator, which automatically estimates the relations
among tabular features and builds graphs by assigning edges between related
features. Such relation graphs organize independent tabular features into a
kind of graph data such that interaction of nodes (tabular features) can be
conducted in an orderly fashion. Based on our proposed Graph Estimator, we
present a bespoke Transformer network tailored for tabular learning, called
T2G-Former, which processes tabular data by performing tabular feature
interaction guided by the relation graphs. A specific Cross-level Readout
collects salient features predicted by the layers in T2G-Former across
different levels, and attains global semantics for final prediction.
Comprehensive experiments show that our T2G-Former achieves superior
performance among DNNs and is competitive with non-deep Gradient Boosted
Decision Tree models.

本文提出了一种自动估计表格数据特征间关系的图估算器，根据所建立的关系图组织各独立特征并实现节点间的有序交互，进而进行表格学习。结合该方法，我们提出了一种基于 Transformer 网络的 T2G-Former，能够在不同层次上收集 T2G-Former 中的显著特征并加以综合，实现对表格数据进行有效处理和预测，进而取得了优异的表现。