A feature selection algorithm should ideally satisfy four conditions:
reliably extract relevant features; be able to identify non-linear feature
interactions; scale linearly with the number of features and dimensions; allow
the incorporation of known sparsity structure. In this work we propose a novel
feature selection algorithm, Gradient Boosted Feature Selection (GBFS), which
satisfies all four of these requirements. The algorithm is flexible, scalable,
and surprisingly straight-forward to implement as it is based on a modification
of Gradient Boosted Trees. We evaluate GBFS on several real world data sets and
show that it matches or out-performs other state of the art feature selection
algorithms. Yet it scales to larger data set sizes and naturally allows for
domain-specific side information.

本研究提出了一种名为梯度提升特征选择 (GBFS) 的新型特征选择算法，该算法可可靠地提取相关特征，能够识别非线性特征相互作用，与特征和维度的数量线性缩放，并允许纳入已知的稀疏结构，并在多个真实世界的数据集上进行了评估，表现出强大的性能，比其他现有的特征选择算法具有更好的扩展性和适应性。