We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the first kernel-based variable selection method applicable to large datasets. It sidesteps the typical poor scaling properties of kernel methods by mapping the inputs into a relatively low-dimensional space of random features. The algorithm discovers the variables relevant for the regression task together with learning the prediction model through learning the appropriate nonlinear random feature maps. We demonstrate the outstanding performance of our method on a set of large-scale synthetic and real datasets.

本文提出了一种新的非线性回归输入变量选择的方法，这种方法嵌入到一个可以模拟一般非线性函数的核回归机器中，而不是局限于加性模型。通过将输入映射到随机特征的相对低维空间中，绕过了核方法典型的低伸缩性属性。通过学习适当的非线性随机特征映射，该算法发现了与回归任务相关的变量，并学习了预测模型。我们在一组大规模合成和实际数据集上展示了我们的方法的出色性能。

基于核随机特征的大规模非线性变量选择