The rise of deep neural networks offers new opportunities in optimizing
recommender systems. However, optimizing recommender systems using deep neural
networks requires delicate architecture fabrication. We propose NASRec, a
paradigm that trains a single supernet and efficiently produces abundant
models/sub-architectures by weight sharing. To overcome the data multi-modality
and architecture heterogeneity challenges in the recommendation domain, NASRec
establishes a large supernet (i.e., search space) to search the full
architectures. The supernet incorporates versatile choice of operators and
dense connectivity to minimize human efforts for finding priors. The scale and
heterogeneity in NASRec impose several challenges, such as training
inefficiency, operator-imbalance, and degraded rank correlation. We tackle
these challenges by proposing single-operator any-connection sampling,
operator-balancing interaction modules, and post-training fine-tuning. Our
crafted models, NASRecNet, show promising results on three Click-Through Rates
(CTR) prediction benchmarks, indicating that NASRec outperforms both manually
designed models and existing NAS methods with state-of-the-art performance. Our
work is publicly available at this https URL

NASRec 是一种用于优化推荐系统的模型，其使用了深度神经网络，通过单一的 supernet，通过权重共享实现了丰富的模型 / 子架构，克服了数据多模性和架构异质性挑战，并在三个 CTR 预测基准测试中取得了有希望的结果。