BriefGPT.xyz
Apr, 2023
无免费午餐定理,科尔莫戈洛夫复杂度,以及归纳偏见在机器学习中的作用
The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning
HTML
PDF
Micah Goldblum, Marc Finzi, Keefer Rowan, Andrew Gordon Wilson
TL;DR
本文研究了在监督学习中“没有免费午餐定理”的适用性,进一步证明了神经网络在数据压缩和处理上也有低复杂性的偏好,从而证明了深度学习中统一问题的趋势。
Abstract
No
free lunch theorems
for
supervised learning
state that no learner can solve all problems or that all learners achieve exactly the same accuracy on average over a uniform distribution on learning problems. Acco
→