Answers are grounded in this paper and cite their sources.
No-free-lunch theorems have shown that learning algorithms cannot be universally good. We show that no free funch exists for noise prediction as well. We show that when the noise is additive and the prior over target functions is uniform, a prior on the noise distribution cannot be updated, in the Bayesian sense, from any finite data set. We emphasize the importance of a prior over the target function in order to justify superior performance for learning systems.
No takes yet. Share an insight, caveat, or question.
Malik Magdon‐Ismail (2000) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: