Answers are grounded in this paper and cite their sources.
This paper investigates the influence of noises added to hidden units of multilayer perceptrons. It is shown that a skeletal structure of the network emerges when independent Gaussian noises are added to inputs of hidden units during the error back‐propagation learning. By analyzing the average behavior of the backp‐ropagation learning to such noises, it is shown that the weights from hidden units to output units tend to be small and outputs of hidden units tend to be 0 or 1. This means that the network is automatically structurized by adding the noises. As the result, it is expected that the generalization ability of the network is improved. This network structurization was confirmed by experiments of pattern classification and logic Boolean function learning.
No takes yet. Share an insight, caveat, or question.
Kurita et al. (1996) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: