Statistical mechanics is applied to estimate the maximal capacity per weight (αc) of a two-layer feed-forward network with binary weights, functioning as a parity machine of the hidden units. For K ⩾ 2 hidden units, the maximal theoretical capacity is achieved, αc = 1, and the average overlap between different solutions is zero. These results agree with the simulations. At finite temperature one-step replica symmetry breaking solution is found, which appears to be exact.
No takes yet. Share an insight, caveat, or question.
Barkai et al. (1991) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: