Stochastic Dynamics of a Layered Neural Network; Exact Solution

We extend our previous solution of a network with deterministic parallel dynamics to stochastic dynamics. Stochasticity is controlled by a "temperature" variable. An exact solution for the dynamics of the network at any temperature is presented. A region of good recall is found, separated from a region of no recall by a first-order line terminating at a critical point. The exact time-evolution of mixtures of patterns is given as well.