A new supervised learning algorithm for multilayered and interconnected neural networks

A new learning algorithm is presented for supervised learning of multilayered and interconnected neural networks without using a gradient method. First, fictitious teacher signals for the outputs of each hidden unit are algebraically determined by an error backpropagation (EBP) method. Then, the weight parameters are determined by using an exponentially weighted least squares (EWLS) method. This is called the EBP-EWLS algorithm for a multilayered neural network. For an interconnected neural network, the mathematical description of the neural network is arranged in the form for which the EBP-EWLS algorithm can be applied. Simulation studies have verified the proposed technique.