Answers are grounded in this paper and cite their sources.
Efficient second order algorithm for training feedforward neural networks is presented. The algorithm has a similar convergence rate as the Lavenberg-Marquardt (LM) method and it is less computationally intensive and requires less memory. This is especially important for large neural networks where the LM algorithm becomes impractical. Algorithm was verified with several examples.
No takes yet. Share an insight, caveat, or question.
Wilamowski et al. (2003) studied this question.