Answers are grounded in this paper and cite their sources.
Considerable research into the training of neural networks by the backpropagation technique has been undertaken in recent years. Introduction of a momentum term into the training equation can accelerate the training process. In the Letter a new momentum step and a scheme for dynamically selecting the momentum rate are described. It is shown that these give improved acceleration of training and strong global convergence characteristics. Results are presented for four benchmark training tasks.
No takes yet. Share an insight, caveat, or question.
Qiu et al. (1992) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: