Title: An improved backpropagation algorithm to avoid the local minima problem
Abstract: We propose an improved backpropagation algorithm intended to avoid the local minima problem caused by neuron saturation in the hidden layer. Each training pattern has its own activation functions of neurons in the hidden layer. When the network outputs have not got their desired signals, the activation functions are adapted so as to prevent neurons in the hidden layer from saturating. Simulations on some benchmark problems have been performed to demonstrate the validity of the proposed method.
Publication Year: 2004
Publication Date: 2004-01-01
Language: en
Type: article
Indexed In: ['crossref']
Access and Citation
Cited By Count: 117
AI Researcher Chatbot
Get quick answers to your questions about the article from our AI researcher chatbot