Optimization via Intermittency with a Self-Organizing Neural Network.
In: Neural Computation, Jg. 17 (2005-11-01), Heft 11, S. 2454-2481
academicJournal
Zugriff:
One of the major obstacles in using neural networks to solve combinatorial optimization problems is the convergence toward one of the many local minima instead of the global minima. In this letter, we propose a technique that enables a self-organizing neural network to escape from local minima by virtue of the intermittency phenomenon. It gives rise to novel search dynamics that allow the system to visit multiple global minima as meta-stable states. Numerical experiments performed suggest that the phenomenon is a combined effect of Kohonen-type competitive learning and the iterated softmax function operating near bifurcation. The resultant intermittent search exhibits fractal characteristics when the optimization performance is at its peak in the form of 1/f signals in the time evolution of the cost, as well as power law distributions in the meta-stable solution states. The N-Queens problem is used as an example to illustrate the meta-stable convergence process that sequentially generates, in a single run, 92 solutions to the 8-Queens problem and 4024 solutions to the 17-Queens problem. [ABSTRACT FROM AUTHOR]
Copyright of Neural Computation is the property of MIT Press and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Titel: |
Optimization via Intermittency with a Self-Organizing Neural Network.
|
---|---|
Autor/in / Beteiligte Person: | Kwok, Terence ; Smith, Kate A. |
Zeitschrift: | Neural Computation, Jg. 17 (2005-11-01), Heft 11, S. 2454-2481 |
Veröffentlichung: | 2005 |
Medientyp: | academicJournal |
ISSN: | 0899-7667 (print) |
DOI: | 10.1162/0899766054796860 |
Schlagwort: |
|
Sonstiges: |
|