International Journal of Computational Intelligence Research
  • Year: 2006
  • Volume: 2
  • Issue: 1

Unsupervised Topology Preserving Networks that Learns Sequentially

  • Author:
  • George Palamas1, George Papadourakis1, Manolis Kavoussanos2, Andrew Ware3
  • Total Page Count: 6
  • Page Number: 121 to 126

1Technological Educational Institute of Crete, Department of Applied Informatics and Multimedia, Greece

2Technological Educational Institute of Crete, Department of Mechanical Engineering, Greece

3University of Glamorgan, school of Computing, United Kingdom

Abstract

In most artificial neural networks, learning capabilities suffer from sudden and total forgetting of all previous learned information when newly arrived information is requested for learning. The particularity that gives to these networks the ability to generalize causes also a phenomenon known as catastrophic forgetting. In this article we examine a biological plausible solution to prevent this undesirable effect while retaining an abstract of past knowledge which attenuates with time. The following mechanism derived from a connectionist model, recently proposed, is known as the reverberating self-refreshing mechanism. That mechanism appears capable of overcoming the so called plasticity — elasticity dilema.

Keywords

pseudorehearsal, GNG, SOM, catastrophic forgetting