Location of Repository

Evolving a Dynamic Predictive Coding Mechanism for Novelty Detection

By Simon J. Haggett, Dominique Chu and Ian W. Marshall

Abstract

Novelty detection is a machine learning technique which identifies new or unknown information in data sets. We present three evolutionary algorithms, a simple genetic algorithm, NEAT and FS-NEAT, for the the task of optimising the structure of an illustrative dynamic predictive coding neural network to improve its performance over stimuli from a number of artificially generated visual environments. We find that NEAT performs more reliably than the other two algorithms in this task and evolves the network with the highest fitness. However, both NEAT and FS-NEAT fail to evolve a network with a significantly higher fitness than the best network evolved by the simple genetic algorithm. The best network evolved demonstrates a more consistent performance over a broader range of inputs than the original network. We also examine the robustness of this network to noise and find that it handles low levels reasonably well, but is outperformed by the illustrative network when the level of noise is increased

Topics: QA76
Year: 2008
OAI identifier: oai:kar.kent.ac.uk:23970

Suggested articles

Preview

Citations

  1. (2002). A self-organising network that grows when required, doi
  2. (1999). An Introduction to Genetic Algorithms, doi
  3. (2005). Automatic feature selection in neuroevolution, in: doi
  4. (2000). Detecting novel features of an environment using habiutation, in:
  5. (2005). Dynamic predictive coding by the retina, doi
  6. (2004). Efficient evolution of neural networks through complexification,
  7. (1999). Image compression with neural networks – a survey, doi
  8. Image compression with neural networks – a survey, Signal doi
  9. (2003). Novelty detection: a review part 1: statistical approaches, doi
  10. (2003). Novelty detection: a review part 2: neural network based approaches, doi
  11. (2005). On-line novelty detection for autonomous mobile robots, doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.