Ce papier décrit comment les objets mentaux conduisent à définir un coût d'organisation et de fonctionnement dans le réseau. L'équivalence Adaptation <=> Apprentissage est ainsi montrée.

Abstract

This paper presents the double loop feedback model, which is used for structure and data flow modelling through reinforcement learning in an artificial neural network. We first consider physiological arguments suggesting that loops and double loops are widely spread in the exchange flows of the central nervous system. We then demonstrate that the double loop pattern, named a mental object, works as a functional memory unit and we describe the main properties of a double loop resonator built with the classical Hebb's law learning principle in a feedforward basis. In this model, we show how some mental objects aggregate themselves in building blocks, then what are the properties of such blocks. We propose the mental objects block as the representing structure of a concept in a neural network. We show how the local application of Hebb's law at the cell level leads to the concept of functional organization cost at the network level (upward effect), which explains spontaneous reorganization of mental blocks (downward effect). In this model, the simple hebbian learning paradigm appears to have emergent effects in both upward and downward directions.

Keywords: Reinforcement learning, memory, double loop coupled resonator, functional organization cost.

To appear in VI-DYNN'98 proceedings, SPIE publications, Stockholm, 22-26 June 98.

Reprints sur demande à cl AT mire.net

See the paper (HTML) at VI-DYNN'98