This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Schmajuk, N. A. Articles by Zanutto, B. S. Search for Related Content Social Bookmarking                         What's this?

Escape, Avoidance, and Imitation: A Neural Network Approach

Duke University

B. Silvano Zanutto

Duke University, Universidad de Buenos Aires

We present a real-time neural network that integrates classical and operant processes to describe how animals learn to escape and avoid an aversive stimulus either by trial and error or by imitation. It is assumed that through classical conditioning animals build an internal model of the environment and that through operant conditioning animals select from alternative responses. The internal model of the environment provides predictions of the aversive stimulus based on environmental stimuli and the animal's own responses, and these predictions are used to train the operant conditioning block to generate responses that minimize the aversive stimulus. Computer simulations show that the model correctly describes many of the features that characterize escape and avoidance.

The network also is able to describe the imitation of a demonstrator by an observer. During the demonstration, a neural network representing the observer stores classical associations between environmental stimuli and the demonstrator's responses and aversive stimuli, and these associations serve to train the operant associations during the observer's performance. It is assumed that the demonstrator's responses evoke a representation of identical responses in the observer and that the demonstrator's unconditioned response to the aversive stimulus serves as an aversive reinforcer for the observer.

The network contributes to a general theory of adaptive behavior and is relevant to the design of autonomous systems that learn either through trial and error or through imitation.

Key Words: escape • avoidance • learned helplessness • two-factor theory • neural network • classical conditioning • operant conditioning • imitation

Adaptive Behavior, Vol. 6, No. 1, 63-129 (1997)
DOI: 10.1177/105971239700600103


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				J. D. Johnson, W. Li, J. Li, and A. H. Klopf A Computational Model of Learned Avoidance Behavior in a One-Way Avoidance Experiment Adaptive Behavior, June 1, 2001; 9(2): 91 - 104. [Abstract] [PDF]