This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Klopf, A. H. Articles by Morgan, J. S. Search for Related Content Social Bookmarking                         What's this?

A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning

Wright Laboratory

Scott E. Weaver

Wright Laboratory

James S. Morgan

Wright Laboratory

A computational model of nervous system function during classical and instrumental conditioning is proposed. The model assumes the form of a hierarchical network of control systems. Each control system is capable of learning and is referred to as an associative control process (ACP). Learning systems consisting of ACP networks, employing the drive-reinforcement learning mechanism (Klopf, 1988) and engaging in real-time, closed-loop, goal-seeking interactions with environments, are capable of being classically and instrumentally conditioned, as demonstrated by means of computer simulations. In multiple-T mazes, the systems learn to chain responses that avoid punishment and that lead eventually to reward. The temporal order in which the responses are learned and extinguished during instrumental conditioning is consistent with that observed in animal learning. Also consistent with animal learning experimental evidence, the ACP network model accounts for a wide range of classical conditioning phenomena. ACP networks, at their current stage of development, are intended to model sensorimotor, limbic, and hypothalamic nervous system function, suggesting a relationship between classical and instrumental conditioning that extends Mowrer's (1956, 1960a/1973) two-factor theory of learning. In conjunction with consideration of limbic system and hypothalamic function, the role of emotion in natural intelligence is modeled and discussed. ACP networks constitute solutions to temporal and structural credit assignment problems, suggesting a theoretical approach for the synthesis of machine intelligence.

Key Words: computational neuroethology • learning • control theory • networks

Adaptive Behavior, Vol. 1, No. 3, 263-319 (1993)
DOI: 10.1177/105971239300100302


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				J. D. Johnson, W. Li, J. Li, and A. H. Klopf A Computational Model of Learned Avoidance Behavior in a One-Way Avoidance Experiment Adaptive Behavior, June 1, 2001; 9(2): 91 - 104. [Abstract] [PDF]

				A. Mignault and A. A. J. Marley A Real-Time Neuronal Model of Classical Conditioning Adaptive Behavior, June 1, 1997; 6(1): 3 - 61. [Abstract] [PDF]