This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (4) Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Iizuka, H. Articles by Di Paolo, E. A. Search for Related Content Social Bookmarking                         What's this?

Toward Spinozist Robotics: Exploring the Minimal Dynamics of Behavioral Preference

Centre for Computational Neuroscience and Robotics, Department of Informatics, University of Sussex Brighton, BN1 9QH, UK, Department of Media Architecture, Future University-Hakodate, 116-2 Kamedanakano-cho, Hakodate, Hokkaido, 041-8655, Japan, ezca{at}sacral.c.u-tokyo.ac.jp

Ezequiel A. Di Paolo

Centre for Computational Neuroscience and Robotics, Department of Informatics, University of Sussex Brighton, BN1 9QH, UK, ezequiel{at}sussex.ac.uk

A preference is not located anywhere in the agent's cognitive architecture, but it is rather a constraining of behavior which is in turn shaped by behavior. Based on this idea, a minimal model of behavioral preference is proposed. A simulated mobile agent is modeled with a plastic neurocontroller, which holds two separate high dimensional homeostatic boxes in the space of neural dynamics. An evolutionary algorithm is used for creating a link between the boxes and the performance of two different phototactic behaviors. After evolution, the agent's performance exhibits some important aspects of behavioral preferences such as durability and transitions. This article demonstrates (1) the logical consistency of the multi-causal view by producing a case study of its viability and providing insights into its dynamical basis and (2) how durability and transitions arise through the mutual constraining of internal and external dynamics in the flow of alternating high and low susceptibility to environmental variations. Implications for modeling autonomy are discussed.

Key Words: behavioral preference • homeostatic adaptation • dynamical systems approach to cognition • evolutionary robotics

References

• Ashby, W.R. (1960). Design for a brain: The origin of adaptive behaviour (2nd ed.). London: Chapman and Hall.
• Beer, R.D. (1990). Intelligence as adaptive behavior: An experiment in computational neuroscience. San Diego: Academic Press.
• Beer, R.D. (1996). Toward the evolution of dynamical neural networks for minimally cognitive behavior. In P. Maes, M. J. Mataric, J-A. Meyer, J. B. Pollack, & S. W. Wilson (Eds.), From Animals to Animats 4: Proceedings of the 4th International Conference on Simulation of Adaptive Behavior (pp. 421—429). Cambridge, MA: MIT Press.
• Beer, R.D. (1999). Arches and stones in cognitive architecture. Adaptive Behavior, 11, 299—305.[CrossRef]
• Beer, R. (2003). The dynamics of active categorical perception in an evolved model agent. Adaptive Behavior, 11, 209— 243.[Medline] [Order article via Infotrieve]
• Bennett, J. (1984). A study of Spinoza's Ethics. Indianapolis: Hackett Publishing.
• Bennett, J. (1992). Spinoza and teleology: A reply to Curley. In E. Curley & P. F. Morean (Eds.), Spinoza, issues and directions (pp. 53—57). Leiden: E. J. Brill.
• Bourgine, P., & Stewart, J. (2004). Autopoiesis and cognition. Artificial Life, 10, 327—346.
• Breazeal (Ferrell), C. (1998). A motivational system for regulating human-robot interaction. In Proceedings of AAAI-98, Madison, WI (pp. 54—61).
• Bryson, J. (2003). Action selection and individuation in agent based modelling. In D. L. Sallach & C. Macal (Eds.), The Proceedings of Agent 2003: Challenges of social simulation. Argonne: Argonne National Laboratory (pp. 317— 330).
• Clark, A. (1997). Being there. Cambridge, MA: MIT Press.
• Curley, E. (1990). On Bennett's Spinoza: The issue of teleology. In E. Curley & P. F. Morean (Eds.), Spinoza, issues and directions (pp. 39—52). Leiden: E. J. Brill.
• Di Paolo, E.A. (2000). Homeostatic adaptation to inversion in the visual field and other sensorimotor disruptions. In J. Meyer, A. Berthoz, D. Floreano, H. Roitblat, & S. Wilson (Eds.), From Animals to Animats VI: Proceedings of the 6th International Conference on Simulation of Adaptive Behavior (pp. 440—449). Cambridge, MA: MIT Press.
• Di Paolo, E.A. (2005). Autopoiesis, adaptivity, teleology, agency. Phenomenology and the Cognitive Sciences, 4, 429—452.
• Goldstein, K. (1934/1995). The organism. New York: Zone Books.
• Harvey, I., Di Paolo, E., Wood, R., Quinn, M., & Tuci, E.A. (2005). Evolutionary Robotics: A new scientific tool for studying cognition. Artificial Life, 11, 79—98.
• Humphrys, M. (1997). Action selection methods using reinforcement learning. Unpublished doctoral dissertation, University of Cambridge, UK.
• Ito, M., Noda, K., Hoshino, Y., & Tani, J. (2006). Dynamic and interactive generation of object handling behaviors by a small humanoid robot using a dynamic neural network model. Neural Networks, 19, 323—337.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
• Jonas, H. (1966). The phenomenon of life: Towards a philosophical biology. Evanston: Northwestern University Press.
• Juarrero, A. (1999). Dynamics in action: Intentional behavior as a complex system. Cambridge, MA: MIT Press.
• Kelso, J.A.S. (1995). Dynamic patterns: The self-organization of brain and behavior. Cambridge, MA: MIT Press.
• Matson, W. (1977). Death and destruction in Spinoza's ethics. Inquiry, 20, 403—417.[Web of Science]
• Maturana, H., & Varela, F. (1980). Autopoiesis and cognition: The realization of the living. Boston: Reidel.
• Merleau-Ponty, M. (1962). Phenomenology of perception (Colin Smith, Trans.). London: Routledge & Kegan Paul.
• Ogai, Y., & Ikegami, T. (forthcoming). Microslip as a simulated artificial mind.
• Phattanasri, P., Chiel, H., & Beer, R. (n.d.) The dynamics of associative learning in evolved model circuits. Submitted for publication.
• Piaget, J. (1954). The construction of reality in the child. New York: Basic Books.
• Stewart, J. (1992). Life=cognition: The epistemological and ontological significance of artificial life. In P. Bourgine & F. Varela (Eds.), Toward a practice of autonomous systems: Proceedings of the First European Conference on Artificial Life (pp. 475—483). Cambridge, MA: MIT Press.
• Thelen, E., Schoener, G., Scheier, C., & Smith, L. (2001). The dynamics of embodiment: A dynamic field theory of infant perseverative reaching. Behavioural and Brain Sciences, 24, 1—86.[Medline] [Order article via Infotrieve]
• Thelen, E., & Smith, L.B. (1994). A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press.
• Thompson, E., & Varela, F. (2001). Radical embodiment: Neural dynamics and conscious experience. Trends in Cognitive Science, 5, 418—425.[CrossRef]
• Varela, F., & Thompson, E. (2003). Neural synchrony and the unity of mind: A neurophenomenological perspective. In A. Cleeremans (Ed.), The unity of consciousness binding, integration, and dissociation (pp. 266—287). Oxford University Press.
• Velásquez, J. (1997). Modeling emotions and other motivations in synthetic agents. In Proceedings of AAAI-97. Menlo Park: AAAI Press, pp. 10—15.
• Weber, A., & Varela, F. (2002). Life after Kant: Natural purposes and the autopoietic foundations of biological individuality. Phenomenology and the Cognitive Sciences, 1, 97—125.
• Wheeler, M. (1997). Cognition's coming home: The reunion of life and mind. In P. Husbands & I. Harvey (Eds.), Proceedings of the Fourth European Conference on Artificial Life (pp. 10—19). Cambridge, MA: MIT Press.
• Williams, H. (2004). Homeostatic plasticity in recurrent neural networks. In S. Schaal, A. Ijspeert, A. Billard, S. Vijayakumar, & J. Meyer (Eds.), From Animals to Animats 8: Proceedings of the 8th International Conference on the Simulation of Adaptive Behavior (pp. 344—353). Cambridge MA: MIT Press.
• Wood, R., & Di Paolo, E. (2007). New models for old questions: Evolutionary robotics and the "A not B" error. In F. Almeida e Costa, L. M. Rocha, E. Costa (Eds.) Proceedings of the 9th European Conference on Artificial life. Berlin: Springer-Verlag, pp. 1141—1150.

Adaptive Behavior, Vol. 15, No. 4, 359-376 (2007)
DOI: 10.1177/1059712307084687


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				X. E. Barandiaran, E. Di Paolo, and M. Rohde Defining Agency: Individuality, Normativity, Asymmetry, and Spatio-temporality in Action Adaptive Behavior, October 1, 2009; 17(5): 367 - 386. [Abstract] [PDF]

				M. Maniadakis and J. Tani Acquiring Rules for Rules: Neuro-Dynamical Systems Account for Meta-Cognition Adaptive Behavior, February 1, 2009; 17(1): 58 - 80. [Abstract] [PDF]

This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (4) Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Iizuka, H. Articles by Di Paolo, E. A. Search for Related Content Social Bookmarking                         What's this?