Abstract
In this paper, the model of classical conditioning introduced by Balkenius [1, 2, 3] is analyzed with varying sequential stimulus configurations. We show that the learning converges under arbitrary stable stimulus sequences and further investigate how the asymptotic CR amplitude depends on CS and US magnitude and timing.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Balkenius C. Natural intelligence in artificial creatures. PhD thesis, Lund University Cognitive Studies 37, 1995
Balkenius C. Generalization in instrumental learning. In Maes P, Mataric M, Meyer J.-A, Pollack J, Wilson S W. (eds) From Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior. MIT Press/Bradford Books, Cambridge, MA, 1996
Balkenius C. A neural network model of classical conditioning I: the dynamics of learning, Lund University Cognitive Studies 68, 1998
Hull C.L. The goal-gradient hypothesis and maze learning. Psychological Review 1932, 39, 1, 25–43
Watkins C J C H. Q-learning. Machine Learning 1992, 8, 279–292
Desmond J E. Temporally adaptive responses in neural models: the stimulus trace. In: Gabriel M, Moore J. (eds) Learning and computational neuroscience: foundations of adaptive networks. MIT Press, Cambridge, MA, 1990, pp 421–456
Grossberg S. The adaptive brain. North-Holland, Amsterdam, 1987
Gray J A. Elements of a two-process theory of learning. Academic Press, London, 1975
Balkenius C, Morén J. Computational models of classical conditioning: a comparative study. In: From animals to animats 5. MIT Press, Cambridge, MA, 1998
Klopf A H. A neuronal model of classical conditioning. Psychobiology 1988, 16, 2, 85–125
Sutton R S, Barto A G. Time-derivative models of Pavlovian reinforcement. In: Gabriel M, Moore J. (eds) Learning and computational neuroscience: foundations of adaptive networks. MIT Press, Cambridge, MA, 1990, pp. 497–538
Rescorla R A, Wagner A R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Black A H, Prokasy W F. (eds) Classical conditioning H: current research and theory. Appleton-Century-Crofts, New York, 1972, pp. 64–99
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag London
About this paper
Cite this paper
Balkenius, C., Morén, J. (1998). Dynamics of a Classical Conditioning Model. In: Niklasson, L., Bodén, M., Ziemke, T. (eds) ICANN 98. ICANN 1998. Perspectives in Neural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-1599-1_65
Download citation
DOI: https://doi.org/10.1007/978-1-4471-1599-1_65
Published:
Publisher Name: Springer, London
Print ISBN: 978-3-540-76263-8
Online ISBN: 978-1-4471-1599-1
eBook Packages: Springer Book Archive