Psychological and Neuroscientific Connections with Reinforcement Learning (preprint)

The field of Reinforcement Learning (RL) was inspired in large part by research in animal behavior and psychology. Early research showed that animals can, through trial and error, learn to execute behavior that would eventually lead to some (presumably satisfactory) outcome, and decades of subsequent research was (and is still) aimed at dis-covering the mechanisms of this learning process. This chapter describes behavioral and theoretical research in animal learning that is directly related to fundamental concepts used in RL. It then describes neuroscientific research that suggests that animals and many RL algorithms use very similar learning mechanisms. Along the way, I highlight ways that research in computer science contributes to and can be inspired by research in psychology and neuroscience. Please note: This is a preprint of a chapter for the book Reinforcement Learning: State of the Art, edited by Marco Wiering and Martijn van Otterlo. This document does not follow the format used in the book, but the text should be pretty much the same. If you cite this chapter, below is a bibtex you can use. Thanks