A reinforcement learning diffusion decision model for value-based decisions
JournalArticle (Originalarbeit in einer wissenschaftlichen Zeitschrift)
ID 4524102
Author(s) Fontanesi, L.; Gluth, S.; Spektor, M. S.; Rieskamp, J.
Author(s) at UniBasel Rieskamp, Jörg
Fontanesi, Laura
Gluth, Sebastian
Spektor, Mikhail
Year 2019
Title A reinforcement learning diffusion decision model for value-based decisions
Journal Psychonomic Bulletin & Review
Volume 26
Number 4
Pages / Article-Number 1099-1121
Keywords decision-making; computational modeling; bayesian inference and parameter estimation; response time models; choice; explain; brain; fmri

Psychological models of value-based decision-making describe how subjective values are formed and mapped to single choices. Recently, additional efforts have been made to describe the temporal dynamics of these processes by adopting sequential sampling models from the perceptual decision-making tradition, such as the diffusion decision model (DDM). These models, when applied to value-based decision-making, allow mapping of subjective values not only to choices but also to response times. However, very few attempts have been made to adapt these models to situations in which decisions are followed by rewards, thereby producing learning effects. In this study, we propose a new combined reinforcement learning diffusion decision model (RLDDM) and test it on a learning task in which pairs of options differ with respect to both value difference and overall value. We found that participants became more accurate and faster with learning, responded faster and more accurately when options had more dissimilar values, and decided faster when confronted with more attractive (i.e., overall more valuable) pairs of options. We demonstrate that the suggested RLDDM can accommodate these effects and does so better than previously proposed models. To gain a better understanding of the model dynamics, we also compare it to standard DDMs and reinforcement learning models. Our work is a step forward towards bridging the gap between two traditions of decision-making research.

ISSN/ISBN 1069-9384
Full Text on edoc
Digital Object Identifier DOI 10.3758/s13423-018-1554-2
PubMed ID http://www.ncbi.nlm.nih.gov/pubmed/WOS:000482783800003

MCSS v5.8 PRO. 0.446 sec, queries - 0.000 sec ©Universität Basel  |  Impressum   |