Title |
What to Choose Next? A Paradigm for Testing Human Sequential Decision Making
|
---|---|
Published in |
Frontiers in Psychology, March 2017
|
DOI | 10.3389/fpsyg.2017.00312 |
Pubmed ID | |
Authors |
Elisa M. Tartaglia, Aaron M. Clarke, Michael H. Herzog |
Abstract |
Many of the decisions we make in our everyday lives are sequential and entail sparse rewards. While sequential decision-making has been extensively investigated in theory (e.g., by reinforcement learning models) there is no systematic experimental paradigm to test it. Here, we developed such a paradigm and investigated key components of reinforcement learning models: the eligibility trace (i.e., the memory trace of previous decision steps), the external reward, and the ability to exploit the statistics of the environment's structure (model-free vs. model-based mechanisms). We show that the eligibility trace decays not with sheer time, but rather with the number of discrete decision steps made by the participants. We further show that, unexpectedly, neither monetary rewards nor the environment's spatial regularity significantly modulate behavioral performance. Finally, we found that model-free learning algorithms describe human performance better than model-based algorithms. |
X Demographics
As of 1 July 2024, you may notice a temporary increase in the numbers of X profiles with Unknown location. Click here to learn more.
Geographical breakdown
Country | Count | As % |
---|---|---|
Unknown | 1 | 100% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 1 | 100% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
Unknown | 47 | 100% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 9 | 19% |
Student > Master | 8 | 17% |
Researcher | 7 | 15% |
Professor | 3 | 6% |
Student > Bachelor | 2 | 4% |
Other | 9 | 19% |
Unknown | 9 | 19% |
Readers by discipline | Count | As % |
---|---|---|
Psychology | 16 | 34% |
Neuroscience | 9 | 19% |
Agricultural and Biological Sciences | 4 | 9% |
Computer Science | 2 | 4% |
Economics, Econometrics and Finance | 1 | 2% |
Other | 2 | 4% |
Unknown | 13 | 28% |