Title |
Expectancies in decision making, reinforcement learning, and ventral striatum
|
---|---|
Published in |
Frontiers in Neuroscience, January 2010
|
DOI | 10.3389/neuro.01.006.2010 |
Pubmed ID | |
Authors |
Matthijs A A Van Der Meer, A. David Redish |
Abstract |
Decisions can arise in different ways, such as from a gut feeling, doing what worked last time, or planful deliberation. Different decision-making systems are dissociable behaviorally, map onto distinct brain systems, and have different computational demands. For instance, "model-free" decision strategies use prediction errors to estimate scalar action values from previous experience, while "model-based" strategies leverage internal forward models to generate and evaluate potentially rich outcome expectancies. Animal learning studies indicate that expectancies may arise from different sources, including not only forward models but also Pavlovian associations, and the flexibility with which such representations impact behavior may depend on how they are generated. In the light of these considerations, we review the results of van der Meer and Redish (2009a), who found that ventral striatal neurons that respond to reward delivery can also be activated at other points, notably at a decision point where hippocampal forward representations were also observed. These data suggest the possibility that ventral striatal reward representations contribute to model-based expectancies used in deliberative decision making. |
X Demographics
As of 1 July 2024, you may notice a temporary increase in the numbers of X profiles with Unknown location. Click here to learn more.
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 1 | 100% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Scientists | 1 | 100% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 6 | 3% |
France | 5 | 2% |
United Kingdom | 3 | 1% |
Germany | 3 | 1% |
Japan | 3 | 1% |
Canada | 3 | 1% |
Portugal | 2 | <1% |
Australia | 1 | <1% |
Austria | 1 | <1% |
Other | 2 | <1% |
Unknown | 183 | 86% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Researcher | 53 | 25% |
Student > Ph. D. Student | 50 | 24% |
Professor > Associate Professor | 24 | 11% |
Student > Master | 18 | 8% |
Professor | 14 | 7% |
Other | 37 | 17% |
Unknown | 16 | 8% |
Readers by discipline | Count | As % |
---|---|---|
Psychology | 58 | 27% |
Agricultural and Biological Sciences | 57 | 27% |
Neuroscience | 27 | 13% |
Computer Science | 23 | 11% |
Medicine and Dentistry | 10 | 5% |
Other | 19 | 9% |
Unknown | 18 | 8% |