Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making.

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Research Abstract Details 

Research Abstract Table of Contents

Jump to the:

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Abstract Text:

Tom ,Nathaniel D Daw,Daphna Joel,John P O'Doherty,Tom ,Nathaniel D Daw,Daphna Joel,John P O'Doherty,

The computational framework of reinforcement learning has been used to forward our understanding of the neural mechanisms underlying reward learning and decision-making behavior. It is known that humans vary widely in their performance in decision-making tasks. Here, we used a simple four-armed bandit task in which subjects are almost evenly split into two groups on the basis of their performance: those who do learn to favor choice of the optimal action and those who do not. Using models of reinforcement learning we sought to determine the neural basis of these intrinsic differences in performance by scanning both groups with functional magnetic resonance imaging. We scanned 29 subjects while they performed the reward-based decision-making task. Our results suggest that these two groups differ markedly in the degree to which reinforcement learning signals in the striatum are engaged during task performance. While the learners showed robust prediction error signals in both the ventral and dorsal striatum during learning, the nonlearner group showed a marked absence of such signals. Moreover, the magnitude of prediction error signals in a region of dorsal striatum correlated significantly with a measure of behavioral performance across all subjects. These findings support a crucial role of prediction error signals, likely originating from dopaminergic midbrain neurons, in enabling learning of action selection preferences on the basis of obtained rewards. Thus, spontaneously observed individual differences in decision making performance demonstrate the suggested dependence of this type of learning on the functional integrity of the dopaminergic striatal system in humans.

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Publishing Authors By Initials

T ,ND Daw,D Joel,JP O'Doherty,T ,ND Daw,D Joel,JP O'Doherty,

For similar abstracts research abstracts see: abstracts research

PUBMED ID PMID:

MEDLINE DATE:

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Journal Published:

PUBLICATION TYPE: Research Support, U.S. Gov't,

Journal: The Journal of neuroscience : the official journal

VOLUME: 27

Page Numbers: 12860-7

Journal Abbreviation: J. Neurosci.

ISSN: 1529-2401

DAY: 21

MONTH: Nov

YEAR: 2007

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Information

Number of References:

LANGUAGE: eng

NlmUniqueID: 8102140

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Keywords Mesh Terms:

KEYWORDS:

MESH TERMS:

Chemical & Substance for Abstract: Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Information

Substance Name:

Registry Number:

Grant and Affiliation Information for Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making.

AFFILIATION: Department of Psychology, Tel Aviv University, Tel Aviv 69978, Israel. tom@post.tau.ac.il

Country: United States

AGENCY:

GRANT:

ACRONYM:

MEDLINETA: J Neurosci

REFSOURCE:

DATABASENAME:

ACCESSION NUMBER:

Number Hits: 0

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making Related Publications

• A moderate increase in carnitine palmitoyltransferase 1a activity is sufficient to substantially reduce hepatic triglyceride levels.
• A new hearing test applicable to the crying newborn infant.
• A palladium-catalyzed glycosylation reaction: the de novo synthesis of natural and unnatural glycosides.
• A stereoselective synthesis of digitoxin and digitoxigen mono- and bisdigitoxoside from digitoxigenin via a palladium-catalyzed glycosylation.
• Addition of deoxynucleosides enhances human immunodeficiency virus type 1 integration and 2LTR formation in resting CD4+ T cells.
• Anterior tibial artery pseudoaneurysm in a patient with hemophilia: a complication of ankle arthroscopy.
• De Novo Asymmetric Synthesis of 8a-epi-Swainsonine.
• De novo approach to 2-deoxy-beta-glycosides: asymmetric syntheses of digoxose and digitoxin.
• De novo asymmetric syntheses of SL0101 and its analogues via a palladium-catalyzed glycosylation.
• De novo asymmetric syntheses of muricatacin and its analogues via dihydroxylation of dienoates.
• De novo asymmetric synthesis of milbemycin beta3 via an iterative asymmetric hydration approach.
• De novo asymmetric synthesis of the anthrax tetrasaccharide by a palladium-catalyzed glycosylation reaction.
• De novo formal synthesis of (-)-apicularen A via an iterative asymmetric hydration sequence.
• De novo formal synthesis of (-)-virginiamycin M2 via the asymmetric hydration of dienoates.
• De novo synthesis of 2-substituted syn-1,3-diols via an iterative asymmetric hydration strategy.
• De novo synthesis of oligosaccharides using a palladium-catalyzed glycosylation reaction.
• Determining the neural substrates of goal-directed learning in the human brain.
• Glucuronidase and lipids in wallerian degeneration.
• HIV-1 integrates into resting CD4+ T cells even at low inoculums as demonstrated with an improved assay for HIV-1 integration.
• Imaging neuroendocrine tumours with radionuclide techniques.
• Inhibition or deletion of the lipopolysaccharide receptor Toll-like receptor-4 confers partial protection against lipid-induced insulin resistance in rodent skeletal muscle.
• Lights, camembert, action! The role of human orbitofrontal cortex in encoding stimuli, rewards, and choices.
• Positron emission tomography and the orthopaedic surgeon.
• Preparation and stability of a radioiodinated pentamidine isethionate analog.
• Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making.
• Synthesis of aza-analogues of the glycosylated tyrosine portion of mannopeptimycin-E.
• The de novo synthesis of oligosaccharides: application to the medicinal chemistry SAR-study of digitoxin.
• The influence of manure composition on emissions of odour and ammonia from finishing pigs fed different concentrations of dietary crude protein.
• [18F]2-fluoro-2-deoxy-D-glucose positron emission tomography (FDG PET) as a diagnostic tool for neurofibromatosis 1 (NF1) associated malignant peripheral nerve sheath tumours (MPNSTs): a long-term clinical study.
• [Sinterloy technic. Ceramic framework of metallic powder]