Tonic Dopamine Modulates Exploitation of Reward Learning

Beeler, Jeff A. and Daw, Nathaniel and Frazier, Cristianne R. M. and Zhuang, Xiaoxi (2010) Tonic Dopamine Modulates Exploitation of Reward Learning. Frontiers in Behavioral Neuroscience, 4. ISSN 1662-5153

[thumbnail of pubmed-zip/versions/2/package-entries/fnbeh-04-00170/fnbeh-04-00170.pdf] Text
pubmed-zip/versions/2/package-entries/fnbeh-04-00170/fnbeh-04-00170.pdf - Published Version

Download (3MB)

Abstract

The impact of dopamine on adaptive behavior in a naturalistic environment is largely unexamined. Experimental work suggests that phasic dopamine is central to reinforcement learning whereas tonic dopamine may modulate performance without altering learning per se; however, this idea has not been developed formally or integrated with computational models of dopamine function. We quantitatively evaluate the role of tonic dopamine in these functions by studying the behavior of hyperdopaminergic DAT knockdown mice in an instrumental task in a semi-naturalistic homecage environment. In this “closed economy” paradigm, subjects earn all of their food by pressing either of two levers, but the relative cost for food on each lever shifts frequently. Compared to wild-type mice, hyperdopaminergic mice allocate more lever presses on high-cost levers, thus working harder to earn a given amount of food and maintain their body weight. However, both groups show a similarly quick reaction to shifts in lever cost, suggesting that the hyperdominergic mice are not slower at detecting changes, as with a learning deficit. We fit the lever choice data using reinforcement learning models to assess the distinction between acquisition and expression the models formalize. In these analyses, hyperdopaminergic mice displayed normal learning from recent reward history but diminished capacity to exploit this learning: a reduced coupling between choice and reward history. These data suggest that dopamine modulates the degree to which prior learning biases action selection and consequently alters the expression of learned, motivated behavior.

Item Type: Article
Subjects: GO STM Archive > Biological Science
Depositing User: Unnamed user with email support@gostmarchive.com
Date Deposited: 22 Mar 2023 06:57
Last Modified: 29 Jul 2024 09:24
URI: http://journal.openarchivescholar.com/id/eprint/414

Actions (login required)

View Item
View Item