1. Aron, A. R., Dowson, J. H., Sahakian, B. J. & Robbins, T. W. Methylphenidate improves response inhibition in adults with attention-deficit/hyperactivity disorder. Biological Psychiatry 54, 1465–1468 (2003).
2. Clatworthy, P. L. et al. Dopamine Release in Dissociable Striatal Subregions Predicts the Different Effects of Oral Methylphenidate on Reversal Learning and Spatial Working Memory. Journal of Neuroscience 29, 4690–4696 (2009).
3. Dodds, C. M. et al. Methylphenidate Has Differential Effects on Blood Oxygenation Level-Dependent Signal Related to Cognitive Subprocesses of Reversal Learning. Journal of Neuroscience 28, 5976–5982 (2008).
4. Elliott, R. et al. Effects of methylphenidate on spatial working memory and planning in healthy young adults. Psychopharmacology 131, 196–206 (1997).
5. Fallon, S. J., van der Schaaf, M. E., ter Huurne, N. & Cools, R. The Neurocognitive Cost of Enhancing Cognition with Methylphenidate: Improved Distractor Resistance but Impaired Updating. Journal of Cognitive Neuroscience 29, 652–663 (2016).
6. Repantis, D., Schlattmann, P., Laisney, O. & Heuser, I. Modafinil and methylphenidate for neuroenhancement in healthy individuals: A systematic review. Pharmacological Research 62, 187–206 (2010).
7. Samanez-Larkin, G. R. et al. A Thalamocorticostriatal Dopamine Network for Psychostimulant-Enhanced Human Cognitive Flexibility. Biological Psychiatry 74, 99–105 (2013).
8. ter Huurne, N. et al. Methylphenidate alters selective attention by amplifying salience. Psychopharmacology 232, 4317–4323 (2015).
9. Westbrook, A. et al. Dopamine promotes cognitive effort by biasing the benefits versus costs of cognitive work. Science 367, 1362–1366 (2020).
10. Arnsten, A. F. T. & Pliszka, S. R. Catecholamine influences on prefrontal cortical function: Relevance to treatment of attention deficit/hyperactivity disorder and related disorders. Pharmacology Biochemistry and Behavior 99, 211–216 (2011).
11. Prince, J. Catecholamine Dysfunction in Attention-Deficit/Hyperactivity Disorder: An Update. Journal of Clinical Psychopharmacology 28, S39 (2008).
12. Arria, A. M. et al. Do college students improve their grades by using prescription stimulants nonmedically? Addictive Behaviors 65, 245–249 (2017).
13. Husain, M. & Mehta, M. A. Cognitive enhancement by drugs in health and disease. Trends in Cognitive Sciences 15, 28–36 (2011).
14. Maier, L. J., Ferris, J. A. & Winstock, A. R. Pharmacological cognitive enhancement among non-ADHD individualsA cross-sectional study in 15 countries. International Journal of Drug Policy 58, 104–112 (2018).
15. Smith, M. E. & Farah, M. J. Are Prescription Stimulants ‘Smart Pills’? Psychological bulletin 137, 717–741 (2011).
16. van der Schaaf, M. E., Fallon, S. J., ter Huurne, N., Buitelaar, J. & Cools, R. Working Memory Capacity Predicts Effects of Methylphenidate on Reversal Learning. Neuropsychopharmacology 38, 2011–2018 (2013).
17. Roberts, C. A., Jones, A., Sumnall, H., Gage, S. H. & Montgomery, C. How effective are pharmaceuticals for cognitive enhancement in healthy adults? A series of meta-analyses of cognitive performance during acute administration of modafinil, methylphenidate and D-amphetamine. European Neuropsychopharmacology (2020) doi:10.1016/j.euroneuro.2020.07.002.
18. Spencer, R. C., Devilbiss, D. M. & Berridge, C. W. The Cognition-Enhancing Effects of Psychostimulants Involve Direct Action in the Prefrontal Cortex. Biological Psychiatry 77, 940–950 (2015).
19. Volkow, N. D., Fowler, J. S., Wang, G., Ding, Y. & Gatley, S. J. Mechanism of action of methylphenidate: Insights from PET imaging studies. Journal of Attention Disorders 6 Suppl 1, S31–43 (2002).
20. Murray, L. K. & Kollins, S. H. Effects of Methylphenidate on Sensitivity to Reinforcement in Children Diagnosed with Attention Deficit Hyperactivity Disorder: An Application of the Matching Law. Journal of Applied Behavior Analysis 33, 573–591 (2000).
21. Volkow, N. D. et al. Methylphenidate-Elicited Dopamine Increases in Ventral Striatum Are Associated with Long-Term Symptom Improvement in Adults with Attention Deficit Hyperactivity Disorder. Journal of Neuroscience 32, 841–849 (2012).
22. Schenk, S. & Izenwasser, S. Pretreatment with methylphenidate sensitizes rats to the reinforcing effects of cocaine. Pharmacology Biochemistry and Behavior 72, 651–657 (2002).
23. Addicott, M. A. et al. Attention-deficit/hyperactivity disorder and the explore/exploit trade-off. Neuropsychopharmacology 46, 614–621 (2021).
24. Manza, P. et al. The effects of methylphenidate on cerebral responses to conflict anticipation and unsigned prediction error in a stop-signal task. Journal of Psychopharmacology 30, 283–293 (2016).
25. Sethi, A., Voon, V., Critchley, H. D., Cercignani, M. & Harrison, N. A. A neurocomputational account of reward and novelty processing and effects of psychostimulants in attention deficit hyperactivity disorder. Brain 141, 1545–1557 (2018).
26. Solanto, M. V. Neuropsychopharmacological mechanisms of stimulant drug action in attention-deficit hyperactivity disorder: A review and integration. Behavioural Brain Research 94, 127–152 (1998).
27. Clarke, H. F., Hill, G. J., Robbins, T. W. & Roberts, A. C. Dopamine, But Not Serotonin, Regulates Reversal Learning in the Marmoset Caudate Nucleus. Journal of Neuroscience 31, 4290–4297 (2011).
28. Goto, Y. & Grace, A. A. Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior. Nature Neuroscience 8, 805–812 (2005).
29. Taghzouti, K., Louilot, A., Herman, J. P., Le Moal, M. & Simon, H. Alternation behavior, spatial discrimination, and reversal disturbances following 6-hydroxydopamine lesions in the nucleus accumbens of the rat. Behavioral and Neural Biology 44, 354–363 (1985).
30. Cools, R., Barker, R. A., Sahakian, B. J. & Robbins, T. W. Enhanced or Impaired Cognitive Function in Parkinson’s Disease as a Function of Dopaminergic Medication and Task Demands. Cerebral Cortex 11, 1136–1143 (2001).
31. Cools, R., Lewis, S. J. G., Clark, L., Barker, R. A. & Robbins, T. W. L -DOPA Disrupts Activity in the Nucleus Accumbens during Reversal Learning in Parkinson’s Disease. Neuropsychopharmacology 32, 180–189 (2007).
32. den Ouden, H. E. M. et al. Dissociable Effects of Dopamine and Serotonin on Reversal Learning. Neuron 80, 1090–1100 (2013).
33. Parkinson, J. A., Olmstead, M. C., Burns, L. H., Robbins, T. W. & Everitt, B. J. Dissociation in Effects of Lesions of the Nucleus Accumbens Core and Shell on Appetitive Pavlovian Approach Behavior and the Potentiation of Conditioned Reinforcement and Locomotor Activity byd-Amphetamine. Journal of Neuroscience 19, 2401–2411 (1999).
34. Frank, M. J. & O’Reilly, R. C. A mechanistic account of striatal dopamine function in human cognition: Psychopharmacological studies with cabergoline and haloperidol. Behavioral Neuroscience 120, 497–517 (2006).
35. Chatham, C. H., Frank, M. J. & Badre, D. Corticostriatal Output Gating during Selection from Working Memory. Neuron 81, 930–942 (2014).
36. Bloemendaal, M. et al. Dopaminergic modulation of distracter-resistance and prefrontal delay period signal. Psychopharmacology 232, 1061–1070 (2015).
37. Schouwenburg, M. R. van, Ouden, H. E. M. den & Cools, R. The Human Basal Ganglia Modulate Frontal-Posterior Connectivity during Attention Shifting. Journal of Neuroscience 30, 9910–9918 (2010).
38. van Schouwenburg, M. R., den Ouden, H. E. M. & Cools, R. Selective Attentional Enhancement and Inhibition of Fronto-Posterior Connectivity by the Basal Ganglia During Attention Switching. Cerebral Cortex 25, 1527–1534 (2015).
39. Moghaddam, B. & Bunney, B. S. Acute Effects of Typical and Atypical Antipsychotic Drugs on the Release of Dopamine from Prefrontal Cortex, Nucleus Accumbens, and Striatum of the Rat: An In Vivo Microdialysis Study. Journal of Neurochemistry 54, 1755–1760 (1990).
40. Tanda, G. et al. A systematic microdialysis study of dopamine transmission in the accumbens shell/core and prefrontal cortex after acute antipsychotics. Psychopharmacology 232, 1427–1440 (2015).
41. Divac, I., Rosvold, H. E. & Szwarcbart, M. K. Behavioral effects of selective ablation of the caudate nucleus. Journal of Comparative and Physiological Psychology 63, 184–190 (1967).
42. Haber, S. N. & Knutson, B. The Reward Circuit: Linking Primate Anatomy and Human Imaging. Neuropsychopharmacology 35, 4–26 (2010).
43. Joel, D. & Weiner, I. The connections of the dopaminergic system with the striatum in rats and primates: An analysis with respect to the functional and compartmental organization of the striatum. Neuroscience 96, 451–474 (2000).
44. Cools, R. & D’Esposito, M. Inverted-UShaped Dopamine Actions on Human Working Memory and Cognitive Control. Biological Psychiatry 69, e113–e125 (2011).
45. Cools, R. et al. Striatal Dopamine Predicts Outcome-Specific Reversal Learning and Its Sensitivity to Dopaminergic Drug Administration. The Journal of Neuroscience 29, 1538–1543 (2009).
46. Hofmans, L. et al. Methylphenidate boosts choices of mental labor over leisure depending on striatal dopamine synthesis capacity. Neuropsychopharmacology 45, 2170–2179 (2020).
47. Cools, R., Altamirano, L. & D’Esposito, M. Reversal learning in Parkinson’s disease depends on medication status and outcome valence. Neuropsychologia 44, 1663–1673 (2006).
48. Schaaf, M. E. van der et al. Establishing the Dopamine Dependency of Human Striatal Signals During Reward and Punishment Reversal Learning. Cerebral Cortex 24, 633–642 (2014).
49. Allen, E. A., Erhardt, E. B. & Calhoun, V. D. Data Visualization in the Neurosciences: Overcoming the Curse of Dimensionality. Neuron 74, 603–608 (2012).
50. Zandbelt, B. Slice Display. figshare (2017) doi:10.6084/m9.figshare.4742866.
51. Sallet, J. et al. The Organization of Dorsal Frontal Cortex in Humans and Macaques. Journal of Neuroscience 33, 12255–12274 (2013).
52. Hall, H. et al. Visualization of the Dopamine Transporter in the Human Brain Postmortem with the New Selective Ligand [125I]PE2I. NeuroImage 9, 108–116 (1999).
53. Hall, H. et al. Distribution of D 1 - and D 2 -Dopamine Receptors, and Dopamine and Its Metabolites in the Human Brain. Neuropsychopharmacology 11, 245–256 (1994).
54. Jocham, G., Klein, T. A. & Ullsperger, M. Dopamine-Mediated Reinforcement Learning Signals in the Striatum and Ventromedial Prefrontal Cortex Underlie Value-Based Choices. Journal of Neuroscience 31, 1606–1613 (2011).
55. Jocham, G., Klein, T. A. & Ullsperger, M. Differential Modulation of Reinforcement Learning by D2 Dopamine and NMDA Glutamate Receptor Antagonism. Journal of Neuroscience 34, 13151–13162 (2014).
56. Kodama, T. et al. Oral Administration of Methylphenidate (Ritalin) Affects Dopamine Release Differentially Between the Prefrontal Cortex and Striatum: A Microdialysis Study in the Monkey. Journal of Neuroscience 37, 2387–2394 (2017).
57. Martinez, E. et al. Ventral striatum supports Methylphenidate therapeutic effects on impulsive choices expressed in temporal discounting task. Scientific Reports 10, 716 (2020).
58. Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M. & Berns, G. S. Human Striatal Response to Salient Nonrewarding Stimuli. Journal of Neuroscience 23, 8092–8097 (2003).
59. Bromberg-Martin, E. S., Matsumoto, M. & Hikosaka, O. Dopamine in Motivational Control: Rewarding, Aversive, and Alerting. Neuron 68, 815–834 (2010).
60. Matsumoto, M. & Hikosaka, O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837–841 (2009).
61. Arsenault, J. T., Nelissen, K., Jarraya, B. & Vanduffel, W. Dopaminergic Reward Signals Selectively Decrease fMRI Activity in Primate Visual Cortex. Neuron 77, 1174–1186 (2013).
62. Murris, S. R., Arsenault, J. T., Raman, R., Vogels, R. & Vanduffel, W. Electrical stimulation of the macaque ventral tegmental area drives category-selective learning without attention. Neuron 109, 1381–1395.e7 (2021).
63. Collins, A. G. E. & Frank, M. J. Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive. Psychological Review 121, 337–366 (2014).
64. Dunnett, S. B. & Iversen, S. D. Learning impairments following selective kainic acid-induced lesions within the neostriatum of rats. Behavioural Brain Research 2, 189–209 (1981).
65. Howard, J. D. et al. Targeted Stimulation of Human Orbitofrontal Networks Disrupts Outcome-Guided Behavior. Current Biology 30, 490–498.e4 (2020).
66. Radulescu, A., Niv, Y. & Ballard, I. Holistic Reinforcement Learning: The Role of Structure and Attention. Trends in Cognitive Sciences 23, 278–292 (2019).
67. Rudebeck, P. H. & Murray, E. A. The Orbitofrontal Oracle: Cortical Mechanisms for the Prediction and Evaluation of Specific Behavioral Outcomes. Neuron 84, 1143–1156 (2014).
68. Schuck, N. W., Wilson, R. & Niv, Y. Chapter 12 - A State Representation for Reinforcement Learning and Decision-Making in the Orbitofrontal Cortex. in Goal-Directed Decision Making (eds. Morris, R., Bornstein, A. & Shenhav, A.) 259–278 (Academic Press, 2018). doi:10.1016/B978-0-12-812098-9.00012-7.
69. Sharpe, M. J. et al. Dopamine transients are sufficient and necessary for acquisition of model-based associations. Nature Neuroscience 20, 735–742 (2017).
70. Takahashi, Y. K. et al. The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes. Neuron 62, 269–280 (2009).
71. Takahashi, Y. K. et al. Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nature Neuroscience 14, 1590–1597 (2011).
72. Wilson, R. C., Takahashi, Y. K., Schoenbaum, G. & Niv, Y. Orbitofrontal Cortex as a Cognitive Map of Task Space. Neuron 81, 267–279 (2014).
73. Brugger, S. P. et al. Heterogeneity of Striatal Dopamine Function in Schizophrenia: Meta-analysis of Variance. Biological Psychiatry 87, 215–224 (2020).
74. Demjaha, A., Murray, R. M., McGuire, P. K., Kapur, S. & Howes, O. D. Dopamine Synthesis Capacity in Patients With Treatment-Resistant Schizophrenia. American Journal of Psychiatry 169, 1203–1210 (2012).
75. Jauhar, S. et al. Determinants of treatment response in first-episode psychosis: An 18 F-DOPA PET study. Molecular Psychiatry 24, 1502–1512 (2019).
76. Barch, D. M. & Dowd, E. C. Goal Representations and Motivational Drive in Schizophrenia: The Role of PrefrontalStriatal Interactions. Schizophrenia Bulletin 36, 919–934 (2010).
77. Ludolph, A. G. et al. Dopaminergic dysfunction in attention deficit hyperactivity disorder (ADHD), differences between pharmacologically treated and never treated young adults: A 3,4-dihdroxy-6-[18F]Fluorophenyl-l-alanine PET study. NeuroImage 41, 718–727 (2008).
78. Kollins, S. H. Comparing the abuse potential of methylphenidate versus other stimulants: A review of available evidence and relevance to the ADHD patient. The Journal of Clinical Psychiatry 64 Suppl 11, 14–18 (2003).
79. Frank, M. J. Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism. Journal of Cognitive Neuroscience 17, 51–72 (2005).
80. Ito, H. et al. Relation between Presynaptic and Postsynaptic Dopaminergic Functions Measured by Positron Emission Tomography: Implication of Dopaminergic Tone. Journal of Neuroscience 31, 7886–7890 (2011).
81. Berry, A. S. et al. Dopamine Synthesis Capacity is Associated with D2/3 Receptor Binding but Not Dopamine Release. Neuropsychopharmacology npp2017180 (2017) doi:10.1038/npp.2017.180.
82. Grace, A. A. The tonic/phasic model of dopamine system regulation and its implications for understanding alcohol and psychostimulant craving. Addiction (Abingdon, England) 95 Suppl 2, S119–128 (2000).
83. Seeman, P. & Madras, B. Methylphenidate elevates resting dopamine which lowers the impulse-triggered release of dopamine: A hypothesis. Behavioural Brain Research 130, 79–83 (2002).
84. Fuller, J. A. et al. Role of homeostatic feedback mechanisms in modulating methylphenidate actions on phasic dopamine signaling in the striatum of awake behaving rats. Progress in Neurobiology 182, 101681 (2019).
85. Beeler, J. A., Daw, N. D., Frazier, C. R. M. & Zhuang, X. Tonic Dopamine Modulates Exploitation of Reward Learning. Frontiers in Behavioral Neuroscience 4, (2010).
86. Dejesus, O. T., Endres, C. J., Shelton, S. E., Nickles, R. J. & Holden, J. E. Noninvasive assessment of aromatic L-amino acid decarboxylase activity in aging rhesus monkey brain in vivo. Synapse 39, 58–63 (2001).
87. Berry, A. S. et al. Aging Affects Dopaminergic Neural Mechanisms of Cognitive Flexibility. Journal of Neuroscience 36, 12559–12569 (2016).
88. Kumakura, Y. et al. Age-dependent decline of steady state dopamine storage capacity of human brain: An FDOPA PET study. Neurobiology of Aging 31, 447–463 (2010).
89. Becker, G. et al. Comparative assessment of 6-[18F]Fluoro-L-m-tyrosine and 6-[18F]Fluoro-L-dopa to evaluate dopaminergic presynaptic integrity in a Parkinson’s disease rat model. Journal of Neurochemistry 141, 626–635 (2017).
90. Gallagher, C. L. et al. A within-subject comparison of 6-[18F]Fluoro-m-tyrosine and 6-[18F]Fluoro-L-dopa in Parkinson’s disease. Movement Disorders 26, 2032–2038 (2011).
91. Froböse, M. I. et al. Catecholaminergic modulation of the avoidance of cognitive control. Journal of Experimental Psychology. General 147, 1763–1781 (2018).
92. Swart, J. C. et al. Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)Action. eLife 6, e22169 (2017).