Exploration Versus Exploitation Decisions in the Human Brain: A Systematic Review of Functional Neuroimaging and Neuropsychological Studies

dc.contributor.advisorTurner, Gary
dc.contributor.authorWyatt, Lindsay Erin
dc.date.accessioned2023-08-04T15:16:25Z
dc.date.available2023-08-04T15:16:25Z
dc.date.issued2023-08-04
dc.date.updated2023-08-04T15:16:25Z
dc.degree.disciplinePsychology (Functional Area: Clinical Psychology)
dc.degree.levelMaster's
dc.degree.nameMA - Master of Arts
dc.description.abstractThoughts and actions are often driven by a decision to either explore new avenues with unknown outcomes, or to exploit known options with predictable outcomes. Yet, the neural mechanisms underlying this exploration-exploitation trade-off in humans remain poorly understood. This is attributable to variability in the operationalization of exploration and exploitation as psychological constructs, the heterogeneity of experimental protocols and paradigms used to study these choice behaviours, as well as the predominance of reinforcement learning studies to study the neurocomputational basis of choice behaviours. We conducted a systematic review of functional neuroimaging (fMRI) studies of exploration- versus exploitation- based decision-making in healthy adult humans during reinforcement learning, information search, and foraging. Eleven fMRI studies met inclusion criterion. Adopting a network neuroscience framework, synthesis of the findings across these studies revealed that exploration-based choice was associated with the engagement of attentional, control, and salience networks. In contrast, exploitation-based choice was associated with engagement of default network brain regions. We interpret these results in the context of a network architecture that supports the flexible switching between externally and internally directed cognitive processes, necessary for adaptive, goal-directed behaviour. Building from these findings in typical adult development, we next surveyed exploration-exploitation behaviours in neurodevelopmental, neuropsychological, and neuropsychiatric disorders, as well as lifespan development, and neurodegenerative disease. Findings revealed differing exploration and exploitation decision-making biases across populations. Taken together, our review highlights the need for precision-mapping of the neural circuitry and behavioural correlates associated with exploitation and exploration in humans. Characterizing exploration versus exploitation decision-making biases may offer a novel, trans-diagnostic approach to assessment, surveillance, and intervention for cognitive decline and dysfunction in normal development and clinical populations.
dc.identifier.urihttps://hdl.handle.net/10315/41363
dc.languageen
dc.rightsAuthor owns copyright, except where explicitly noted. Please contact the author directly with licensing requests.
dc.subjectClinical psychology
dc.subjectNeurosciences
dc.subject.keywordsDecision-making
dc.subject.keywordsReinforcement learning
dc.subject.keywordsForaging
dc.subject.keywordsInformation search
dc.subject.keywordsfMRI
dc.subject.keywordsAttention network
dc.subject.keywordsDefault network
dc.titleExploration Versus Exploitation Decisions in the Human Brain: A Systematic Review of Functional Neuroimaging and Neuropsychological Studies
dc.typeElectronic Thesis or Dissertation

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Wyatt_Lindsay_E_2023_Masters.pdf
Size:
1.48 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
license.txt
Size:
1.87 KB
Format:
Plain Text
Description:
No Thumbnail Available
Name:
YorkU_ETDlicense.txt
Size:
3.39 KB
Format:
Plain Text
Description: