Decision and Reward in Intertemporal Choice: The Roles of Brain Development, Inter-individual Differences and Pharmacological Influences

Human decision making is closely related to reward processing because many decisions rely to a certain degree on the evaluation of different outcome values. Reward-based decisions can be health-related, for example if someone has to compare the outcome value of the instant reward of smoking a cigarette to that of the long term goal of keeping well and fit. Such comparisons do not only rely on the nominal value of the alternatives but also on devaluation of rewards over time. The value of being healthy at older age might outweigh the value of smoking a cigarette but since the payoff of the health-outcome will be delayed, humans tend to decrease the value of this option. Therefore in this example one might choose the immediate reward of smoking a cigarette. The proclivity to devaluate the value of rewards over time has been widely investigated with experimental intertemporal choice tasks, in which subjects have to choose between smaller sooner rewards and larger later rewards. A stronger individual devaluation proclivity (i.e. discounting rate) has been reported to be related to addiction. Research in neuroeconomics has suggested the competing neurobehavioural decision systems (CNDS) theory, proposing that an imbalance between an executive (cortical prefrontal brain areas) and an impulsive (i.e. subcortical areas, such as ventral striatum (VS), amygdala) system in the brain leads to steeper discounting and a higher risk for addiction. Additionally, temporal discounting has been proposed as a transdisease process, i.e., “a process that occurs across a range of disorders, making findings from one disorder relevant to other disorders” (Bickel, Jarmolowicz, Mueller, Koffarnus, & Gatchalian, 2012, Abstract). Thus, the CNDS theory and temporal discounting might also have implications for other health-related behaviour than substance use. So far many factors have been shown to be associated with higher discount rates: for instance, adolescent age, lower intelligence and nicotine dependence. Further, it has been shown that adolescents are at highest risk to start smoking. On the other hand a higher education level has been shown to be associated to lower rates of smoking. Thus, it seems likely that a higher discount rate might be one reason why adolescents experiment with smoking, why lower education is associated to nicotine addiction and why dependent smokers are not successful in smoking cessation. But relatively little is known about the neural processes behind these variables, which could be also seen as exemplary risk- and protective factors regarding addiction. The 3 studies of the thesis at hand were conducted to extend the knowledge about neural processes associated to age, intelligence and smoking in their relation to intertemporal choice. The task was chosen because of its relevance for addiction and a variety of health-related behaviour. The first study was conducted to explore the neural correlates of age related differences between adolescents at age 14 and young adults during intertemporal choices. Additionally, the roles of discounting and choice consistency were investigated. Although adoles-cents discounted delayed rewards more steeply than adults, neural processing of reward value did not differ between groups, when controlling reward values for the individual discount rates. However, a higher discount rate was related to a lower responsivity in the ventral striatum to delayed rewards, independent of age. Concerning decision making, adolescents exhib-ited a lower consistency of choices and less brain activity in a parietal network than adults (i.e. posterior and inferior parietal regions). Thus, reward value processing might be more sensitive to the discount rate than to chronological age. Lower consistency of intertemporal choices might indicate ongoing maturation of parietal brain areas from adolescence to young adulthood. The second study was conducted to reveal the associations between neural processes of decision making and intelligence in adolescents. The results of study 2 revealed networks in the adolescent brain where brain activity was related to crystallised intelligence as well as to intertemporal choice behaviour. Specifically, during decision processing higher crystallised intelligence as well as more consistent decisions were associated with higher brain activity in the posterior parietal cortex. Processing of delayed rewards was also related to crystallised intelligence, i.e. more intelligent adolescents showed higher brain activation in the anterior cingulate cortex (ACC) and the inferior frontal gyrus (IFG), which was in turn related to a lower discount rate. Additionally, associations between the parental education level and crys-tallised intelligence of the adolescent participants of the study and their discount rate were found, indicating that parental education as an environmental factor could be related to a low-er risk for addiction. This protective effect might be mediated by the offspring’s crystallised intelligence and discount rate which are both related to brain activity in parts of the same brain networks (i.e. the IFG). The third study was done to investigate neural processes of intertemporal decisions in smokers and non-smokers. To test whether the effects of smoking on the discount rate are due to chronic or acute nicotine intake, non-smokers were additionally assessed under acute nico-tine administration. Study 3 revealed that the effects of nicotine on intertemporal choice behaviour were related to chronic intake of nicotine in smokers rather than to acute nicotine ad-ministration in non-smokers. Regarding the neural processes, smokers compared to non-smokers showed lower brain activity in the posterior parietal cortex. Comparable but weaker effects were found under acute nicotine in non-smokers. Although acute nicotine administra-tion altered neural processes, behavioural changes might only occur after repeated nicotine intake. However, the study did not preclude that the differences are predrug characteristics. Altogether the studies revealed overlapping neural correlates of intertemporal choices which are related to the individual age, the discount rate, the choice consistency, the individual intelligence as well as acute and chronic nicotine intake. This might provide an integrative view on how inter-individual differences and behaviour during intertemporal choices are based on common neural correlates which in turn might have implications for the development and the maintenance of addiction. Specifically, hyposensitivity towards delayed rewards in the adolescent ventral striatum, which has also been found in smokers compared to non-smokers, is associated with higher discount rates and higher risk for smoking initiation. In contrast, higher activation in the IFG and the ACC in more intelligent individuals during reward value processing might enhance behavioural inhibition and control and, hence, might prevent nicotine addiction. In line with the CNDS theory responsivity in subcortical brain areas (i.e. impulsive system), such as the VS was related to the risk factor of adolescent age, whereas activity in cortical areas (IFG and ACC) was related to the protective factors of high-er crystallised intelligence. Since there was only one study beside the studies of the current thesis reporting results regarding consistency, one can only speculate about implications for health-related behaviour, such as addiction. Consistency might play a role, especially for cessation success. Thus, the findings that adolescents as well as less intelligent individuals were less consistent might point to a higher risk for maintenance of nicotine addiction. The higher brain activity in a fronto-parietal network, which has been shown in studies 1 and 2 in adults as well as in more intelligent adolescents, was related to higher consistency of choices in both studies. Thus, the finding might be a possible neural correlate for the association between the risk factor of ado-lescent age, the protective factor of higher crystallised intelligence, and more consistent deci-sion making. In conclusion the findings of the current thesis contribute to a better understanding of how inter-individual differences and environmental factors might be accompanied by neural processes which in turn might be related to individual development of addiction. Further the results might extend the CNDS theory regarding neural correlates of exemplary risk and pro-tective factors regarding adolescents’ health behaviour and smoking in adults