<html lang="en"> <head> <title>Valence biases in reinforcement learning shift across adolescence and modulate subsequent memory</title> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <meta http-equiv="X-UA-Compatible" content="ie=edge"> <link href="https://unpkg.com/@stencila/thema@2/dist/themes/elife/styles.css" rel="stylesheet"> <script src="https://unpkg.com/@stencila/thema@2/dist/themes/elife/index.js" type="text/javascript"></script> <script src="https://unpkg.com/@stencila/components@<=1/dist/stencila-components/stencila-components.esm.js" type="module"></script> <script src="https://unpkg.com/@stencila/components@<=1/dist/stencila-components/stencila-components.js" type="text/javascript" nomodule=""></script> </head> <body> <main role="main"> <article itemscope="" itemtype="http://schema.org/Article" data-itemscope="root"> <h1 itemprop="headline">Valence biases in reinforcement learning shift across adolescence and modulate subsequent memory</h1> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Valence%20biases%20in%20reinforcement%20learning%20shift%20across%20adolescence%20and%20modulate%20subsequent%20memory"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Gail M Rosenbaum"><span data-itemprop="givenNames"><span itemprop="givenName">Gail</span><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rosenbaum</span></span><span data-itemprop="affiliations"><a itemprop="affiliation" href="#author-organization-1">1</a></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Hannah L Grassie"><span data-itemprop="givenNames"><span itemprop="givenName">Hannah</span><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Grassie</span></span><span data-itemprop="affiliations"><a itemprop="affiliation" href="#author-organization-1">1</a></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Catherine A Hartley"><span data-itemprop="givenNames"><span itemprop="givenName">Catherine</span><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hartley</span></span><span data-itemprop="emails"><a itemprop="email" href="mailto:cah369@nyu.edu">cah369@nyu.edu</a></span><span data-itemprop="affiliations"><a itemprop="affiliation" href="#author-organization-1">1</a><a itemprop="affiliation" href="#author-organization-2">2</a></span> </li> </ol> <ol data-itemprop="affiliations"> <li itemscope="" itemtype="http://schema.org/Organization" itemid="#author-organization-1" id="author-organization-1"><span itemprop="name">Department of Psychology, New York University</span><address itemscope="" itemtype="http://schema.org/PostalAddress" itemprop="address"><span itemprop="addressLocality">New York</span><span itemprop="addressCountry">United States</span></address></li> <li itemscope="" itemtype="http://schema.org/Organization" itemid="#author-organization-2" id="author-organization-2"><span itemprop="name">Center for Neural Science, New York University</span><address itemscope="" itemtype="http://schema.org/PostalAddress" itemprop="address"><span itemprop="addressLocality">New York</span><span itemprop="addressCountry">United States</span></address></li> </ol><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span><time itemprop="datePublished" datetime="2022-01-24">2022-01-24</time> <ul data-itemprop="genre"> <li itemprop="genre">Research Article</li> </ul> <ul data-itemprop="about"> <li itemscope="" itemtype="http://schema.org/DefinedTerm" itemprop="about"><span itemprop="name">Neuroscience</span></li> </ul> <ul data-itemprop="keywords"> <li itemprop="keywords">valence asymmetries</li> <li itemprop="keywords">reinforcement learning</li> <li itemprop="keywords">memory</li> <li itemprop="keywords">adolescence</li> <li itemprop="keywords">decision making</li> <li itemprop="keywords">individual diferences</li> <li itemprop="keywords">Human</li> </ul> <ul data-itemprop="identifiers"> <li itemscope="" itemtype="http://schema.org/PropertyValue" itemprop="identifier"> <meta itemprop="propertyID" content="https://registry.identifiers.org/registry/publisher-id"><span itemprop="name">publisher-id</span><span itemprop="value" data-itemtype="http://schema.org/Number">64620</span> </li> <li itemscope="" itemtype="http://schema.org/PropertyValue" itemprop="identifier"> <meta itemprop="propertyID" content="https://registry.identifiers.org/registry/doi"> <span itemprop="name">doi</span><span itemprop="value">10.7554/eLife.64620</span> </li> <li itemscope="" itemtype="http://schema.org/PropertyValue" itemprop="identifier"> <meta itemprop="propertyID" content="https://registry.identifiers.org/registry/elocation-id"><span itemprop="name">elocation-id</span><span itemprop="value">e64620</span> </li> </ul> <section data-itemprop="description"> <h2 data-itemtype="http://schema.stenci.la/Heading">Abstract</h2> <meta itemprop="description" content="As individuals learn through trial and error, some are more influenced by good outcomes, while others weight bad outcomes more heavily. Such valence biases may also influence memory for past experiences. Here, we examined whether valence asymmetries in reinforcement learning change across adolescence, and whether individual learning asymmetries bias the content of subsequent memory. Participants ages 8–27 learned the values of ‘point machines,’ after which their memory for trial-unique images presented with choice outcomes was assessed. Relative to children and adults, adolescents overweighted worse-than-expected outcomes during learning. Individuals’ valence biases modulated incidental memory, such that those who prioritized worse- (or better-) than-expected outcomes during learning were also more likely to remember images paired with these outcomes, an effect reproduced in an independent dataset. Collectively, these results highlight age-related changes in the computation of subjective value and demonstrate that a valence-asymmetric valuation process influences how information is prioritized in episodic memory."> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">As individuals learn through trial and error, some are more influenced by good outcomes, while others weight bad outcomes more heavily. Such valence biases may also influence memory for past experiences. Here, we examined whether valence asymmetries in reinforcement learning change across adolescence, and whether individual learning asymmetries bias the content of subsequent memory. Participants ages 8–27 learned the values of ‘point machines,’ after which their memory for trial-unique images presented with choice outcomes was assessed. Relative to children and adults, adolescents overweighted worse-than-expected outcomes during learning. Individuals’ valence biases modulated incidental memory, such that those who prioritized worse- (or better-) than-expected outcomes during learning were also more likely to remember images paired with these outcomes, an effect reproduced in an independent dataset. Collectively, these results highlight age-related changes in the computation of subjective value and demonstrate that a valence-asymmetric valuation process influences how information is prioritized in episodic memory.</p> </section> <h2 itemscope="" itemtype="http://schema.stenci.la/Heading" id="introduction">Introduction </h2> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Throughout our lives, we encounter many new or uncertain situations in which we must learn, through trial and error, which actions are beneficial and which are best avoided. Determining which behaviors will earn praise from a teacher, which social media posts will be liked by peers, or which route to work will have the least traffic is often accomplished by exploring different actions, and learning from the good or bad outcomes that they yield. Importantly, individuals differ in the extent to which their evaluations <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib27"><span>27</span><span>Daw et al.</span><span>2002</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib35"><span>35</span><span>Frank et al.</span><span>2004</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib41"><span>41</span><span>Gershman</span><span>2015</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib52"><span>52</span><span>Lefebvre et al.</span><span>2017</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib88"><span>88</span><span>Sharot and Garrett</span><span>2016</span></a></cite></span> and their memories <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib57"><span>57</span><span>Madan et al.</span><span>2014</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib58"><span>58</span><span>Madan et al.</span><span>2017</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib83"><span>83</span><span>Rouhani and Niv</span><span>2019</span></a></cite></span> are influenced by good versus bad experiences. For example, consider a diner who has a delicious meal on her first visit to a new sushi restaurant, but on her next visit, the meal is not very good. A tendency to place greater weight on past positive experiences might make her both more likely to remember the good dining experience and more likely to return and try the restaurant again. In contrast, if the recent negative experience exerts an outsized influence, it may be more easily called to mind and she may forego another visit to that restaurant in favor of a surer bet. In this manner, asymmetric prioritization of past positive versus negative outcomes may render these valenced experiences more persistent in our memories and systematically alter how we make future decisions about uncertain prospects.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Understanding how experiential learning informs decision-making under uncertainty may be particularly important during adolescence, when teens’ burgeoning independence offers more frequent exposure to novel contexts in which the potential positive or negative outcomes of an action may be uncertain. Epidemiological data reveal an adolescent peak in the prevalence of many ‘risky’ behaviors that carry potential negative consequences (e.g., criminal behavior <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib93"><span>93</span><span>Steinberg</span><span>2013</span></a></cite>, risky sexual behavior <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib85"><span>85</span><span>Satterwhite et al.</span><span>2013</span></a></cite>). Moreover, consistent with proposals that adolescent risk taking might be driven by heightened sensitivity to rewarding outcomes <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib15"><span>15</span><span>Casey et al.</span><span>2008</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib39"><span>39</span><span>Galván</span><span>2013</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib89"><span>89</span><span>Silverman et al.</span><span>2015</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib92"><span>92</span><span>Steinberg</span><span>2008</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib99"><span>99</span><span>Duijvenvoorde et al.</span><span>2017</span></a></cite></span>, several neuroimaging studies have observed that adolescents exhibit neural responses to reward that are greater in magnitude than those of children or adults <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib12"><span>12</span><span>Braams et al.</span><span>2015</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib23"><span>23</span><span>Cohen et al.</span><span>2010</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib38"><span>38</span><span>Galvan et al.</span><span>2006</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib89"><span>89</span><span>Silverman et al.</span><span>2015</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib100"><span>100</span><span>Van Leijenhorst et al.</span><span>2010</span></a></cite></span>. These findings suggest that as adolescents learn to evaluate novel situations through trial and error, positive experiences might exert an outsized influence on their subsequent actions and choices.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Reinforcement learning (RL) models mathematically formalize the process of evaluating actions based on their resulting good and bad outcomes <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib94"><span>94</span><span>Sutton and Barto</span><span>1998</span></a></cite>. In such models, action value estimates are iteratively revised based on prediction errors or the extent to which an experienced outcome deviates from one’s current expectation. The magnitude of the resulting value update is scaled by an individual’s learning rate. Valence asymmetries in the estimation of action values can be captured by positing two distinct learning rates for positive versus negative prediction errors, leading to differential adjustment of value estimates following outcomes that are better or worse than one’s expectations. Importantly, an RL algorithm with such valence-dependent learning rates estimates subjective values in a ‘risk-sensitive’ manner <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib61"><span>61</span><span>Mihatsch and Neuneier</span><span>2002</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib67"><span>67</span><span>Niv et al.</span><span>2012</span></a></cite></span>. A learner with a greater positive than negative learning rate will, across repeated choices, come to assign a greater value to a risky prospect (i.e., with variable outcomes) than to a safer choice with equivalent expected value (EV) that consistently yields intermediate outcomes, whereas a learner with the opposite asymmetry will estimate the risky option as being relatively less valuable. </p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Outcomes that violate our expectations might also be particularly valuable to remember. Beyond the central role of prediction errors in the estimation of action values, these learning signals also appear to influence what information is prioritized in episodic memory <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib34"><span>34</span><span>Ergo et al.</span><span>2020</span></a></cite>. Past studies have demonstrated enhanced memory for stimuli presented concurrently with outcomes that elicit positive <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib26"><span>26</span><span>Davidow et al.</span><span>2016</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib44"><span>44</span><span>Jang et al.</span><span>2019</span></a></cite></span>, negative <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib47"><span>47</span><span>Kalbe and Schwabe</span><span>2020</span></a></cite>, or high-magnitude (independent of valence) prediction errors <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite>, suggesting that prediction errors can facilitate memory encoding and consolidation processes. The common role of prediction errors in driving value-based learning and facilitating memory may reflect, in part, a tendency to allocate greater attention to stimuli that are uncertain <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib28"><span>28</span><span>Dayan et al.</span><span>2000</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib70"><span>70</span><span>Pearce and Hall</span><span>1980</span></a></cite></span>. However, it is unclear whether idiosyncratic valence asymmetries in RL computations might give rise to corresponding asymmetries in the information that is prioritized for memory. Moreover, while few studies have explored the development of these interactive learning systems, a recent empirical study observing an effect of prediction errors on recognition memory in adolescents, but not adults <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib26"><span>26</span><span>Davidow et al.</span><span>2016</span></a></cite>, suggests that the influence of RL signals on memory may be differentially tuned across development.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">In the present study, we examined whether valence asymmetries in RL change across adolescent development, conferring age differences in risk preferences. We additionally hypothesized that individuals’ learning asymmetries might asymmetrically bias their memory for images that coincide with positive versus negative prediction errors. Several past studies have characterized developmental changes in learning from valenced outcomes <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib18"><span>18</span><span>Christakou et al.</span><span>2013</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib42"><span>42</span><span>Hauser et al.</span><span>2015</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib45"><span>45</span><span>Jones et al.</span><span>2014</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib59"><span>59</span><span>Master et al.</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib63"><span>63</span><span>Moutoussis et al.</span><span>2018</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib96"><span>96</span><span>Bos et al.</span><span>2012</span></a></cite></span>. However, the probabilistic reinforcement structures used in each of these studies demanded that the learner adopt specific valence asymmetries during value estimation in order to maximize reward in the task <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib68"><span>68</span><span>Nussenbaum and Hartley</span><span>2019</span></a></cite>. For instance, in one study, child, adolescent, and adult participants were rewarded on 80% of choices for one option and 20% of choices for a second option <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib96"><span>96</span><span>Bos et al.</span><span>2012</span></a></cite>. In this task, a positive learning asymmetry yields better performance than a neutral or negative asymmetry <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib68"><span>68</span><span>Nussenbaum and Hartley</span><span>2019</span></a></cite>. Indeed, adults exhibited a more optimal pattern of learning, with higher positive than negative learning rates, while children and adolescents did not <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib96"><span>96</span><span>Bos et al.</span><span>2012</span></a></cite>. Thus, choice behavior in these studies might reflect both potential age differences in the optimality of RL, as well as context-independent differences in the weighting of positive versus negative prediction errors <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib16"><span>16</span><span>Cazé and Meer</span><span>2013</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib68"><span>68</span><span>Nussenbaum and Hartley</span><span>2019</span></a></cite></span>.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">In Experiment 1 of the present study, we assessed whether valence asymmetries in RL varied from childhood to adulthood, using a risk-sensitive RL task <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib67"><span>67</span><span>Niv et al.</span><span>2012</span></a></cite> in which probabilistic and deterministic choice options have equal EV, making no particular learning asymmetry optimal. This parameterization allows any biases in the weighting of positive versus negative prediction errors to be revealed through subjects’ systematic risk-averse or risk-seeking choice behavior. Each choice outcome in the task was associated with a trial-unique image, enabling assessment of whether valenced learning asymmetries also biased subsequent memory for images that coincided with good or bad outcomes.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">To determine whether this hypothesized correspondence between valence biases in learning and memory generalized across experimental tasks and samples of different ages, in Experiment 2, we conducted a reanalysis of data from a previous study <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite>. In this study, a group of adults completed a task in which they reported value estimates for a series of images, and later completed a memory test for the images they encountered during learning. The original manuscript reported that subsequent memory varied as a function of PE magnitude, but not valence. Here, we tested whether a valence-dependent effect of PE on memory might be evident after accounting for idiosyncratic valence biases in learning.</p> <h2 itemscope="" itemtype="http://schema.stenci.la/Heading" id="results">Results</h2> <h3 itemscope="" itemtype="http://schema.stenci.la/Heading" id="experiment-1">Experiment 1 </h3> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" title="Load libraries and functions"><label data-itemprop="label">Load libraries and functions</label> <stencila-code-chunk itemscope="" itemtype="http://schema.stenci.la/CodeChunk" data-include="FALSE" data-programminglanguage="r"> <pre class="language-r" itemscope="" itemtype="http://schema.stenci.la/CodeBlock" slot="text"><code>source("twolines.R") #this "two lines" approach was introduced by Simonsohn (2017), and helps us better understand quadratic patterns. Simonsohn argues that a quadratic pattern can have many shapes but to argue that something is u-shaped, we should be able to fit two regression lines to the data with a breakpoint between the two, and the two lines should have significant opposite-signed slopes library(knitr) library(tidyverse) library(pander) library(lme4) library(lmerTest) library(sjPlot) library(dplyr) library(car) library(gridExtra) library(reshape2) library(ggpubr) library(ggeffects) library(here) library(GGally) library(emmeans) library(sjmisc) library(sjstats) library(r2glmm) library(effectsize) library(plotrix) library(gtable) library(psych) library(np) library(ordinal) library(formattable) library(grid) #reporting regression results #These functions output statistics, including effect sizes, for each type of #statistical test I report for display in html report created using knitr. lmReport <- function(model) { cat(tab_model(model, show.stat = TRUE, show.df = TRUE, string.stat = "t", col.order = c("est", "ci", "stat","df.error","p"))$knitr,"\n--------\n") ftab <- effectsize::cohens_f(model, ci = .95) #square and round2 the parameter columns ftab[,2] <- round2(ftab[,2]^2,2) ftab[,4] <- round2(ftab[,4]^2,2) ftab[,5] <- round2(ftab[,5]^2,2) colnames(ftab) <- c("Parameter","Cohensf2Partial", "f2_CI","f2_CI_low","f2_CI_high") return(ftab) } lmerReport <- function(model) { cat(tab_model(model, show.stat = TRUE, show.df = TRUE, string.stat = "t", col.order = c("stat","df.error","p", "est", "ci"))$knitr,"\n--------\n") } glmerReport <- function(model) { cat(tab_model(model, show.stat = TRUE, show.df = TRUE, string.stat = "z", col.order = c("stat","p","est", "ci"))$knitr,"\n--------\n") } ## Custom round function # Function to always round 0.5 up round2 <- function(x, digits = 0) { posneg <- sign(x) z <- abs(x) * 10^digits z <- z + 0.5 z <- trunc(z) z <- z / 10^digits z * posneg } ## Function to compute BIC from AIC, nobs, nparams compBIC <- function(AIC,nobs,nparams) { loglik <- (AIC - 2*nparams)/2 BIC <- (2*loglik) + (nparams*log(nobs)) } </code></pre> </stencila-code-chunk> </figure> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" title="Load experiment 1 data"><label data-itemprop="label">Load experiment 1 data</label> <stencila-code-chunk itemscope="" itemtype="http://schema.stenci.la/CodeChunk" data-include="FALSE" data-programminglanguage="r"> <pre class="language-r" itemscope="" itemtype="http://schema.stenci.la/CodeBlock" slot="text"><code>### Wide Files - one row per sub, not trial by trial ### widedf <- read_csv("data_Exp1/widedf.csv") #setting mean and sd age to use below because this isn't affected by other variables like number of trials, etc. meanage <- mean(widedf$Age) sdage <- sd(widedf$Age) #z-score age widedf$Age_Z <-(widedf$Age-meanage)/sdage #model parameters newModParams <- read_csv("data_Exp1/BestFitParams.csv") newModParams$Age_Z <-(newModParams$Age-meanage)/sdage ### Long - trial-by-trial info derived from TDRS models ### #Load the long file with trial-by-trial memory performance and compute relevant variables MemDF <- read_csv(here("data_Exp1","MemDF.csv")) #z-score age MemDF$Age_Z <-(MemDF$Age-meanage)/sdage #dummy coding for forced trials MemDF$Forced <- factor(ifelse(MemDF$TrialType == 2, 1, 0)) #dummy coding for equalEV risks MemDF$EqEVRiskTrial <- factor(ifelse(MemDF$FullTrialType==1 | MemDF$FullTrialType==3, 1, 0)) #dummy coding for unequalEV risks MemDF$UnEqEVRiskTrial <- factor(ifelse(MemDF$FullTrialType == 2, 1, 0)) #dummy coding for testTrials MemDF$Test <- factor(ifelse(MemDF$TrialType == 3, 1, 0)) #dummy coding for equal vs unequal EV risky trials MemDF$EqvsUnEqEVRiskTrial <- ifelse(MemDF$FullTrialType==1, 1, ifelse(MemDF$FullTrialType==3, 1, ifelse(MemDF$FullTrialType==2, 2, NaN))) #dummy coding for equal vs unequal EV risky trials MemDF$TrialTypeContrast <- factor( ifelse(MemDF$FullTrialType==1, 1, ifelse(MemDF$FullTrialType==3, 1, ifelse(MemDF$FullTrialType==2, 2, ifelse(MemDF$TrialType==2, 3, ifelse(MemDF$TrialType==3, 4, NaN))))), levels = c("1","2","3","4"), labels = c("EqEVRisk", "UnEqEvRisk","Forced","Test")) #Get the EV difference between machines for each problem EVDiffTable <- read_csv(here("data_Exp1", "MachineEVs.csv")) MemDF$EVDiff <- NA MemDF$EVDiff <- as.numeric(unlist(EVDiffTable[MemDF$FullTrialType,6])) MemDF$EVDiffScale <- scale(MemDF$EVDiff) rm(EVDiffTable) #Centering/scaling the memory trial index (when in the memory test a picture #was presented) MemDF$MemIdxScaled <- scale(MemDF$MemIdx) #make PositiveRPE a factor MemDF$PositiveRPE <-factor(MemDF$PositiveRPE, levels = c(0,1), labels = c("Negative Prediction Error", "Positive Prediction Error")) #compute AI MemDF$AsymmIdx <- (MemDF$AlphaPos-MemDF$AlphaNeg)/(MemDF$AlphaPos+MemDF$AlphaNeg) #Unscaled Trial - created this after already creating analyses below that call #on trialnum MemDF$TrialUnscaled <- MemDF$TrialNum #rescaling trial numbers MemDF$TrialNum <- scale(MemDF$TrialNum) #make block variable with 3 blocks MemDF$Block <- ifelse(MemDF$TrialUnscaled<62, 1, ifelse(MemDF$TrialUnscaled<123, 2, 3)) #make block variable with 6 blocks MemDF$Block2 <- ifelse(MemDF$TrialUnscaled<31, 1, ifelse(MemDF$TrialUnscaled<62, 2, ifelse(MemDF$TrialUnscaled<92, 3, ifelse(MemDF$TrialUnscaled<123, 4, ifelse(MemDF$TrialUnscaled<153, 5, 6))))) ### Utility data MemDF_Util <- read_csv(here("data_Exp1", "MemDF_Util.csv")) #z-score age MemDF_Util$Age_Z <-(MemDF_Util$Age-meanage)/sdage #dummy coding for forced trials MemDF_Util$Forced <- factor(ifelse(MemDF_Util$TrialType == 2, 1, 0)) #dummy coding for equalEV risks MemDF_Util$EqEVRiskTrial <- factor( ifelse(MemDF_Util$FullTrialType==1 | MemDF_Util$FullTrialType==3, 1, 0)) #dummy coding for unequalEV risks MemDF_Util$UnEqEVRiskTrial <- factor( ifelse(MemDF_Util$FullTrialType == 2, 1, 0)) #dummy coding for testTrials MemDF_Util$Test <- factor(ifelse(MemDF_Util$TrialType == 3, 1, 0)) #dummy coding for equal vs unequal EV risky trials MemDF_Util$EqvsUnEqEVRiskTrial <- ifelse(MemDF_Util$FullTrialType==1, 1, ifelse(MemDF_Util$FullTrialType==3, 1, ifelse(MemDF_Util$FullTrialType==2, 2, NaN))) #dummy coding for equal vs unequal EV risky trials MemDF_Util$TrialTypeContrast <- factor( ifelse(MemDF_Util$FullTrialType==1, 1, ifelse(MemDF_Util$FullTrialType==3, 1, ifelse(MemDF_Util$FullTrialType==2, 2, ifelse(MemDF_Util$TrialType==2, 3, ifelse(MemDF_Util$TrialType==3, 4, NaN))))), levels = c("1","2","3","4"), labels = c("EqEVRisk", "UnEqEvRisk","Forced","Test")) #Get the EV difference between machines for each problem EVDiffTable <- read_csv(here("data_Exp1", "MachineEVs.csv")) MemDF_Util$EVDiff <- NA MemDF_Util$EVDiff <- as.numeric( unlist(EVDiffTable[MemDF_Util$FullTrialType,6])) MemDF_Util$EVDiffScale <- scale(MemDF_Util$EVDiff) rm(EVDiffTable) #Centering/scaling the memory trial index (when in the memory test a picture was presented) MemDF_Util$MemIdxScaled <- scale(MemDF_Util$MemIdx) #make RositiveRPE a factor MemDF_Util$PositiveRPE <-factor(MemDF_Util$PositiveRPE, levels = c(0,1), labels = c("Negative Prediction Error", "Positive Prediction Error")) #Unscaled Trial - created this after already creating analyses below that call on trialnum MemDF_Util$TrialUnscaled <- MemDF_Util$TrialNum #rescaling trial numbers MemDF_Util$TrialNum <- scale(MemDF_Util$TrialNum) #make block variable with 3 blocks MemDF_Util$Block <- ifelse(MemDF_Util$TrialUnscaled<62, 1, ifelse(MemDF_Util$TrialUnscaled<123, 2, 3)) #make block variable with 6 blocks MemDF_Util$Block2 <- ifelse( MemDF_Util$TrialUnscaled<31, 1, ifelse(MemDF_Util$TrialUnscaled<62, 2, ifelse(MemDF_Util$TrialUnscaled<92, 3, ifelse(MemDF_Util$TrialUnscaled<123, 4, ifelse(MemDF_Util$TrialUnscaled<153, 5, 6))))) ###Posterior predictive check data for RSTD PPC <- read_csv(here("data_Exp1","PPC_RSTD.csv")) #Keeping this separate because the parameters have the same names as those in #widedf but are based on simulations. don't want to deal with renaming all of them PPC$Age_Z <- scale(PPC$Age) # PPC data for Utility PPC_Util <- read_csv(here("data_Exp1","PPC_Util.csv")) PPC_Util$Age_Z <- scale(PPC_Util$Age) TDRecovDF <- read_csv(here("data_Exp1", 'ModelRecov_TD.csv')) TDRSRecovDF <- read_csv(here("data_Exp1", 'ModelRecov_RSTD.csv')) UtilRecovDF <- read_csv(here("data_Exp1", 'ModelRecov_Util.csv')) FourLRRecovDF <- read_csv(here("data_Exp1", 'ModelRecov_FourLR.csv')) </code></pre> </stencila-code-chunk> </figure> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Participants (N = <stencila-code-expression programming-language="r" itemscope="" itemtype="http://schema.stenci.la/CodeExpression"><code class="r" slot="text">nrow(widedf)</code><output slot="output"></output> </stencila-code-expression>) ages <stencila-code-expression programming-language="r" itemscope="" itemtype="http://schema.stenci.la/CodeExpression"><code class="r" slot="text">min(widedf$Age)</code><output slot="output"></output> </stencila-code-expression>–<stencila-code-expression programming-language="r" itemscope="" itemtype="http://schema.stenci.la/CodeExpression"><code class="r" slot="text">max(widedf$Age)</code><output slot="output"></output> </stencila-code-expression> (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">M</em> = <stencila-code-expression programming-language="r" itemscope="" itemtype="http://schema.stenci.la/CodeExpression"> <code class="r" slot="text">round2(meanage,2)</code><output slot="output"></output> </stencila-code-expression>, SD = <stencila-code-expression programming-language="r" itemscope="" itemtype="http://schema.stenci.la/CodeExpression"><code class="r" slot="text">round2(sdage,2)</code><output slot="output"></output> </stencila-code-expression>) completed a risk-sensitive RL task <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib67"><span>67</span><span>Niv et al.</span><span>2012</span></a></cite>. In this task, participants learned, through trial and error, the values and probabilities associated with probabilistic and deterministic ‘point machines’ (<a href="#fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 1A and B</a>). On each trial (183 trials), participants made a free (two-choice options) or forced (single-choice option) selection of a point machine. Within free-choice trials, ‘risky’ trials presented a pair consisting of one probabilistic and one deterministic option, where neither option strictly dominated the other and evidence of individuals’ subjective values was revealed by their choices. On ‘test’ trials, in which one option dominated the other, we could assess objectively the accuracy of participants’ learning. We presented feedback (number of points) from each choice on a ‘ticket’ that also displayed a trial-unique picture of an object. A subsequent memory test allowed us to explore the interaction between choice outcomes and memory encoding across age (<a href="#fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 1C</a>).</p> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" id="fig1" title="Figure 1."> <label data-itemprop="label">Figure 1.</label><img src="index.html.media/fig1.jpg" alt="" itemscope="" itemtype="http://schema.org/ImageObject"> <figcaption> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="task-structure">Task structure.</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">(<strong itemscope="" itemtype="http://schema.stenci.la/Strong">A</strong>) Schematic of the structure of a trial in the risk-sensitive reinforcement learning task. (<strong itemscope="" itemtype="http://schema.stenci.la/Strong">B</strong>) The probabilities and point values associated with each of five ‘point machines’ (colors were counterbalanced). (<strong itemscope="" itemtype="http://schema.stenci.la/Strong">C</strong>) Example memory trial.</p> </figcaption> </figure> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="test-trial-performance">Test trial performance</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">To ensure that participants learned the probabilities and outcomes associated with each machine, we first examined performance on test trials, in which one option dominated the other. Test trial accuracy significantly improved across the task (generalized linear mixed-effects model: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 8.56, p<0.001, OR = 2.03, 95% CI [1.72, 2.38]), with accuracy improving from a mean of 0.63 in the first block to means of 0.80 and 0.84 in blocks 2 and 3, respectively. There was no main effect of age (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 0.51, p=0.612, OR = 1.06, 95% CI [0.86, 1.30]) or interaction between age and trial number (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 0.22, p=0.830, OR <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">=</em> 1.02, 95% CI [0.87, 1.19]; <a href="#app1fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 1A</a>). These results suggest that accuracy on this coarse measure of value learning did not change with age in our task.</p> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" title="WASIByAge"><label data-itemprop="label">WASIByAge</label> <stencila-code-chunk itemscope="" itemtype="http://schema.stenci.la/CodeChunk" data-programminglanguage="r"> <pre class="language-r" itemscope="" itemtype="http://schema.stenci.la/CodeBlock" slot="text"><code>print('Is there a relationship between age and WASI?') WASIage <- lm(WASI~Age_Z, data = widedf) lmReport(WASIage) WASIagesq <- lm(WASI~Age_Z + I(Age_Z^2), data = widedf) lmReport(WASIagesq) print('There is no relationship between WASI and linear or quadratic age') </code></pre> </stencila-code-chunk> </figure> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="explicit-reports">Explicit reports</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Following the learning task, we probed participants’ explicit knowledge about the point machines. Consistent with participants’ high accuracy on test trials, accuracy was also high on participants’ reports of whether each point machine was probabilistic or deterministic (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">M</em> = 0.85) and for the point values associated with each machine (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">M</em> = 0.84). Linear regressions suggested that performance on these explicit accuracy metrics did not vary with linear age (probabilistic/deterministic response accuracy by age: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.02, 95% CI [–0.06, 0.03], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(60) = –0.88, p=0.382, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.01, 95% CI [0, 0.13]; point value response accuracy by age: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.02, 95% CI [–0.04, 0.07], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(60) = 0.65, p=0.516, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.01, 95% CI [0, 0.11]).</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="response-time">Response time </h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">We explored whether response time (RT) varied with age during the learning task. We found a significant interaction between age and trial number (linear mixed-effects model: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(11279) = –2.10, p=0.036, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.02, 95% CI [–0.04, 0]) predicting log-transformed RT. Although RT did not differ by age early in the experiment, older participants responded faster than younger participants by the end of the experiment.</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="decision-making"> Decision-making</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Importantly, in our task, there were two pairs of machines in which both probabilistic and deterministic options yielded the same EV (i.e., 100% 20 points and 50/50% 0/40 points; 100% 40 points and 50/50% 0/80 points). A primary goal of this study was to examine participants’ tendency to choose probabilistic versus deterministic machines when EV was equivalent. On these equal-EV risk trials, participants chose the probabilistic option on 37% of trials (SD = 21%). This value was significantly lower than 50% (one-sample <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>-test: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(61) = 4.87, p<0.001, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">d</em> = 0.62, 95% CI [0.37, 0.95]), suggesting that, despite exhibiting heterogeneity in risk preferences, participants as a group were generally risk averse.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Next, we tested whether choices of the probabilistic machines, compared to choices for equal-EV deterministic machines, changed with age. The best-fitting model included both linear and quadratic age terms (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">F</em>(1,59) = 4.58, p=0.036), indicating that risk taking changed nonlinearly with age. Contrary to our hypothesis that risk-seeking choices would be highest in adolescents, we observed a significant quadratic effect of age, such that adolescents chose the probabilistic options less often than children or adults (quadratic age effect in a linear regression including both linear and quadratic age terms: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.06, 95% CI [0, 0.12], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = 2.14, p=0.036, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.08, 95% CI [0, 0.29]; <a href="#fig2" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 2</a>; see <a href="#app1fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 1</a> for plots depicting risk taking across the task as a function of age). The linear effect of age was not significant (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.01, 95% CI [–0.06, 0.12], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = –0.44, p=0.662, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.01, 95% CI [0, 0.11]). We also conducted a regression using the two-lines approach <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib90"><span>90</span><span>Simonsohn</span><span>2018</span></a></cite> and found a significant u-shaped pattern of risk taking with age, where the proportion of probabilistic choices decreased from age 8–16.45 (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.03, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = –1.97, p=0.048) and increased from age 16.45–27 (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.02, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 1.98, p=0.048). Age patterns were qualitatively similar when considering the subset of trials in which participants faced choice options with unequal EV (i.e., the 0/80 point machine vs. the safe 20 point machine; see Appendix 1 and <a href="#app1fig2" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 2</a> for full results).</p> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" id="fig2" title="Figure 2."> <label data-itemprop="label">Figure 2.</label> <stencila-code-chunk itemscope="" itemtype="http://schema.stenci.la/CodeChunk" data-programminglanguage="r"> <pre class="language-r" itemscope="" itemtype="http://schema.stenci.la/CodeBlock" slot="text"><code>ggplot(data=widedf, aes(x=Age, y=MeanRiskOverallEqEV)) + geom_point() + stat_smooth(method=lm,formula = y ~ x + I(x^2),se=TRUE,color="black") + scale_y_continuous(breaks=c(0,.25,.5,.75,1), labels = c("0%","25%","50%","75%","100%"), limits = c(0, 1)) + ylab("Percent Probabilistic Choices \nEqual-EV Trials") + geom_hline(yintercept=0.5, linetype="dashed") + theme_bw() + theme(text=element_text(family="sans",size=16), panel.grid.major = element_blank(), panel.grid.minor = element_blank())</code></pre> </stencila-code-chunk> <figcaption> <h5 itemscope="" itemtype="http://schema.stenci.la/Heading" id="probabilistic-choices-by-age">Probabilistic choices by age.</h5> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Probabilistic (i.e., risky) choices by age on trials in which the risky and safe machines had equal expected value (EV). Data points depict the mean percentage of trials where each participant selected the probabilistic choice option as a function of age. The regression line is from a linear regression including linear and quadratic age terms (significant quadratic effect of age: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.06, 95% CI [0, 0.12], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = 2.14, p=0.036, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = .08, 95% CI [0, 0.29], N = 62). Shaded region represents 95% CIs for estimates.</p> </figcaption> </figure> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="reinforcement-learning-modeling">Reinforcement learning modeling</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">To better understand the learning processes underlying individuals’ decision-making, we compared the fit of four RL models to participants’ choice behavior. The first was a temporal difference (TD) model with one learning rate (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em>). The second was a risk-sensitive temporal difference (RSTD) model with separate learning rates for better-than-expected (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup>) and worse-than-expected (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup>) outcomes, allowing us to index valence biases in learning. The third model included four learning rates (FourLR), with separate <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> and <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup></em> for free and forced choices, as past studies have found learning may differ as a function of agency <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib17"><span>17</span><span>Chambon et al.</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib21"><span>21</span><span>Cockburn et al.</span><span>2014</span></a></cite></span>. Finally, the fourth model was a Utility model, which transforms outcome values into utilities with an exponential subjective utility function with a free parameter (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">ρ</em>) capturing individual risk preferences <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib72"><span>72</span><span>Pratt</span><span>1964</span></a></cite>, updated value estimates using a single learning rate. For all models, machine values were transformed to range from 0 to 1, and values were initialized at 0.5 (equivalent to 40 points). A softmax function with an additional parameter <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">β</em> was used to convert the relative estimated values of the two machines into a probability of choosing each machine presented for maximum likelihood estimation.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">The RSTD (median Bayesian information criterion (BIC) = 131.93) and Utility (median BIC = 131.06) models both provided a better fit to participants’ choice data than both the TD (median BIC = 145.35) and FourLR (median BIC = 141.25) models (<a href="#app1fig5" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 5</a>). Assessment of whether the RSTD or Utility model provided the best fit to participants’ data was equivocal. At the group level, median ΔBIC was 0.87, while at the subject level, the median ΔBIC was 0.33. Thus, neither ΔBIC metric provides clear evidence in favor of either model (ΔBIC > 6 ; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib77"><span>77</span><span>Raftery</span><span>1995</span></a></cite>).</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">To further arbitrate between the RSTD and Utility models, we ran posterior predictive checks and confirmed that simulations from both models generated using subjects’ fit parameter values yielded choice behavior that exhibited strong correspondence to the real participant data (see <a href="#app1fig9" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 9</a>). However, data simulated from the RSTD model exhibited a significantly stronger correlation with actual choices (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">r</em> = 0.92) than those simulated using the Utility model (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">r</em> = 0.89; <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(61) = 2.58, p=0.012). Because the RSTD model fit choice data approximately as well as the Utility model, provided a significantly better qualitative fit to the choice data, and yielded an index of valence biases in learning, we focused our remaining analyses on the RSTD model (see Appendix 1 for additional model comparison analyses and for an examination of the relation between the Utility model and subsequent memory data).</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">We computed an asymmetry index (AI) for each participant, which reflects the relative size of <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> and <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup>, from the RSTD model. Mean AI was –0.22 (SD = 0.50). Mirroring the age patterns observed in risk taking, a linear regression model with a quadratic age term fit better than the model with only linear age (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">F</em>(1,59) = 5.88, p=0.018), and there was a significant quadratic age pattern in AI (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.17, 95% CI [0.03, 0.31], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = 2.43, p=0.018, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.10, 95% CI [0, 0.33]; <a href="#fig3" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 3</a>). Further, the u-shaped relationship between AI and age was significant, with a decrease in AI from ages 8–17 (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.08, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = –3.82, p<0.001), and an increase from ages 17–27 (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.05, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 2.17, p=0.030). This pattern was driven primarily by age-related changes in <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup>, which was greater in adolescents relative to children and adults (better fit for linear regression including quadratic term: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">F</em>(1,59) = 9.04, p=0.004; quadratic age: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.09, 95% CI [–0.16, –0.03], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = –3.01, p=0.004, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.15, 95% CI [0.02, 0.43]; <a href="#app1fig10" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 10B</a>). According to the two-lines approach, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup> significantly increased from ages 8–18 (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.04, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 3.24, p=0.001) and decreased from ages 18–27 (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.04, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = –3.57, p<0.001). Conversely, there were no linear or quadratic effects of age for <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> (all <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">p_s>0.24; <a href="#app1fig10" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 10A</a>). Finally, there were no significant linear or quadratic age patterns in the </em>β_ parameter (_p_s>.15, see Appendix 1 for full results; <a href="#app1fig10" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 10C</a>).</p> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" id="fig3" title="Figure 3."> <label data-itemprop="label">Figure 3.</label><img src="index.html.media/fig3.jpg" alt="" itemscope="" itemtype="http://schema.org/ImageObject"> <figcaption> <h5 itemscope="" itemtype="http://schema.stenci.la/Heading" id="asymmetry-index-ai-by-age">Asymmetry index (AI) by age.</h5> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">The regression line is from a linear regression model including linear and quadratic age terms (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.17, 95% CI [0.03, 0.31], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = 2.43, p=0.018, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.10, 95% CI [0, 0.33], N = 62). Data points represent individual participants. Shaded region represents 95% CIs for estimates.</p> </figcaption> </figure> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Prior work has found that valence biases tend to be positive in free choices, but neutral or negative in forced choices <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib17"><span>17</span><span>Chambon et al.</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib21"><span>21</span><span>Cockburn et al.</span><span>2014</span></a></cite></span>. While model comparison indicated that the FourLR model did not provide the best account of participants' learning process, we nonetheless conducted an exploratory analysis in which we used parameter estimates from the FourLR model to test whether learning asymmetries varied as a function of agency in our study. While the <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em>+ and AI were both higher for free compared to forced trials, median AIs were negative for both free and forced choices (see Appendix 1 for full results; <a href="#app1fig12" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 12</a>).</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="memory-performance">Memory performance</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Next, we examined accuracy during the surprise memory test for images that were presented with choice outcomes. Participants correctly identified 54% (SD = 14%) of images presented alongside choice feedback (i.e., Hits) and incorrectly indicated that 24% (SD = 15%) of foil images had been presented during the choice task (False Alarms). Mean <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">d</em>′ was 0.93 (SD = 0.48). Hit rate did not significantly change with linear or quadratic age (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">p_s>0.14). However, false alarm rate significantly increased with linear age (linear regression: _b</em> = 0.04, 95% CI [0.00; 0.08], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(60) = 2.14, p=0.037, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.08, 95% CI [0, 0.28]; <a href="#app1fig3" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 3A</a>). There was a marginal linear decrease in <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">d′</em> with age (linear regression: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.11, 95% CI [–0.23, 0.01], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(60) = 1.84, p=0.070, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.06, 95% CI [0, 0.24]; <a href="#app1fig3" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 3B</a>), suggesting that adults performed slightly worse on the memory test than younger participants.</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="influence-of-choice-context-on-memory">Influence of choice context on memory</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">We next tested whether the decision context in which images were presented influenced memory encoding. To explore this possibility, we first tested whether participants preferentially remembered images presented with outcomes of probabilistic versus deterministic machines. Participants were significantly more likely to remember pictures presented following a choice that yielded probabilistic rather than deterministic outcomes (probabilistic: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">M</em> = 0.56, SD = 0.15; deterministic: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">M =</em> 0.52, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">SD =</em> 0.15; <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(61) = 3.08, p=0.003, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">d</em> = 0.39, 95% CI [0.13, 0.65]). This result suggests that pictures were better remembered when they followed the choice of a machine that consistently generated prediction errors (PEs), which may reflect preferential allocation of attention toward outcomes of uncertain choices <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib28"><span>28</span><span>Dayan et al.</span><span>2000</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib70"><span>70</span><span>Pearce and Hall</span><span>1980</span></a></cite></span>.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Next, we explored whether valence biases in learning could account for individual variability in subsequent memory. In theory, larger-magnitude PEs provide stronger learning signals. Thus, we hypothesized that participants would have better memory for items coinciding with larger PEs. We also expected that this effect might differ as a function of idiosyncratic valence biases, with participants preferentially remembering items coinciding with signed PEs where the sign was consistent with the valence bias of their AI. Of note, this model did not explicitly include a variable indicating whether outcomes followed probabilistic or deterministic choices. Rather, whether the choice was probabilistic or deterministic was reflected in the PE magnitude variable, which was typically higher for probabilistic choices. In a generalized linear mixed-effects model, we predicted memory accuracy as a function of AI, PE valence, PE magnitude, and their interaction. We also tested for effects of linear and quadratic age, false alarm rate, as a measure of participants’ tendency to generally deem items as old, and trial number in the memory task, to account for fatigue as the task progressed (<a href="#fig4" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 4A</a>). We had no a priori hypothesis about how any effect of valence bias on memory might interact with participants’ confidence in their ‘old’ and ‘new’ judgments. Therefore, consistent with prior research examining memory accuracy (e.g., <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib33"><span>33</span><span>Dunsmoor et al.</span><span>2015</span></a></cite>; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib65"><span>65</span><span>Murty et al.</span><span>2016</span></a></cite>), we collapsed across ‘definitely’ and ‘maybe’ confidence ratings for our primary analysis (but see Appendix 1 for an exploratory ordinal regression analysis).</p> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" id="fig4" title="Figure 4."> <label data-itemprop="label">Figure 4.</label><img src="index.html.media/fig4.jpg" alt="" itemscope="" itemtype="http://schema.org/ImageObject"> <figcaption> <h5 itemscope="" itemtype="http://schema.stenci.la/Heading" id="the-relation-between-valence-biases-in-learning-and-incidental-memory-for-pictures-presented-with-choice-outcomes-experiment-1"> The relation between valence biases in learning and incidental memory for pictures presented with choice outcomes (Experiment 1).</h5> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">(<strong itemscope="" itemtype="http://schema.stenci.la/Strong">A</strong>) Results from generalized mixed-effects regression depicting fixed effects on memory accuracy. Whiskers represent 95% CI. (<strong itemscope="" itemtype="http://schema.stenci.la/Strong">B</strong>) Estimated marginal means plot showing the three-way interaction between AI, PE valence, and PE magnitude (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 3.45, p=0.001, OR = 1.12, 95% CI [1.05, 1.19], N = 62). Individuals with higher AIs were more likely to remember images associated with larger positive PEs, and those with lower AIs were more likely to remember images associated with larger negative PEs. Shaded areas represent 95% CI for estimates. ***p < .001.</p> </figcaption> </figure> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">As expected, accuracy was significantly higher for those with a higher false alarm rate (suggesting a bias towards old responses; <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z =</em> 4.86, p<0.001, OR = 1.41, 95% CI [1.23, 1.61]), and accuracy decreased as the task progressed (main effect of memory trial number: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = –5.83, p<0.001, OR = 0.82, 95% CI [0.76, 0.87]). There was a significant effect of unsigned PE magnitude on memory (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 4.75, p<0.001, OR = 1.19, 95% CI [1.11, 1.28]), such images that coincided with largerPEs were better remembered. There was also a significant three-way interaction between PE magnitude, PE valence, and AI on memory accuracy (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 3.45, p=0.001, OR = 1.12, 95% CI [1.05, 1.19]), such that people with more positive AIs were more likely to remember images associated with larger positive PEs (<a href="#fig4" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 4B</a>). The converse was also true: those with lower AIs were more likely to remember images presented concurrently with outcomes that elicited higher-magnitude negative PEs. Ordinal regression results that considered all four levels of confidence in recollection judgments (<a href="#supp1" itemscope="" itemtype="http://schema.stenci.la/Link">Supplementary file 1</a>, <a href="#app1fig4" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 4</a>) yielded consistent results and suggested that effects were primarily driven by high-confidence responses. Notably, neither linear (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 0.32, p=0.750, OR = 1.02, 95% CI [0.89, 1.17]) nor quadratic age (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = –0.18, p=0.856, OR = 0.99, 95% CI [0.84, 1.15]) were significant predictors of memory, suggesting that AI parsimoniously accounted for individual differences in memory.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">To test whether differences in memory for outcomes of deterministic versus probabilistic trials might have driven the observed AI × PE magnitude × PE valence interaction effect, we reran the regression model only within the subset of trials in which participants made probabilistic choices. Our results did not change — we observed both a main effect of PE magnitude (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 2.22, p=0.026, OR = 1.11, 95% CI [1.01, 1.23], N = 62) and a significant PE valence × PE magnitude × AI interaction (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 2.34, p=0.019, OR = 1.11, 95% CI [1.02, 1.21], N = 62).</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Finally, we tested for effects of agency — whether an image coincided with the outcome of a free or forced choice — on memory performance. We did not find a significant main effect of agency on memory, and agency did not significantly modulate the AI × PE magnitude × PE valence interaction effect (see Appendix 1 for full results; <a href="#app1fig13" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 13</a>).</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="self-reported-risk-taking"> Self-reported risk taking</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">One possible explanation for our unexpected u-shaped relationship between age and risk preferences in our choice task is that the adolescents in our sample might have been atypically risk averse. To investigate this possibility, we examined the relation between age and self-reported risk taking to the Domain-Specific Risk Taking (DOSPERT) scale <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib9"><span>9</span><span>Blais and Weber</span><span>2006</span></a></cite>. A linear regression model including quadratic age was a better fit than the model including linear age alone (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">F</em>(1,59) = 9.55, p=0.003). Specifically, consistent with prior reports of increased self-reported risk taking in adolescents, we found a significant inverted u-shaped quadratic age pattern (<a href="#fig5" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 5</a><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">, b</em> = –0.42, 95% CI [-0.69, –0.15], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = –3.09, p=0.003, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.16, 95% CI [0.02, 0.44]). There was not a significant linear age pattern in self-reported risk taking (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.15, 95% CI [–0.09, 0.39], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = 1.27, p=0.208, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.04, 95% CI [0, 0.20]). A two-lines regression analysis indicated that risk taking increased until age 15.29 (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = 0.23, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 2.20, p=0.028) and decreased thereafter (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.09, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = –2.03, p=0.042). Despite the fact that both choices in our task and self-report risk taking exhibited nonlinear age-related changes, there was not a significant correlation between DOSPERT score and risk taking in the task (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">r</em> = –0.12, 95% CI [–0.36, 0.13], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(60) = –0.95, p=0.347). </p> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" id="fig5" title="Figure 5."> <label data-itemprop="label">Figure 5.</label><img src="index.html.media/fig5.jpg" alt="" itemscope="" itemtype="http://schema.org/ImageObject"> <figcaption> <h5 itemscope="" itemtype="http://schema.stenci.la/Heading" id="self-reported-risk-taking-by-age">Self-reported risk taking by age.</h5> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Self-reported risk taking on the Domain-Specific Risk Taking (DOSPERT) scale changed nonlinearly with age (linear regression: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">b</em> = –0.42, 95% CI [–0.69,–0.15], <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>(59) = –3.09, p=0.003, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup> = 0.16, 95% CI [0.02, 0.44], N = 62). Shaded region represents 95% CIs for estimates.</p> </figcaption> </figure> <h3 itemscope="" itemtype="http://schema.stenci.la/Heading" id="experiment-2">Experiment 2 </h3> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Next, we assessed the generalizability of the observed effect of valence biases in learning on memory by conducting a reanalysis of a previously published independent dataset from a study that used a different experimental task in an adult sample <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite>. Notably, results from this study suggested that unsigned PEs (i.e., PEs of greater magnitude, whether negative or positive) facilitated subsequent memory, but no signed effect was observed. Here, we examined whether signed valence-specific effects might be evident when we account for individual differences in valence biases in learning.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Participants (N = 305) completed a Pavlovian learning task in which they encountered indoor and outdoor scenes. One type of scene had higher average value than the other. On each trial, an indoor or outdoor image was displayed, and participants provided an explicit prediction for the average value of that scene type. After the learning task, participants completed a memory test for the scenes.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">To quantify valence biases in this task, we fit an ‘Explicit Prediction’ RL model that was similar to the RSTD model used in Experiment 1, but was fit to participants’ trial-by-trial predictions rather than to choices. Like RSTD, the Explicit Prediction model included <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> and <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup>, allowing us to quantify each participant’s AI based on the relative size of their best-fit <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> and <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup> parameters. Mean AI was –0.11 (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">SD =</em> 0.34). Next, we ran a generalized linear mixed-effects model, as in Experiment 1, to examine whether PE valence and magnitude interacted with AI to predict subsequent memory, controlling for false alarm rate and memory trial number. Results are reported in <a href="#fig6" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 6</a>.</p> <figure itemscope="" itemtype="http://schema.stenci.la/Figure" id="fig6" title="Figure 6."> <label data-itemprop="label">Figure 6.</label><img src="index.html.media/fig6.jpg" alt="" itemscope="" itemtype="http://schema.org/ImageObject"> <figcaption> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="the-relation-between-valence-biases-in-learning-and-incidental-memory-for-pictures-presented-with-trial-outcomes-experiment-2"> The relation between valence biases in learning and incidental memory for pictures presented with trial outcomes (Experiment 2).</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Reanalysis of data from <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite>. (<strong itemscope="" itemtype="http://schema.stenci.la/Strong">A</strong>) Results from generalized mixed-effects regression depicting fixed effects on memory accuracy. Whiskers represent 95% CI. (<strong itemscope="" itemtype="http://schema.stenci.la/Strong">B</strong>) Estimated marginal means plot showing the three-way interaction between AI, PE valence, and PE magnitude (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 2.19, p=0.029, OR = 1.07, 95% CI [1.01, 1.13], N = 305). Individuals with higher AIs were more likely to remember images associated with larger positive PEs, and those with lower AIs were more likely to remember images associated with larger negative PEs. Shaded areas represent 95% CI for estimates. *p < .05, ***p < .001.</p> </figcaption> </figure> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Consistent with the results reported in the original manuscript <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite>, as well as the findings in Experiment 1, there was a strong main effect of unsigned PE (i.e., PE magnitude) on memory (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 5.09, p<0.001, OR = 1.19, 95% CI [1.12, 1.28]). However, aligned with our results from Experiment 1, we also observed a significant three-way interaction between AI, PE magnitude, and PE valence (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> = 2.19, p=0.029, OR = 1.07, 95% CI [1.01, 1.13]). Qualitative examination of this interaction effect suggests that the pattern of results differed slightly from that in Experiment 1. In Experiment 2, differences in memory performance as a function of AI were primarily apparent for images coinciding with negative PEs (<a href="#fig6" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 6B</a>): those who learned more from negative PEs also had better episodic memory for images that coincided with increasingly large negative PEs, while all participants appeared to have stronger memory for images coinciding with larger positive PEs. Notably, the interaction pattern here mirrors that within the subset of forced trials from Experiment 1 (<a href="#app1fig13" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 13B</a>) where, as in Experiment 2, participants learned from observed outcomes, but did not make free choices. One possibility is that PE magnitude and PE valence enhance memory through separate mechanisms, with a universal positive effect of unsigned PEs but a contextually (depending on choice agency) and individually variable effect of PE valence.</p> <h2 itemscope="" itemtype="http://schema.stenci.la/Heading" id="discussion">Discussion</h2> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">In this study, we examined whether asymmetry in learning from good versus bad choice outcomes changed across adolescence, and whether valence biases in RL also influenced episodic memory encoding. Specifically, we hypothesized that adolescents would place greater weight on good than bad outcomes during learning, a potential cognitive bias that may contribute to the increased risk taking during adolescence evident in real-world epidemiological data <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib48"><span>48</span><span>Kann et al.</span><span>2018</span></a></cite>. We indeed observed nonlinear age differences in valence-based learning asymmetries, but in the direction opposite from our prediction. Adolescents learned more from outcomes that were worse than expected, which was reflected in less risk taking relative to children and adults. Within this developmental sample, individual differences in learning biases were mirrored in subsequent memory. People who learned more from surprising negative versus positive outcomes also had better memory for images that coincided with negative outcomes, and vice versa. Although the precise pattern of results differed slightly, this relation between idiosyncratic valence biases in RL and corresponding biases in subsequent memory was also evident in a second independent sample in a different task <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite>, suggesting that this finding is generalizable. Collectively, these results highlight age-related changes across adolescence in the computation of subjective value and demonstrate that an individually varying valence asymmetric valuation process also influences how information is prioritized in memory.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Age-related shifts in learning rate asymmetry were driven primarily by changes in negative, rather than positive, learning rates. Whereas negative learning rates changed nonlinearly with age, there was no evidence for significant age differences in positive learning rates. This absence of age-related change in reward learning may seem counterintuitive given a large literature characterizing heightened reward sensitivity in adolescence (for reviews, see <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib39"><span>39</span><span>Galván</span><span>2013</span></a></cite>; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib89"><span>89</span><span>Silverman et al.</span><span>2015</span></a></cite>; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib98"><span>98</span><span>Duijvenvoorde et al.</span><span>2016</span></a></cite>); however, these effects have largely been observed in tasks in which learning was not required. Moreover, heightened reactivity to negatively valenced stimuli has also been observed in adolescents, relative to children <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib59"><span>59</span><span>Master et al.</span><span>2020</span></a></cite> and adults <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib40"><span>40</span><span>Galván and McGlennen</span><span>2013</span></a></cite>, and adolescents have been found to exhibit greater sensitivity to negative social evaluative feedback than adults <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib78"><span>78</span><span>Rodman et al.</span><span>2017</span></a></cite>. While a relatively small number of studies have used RL models to characterize age-related changes in valence-specific value updating <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib18"><span>18</span><span>Christakou et al.</span><span>2013</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib42"><span>42</span><span>Hauser et al.</span><span>2015</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib45"><span>45</span><span>Jones et al.</span><span>2014</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib59"><span>59</span><span>Master et al.</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib63"><span>63</span><span>Moutoussis et al.</span><span>2018</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib96"><span>96</span><span>Bos et al.</span><span>2012</span></a></cite></span>, age patterns reported in these studies vary substantially and none observed the same pattern of valence asymmetries present in our data. Variability in these findings may be due in part to substantial variation in the task reward structures, each of which required specific asymmetric settings of learning rates in order to perform optimally <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib16"><span>16</span><span>Cazé and Meer</span><span>2013</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib68"><span>68</span><span>Nussenbaum and Hartley</span><span>2019</span></a></cite></span>. This task variation limits the ability to differentiate age differences in optimal learning from systematic age differences in the influence of positive versus negative prediction errors on subjective value computation <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib68"><span>68</span><span>Nussenbaum and Hartley</span><span>2019</span></a></cite>. In contrast, our study used a paradigm in which risky and safe options had equal EV, allowing us to index risk preferences and corresponding valence biases in a context where there was no optimal strategy. Given the lack of convergence in the literature to date, further studies characterizing valence asymmetries in learning using unconfounded measures will be needed to ascertain how broadly the biases we observed generalize to learning contexts with varying reward statistics (e.g., different outcome probabilities or outcomes that are truly negative instead of neutral).</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Across two experimental samples, participants’ idiosyncratic tendencies to place greater weight on outcomes that elicited either positive or negative prediction errors was, in turn, associated with a propensity to form stronger incidental memories for images paired with these outcomes during learning. This correspondence between valence biases in evaluation and in memory is consistent with past findings. Greater risk-seeking choice behavior has been associated with better memory for the magnitude of extreme win outcomes <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib55"><span>55</span><span>Ludvig et al.</span><span>2018</span></a></cite> as well as greater recalled frequency of win outcomes <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib57"><span>57</span><span>Madan et al.</span><span>2014</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib58"><span>58</span><span>Madan et al.</span><span>2017</span></a></cite></span>, whereas risk-averse choices have been associated with the opposite pattern. Our results extend these findings by linking individual risk preferences to an underlying learning algorithm that predicts the valence specificity of corresponding memory biases and by demonstrating that these biases extend to episodic features incidentally associated with valenced outcomes. Moreover, while several prior studies employing computational analyses of learning have variably observed enhanced memory for images coinciding with outcomes that elicit positive <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib26"><span>26</span><span>Davidow et al.</span><span>2016</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib44"><span>44</span><span>Jang et al.</span><span>2019</span></a></cite></span>, negative <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib47"><span>47</span><span>Kalbe and Schwabe</span><span>2020</span></a></cite>, or high-magnitude (independent of valence) PEs <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib83"><span>83</span><span>Rouhani and Niv</span><span>2019</span></a></cite></span>, our findings suggest that consideration of individual differences in the prioritization of positive versus negative PEs may be critical in understanding how these aspects of value-based learning signals relate to memory encoding.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Attention likely played a critical role in the observed learning and memory effects. Although our study did not include direct measures of attention, there is a large literature demonstrating the critical role of attention in both RL <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib28"><span>28</span><span>Dayan et al.</span><span>2000</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib43"><span>43</span><span>Holland and Schiffino</span><span>2016</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib70"><span>70</span><span>Pearce and Hall</span><span>1980</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib75"><span>75</span><span>Radulescu et al.</span><span>2019</span></a></cite></span> and memory formation <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib20"><span>20</span><span>Chun and Turk-Browne</span><span>2007</span></a></cite>. Prominent theoretical accounts have proposed that attention should be preferentially allocated to stimuli that are more uncertain <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib28"><span>28</span><span>Dayan et al.</span><span>2000</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib70"><span>70</span><span>Pearce and Hall</span><span>1980</span></a></cite></span>. In our study, memory was better for items that coincided with probabilistic compared to deterministic outcomes. This finding likely reflects greater attention to the episodic features associated with outcomes of uncertain choice options. Importantly, however, our memory findings could not be solely explained via an uncertainty-driven attention account as the relation between idiosyncratic asymmetric valence biases and memory was also evident within the subset of trials with probabilistic outcomes. Thus, our observed memory effects may reflect differential attention to valenced outcomes that varies systematically across individuals in a manner that can be accounted for by asymmetries in their learning rates. Such valence biases in attention have been widely observed in clinical disorders <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib2"><span>2</span><span>Bar-Haim et al.</span><span>2007</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib62"><span>62</span><span>Mogg and Bradley</span><span>2016</span></a></cite></span> and may also be individually variable within non-clinical populations.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">In Experiment 1 of the present study, participants observed the outcomes of both free and forced choices. Prior studies have demonstrated differential effects of free versus forced choices on both learning and memory <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib17"><span>17</span><span>Chambon et al.</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib21"><span>21</span><span>Cockburn et al.</span><span>2014</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib49"><span>49</span><span>Katzman and Hartley</span><span>2020</span></a></cite></span>, which may reflect greater allocation of attention to contexts in which individuals have agency. Valence asymmetries in learning have been found to vary as a function of whether choices are free or forced, such that participants tend to exhibit a greater positive learning rate bias for free than for forced choices <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib17"><span>17</span><span>Chambon et al.</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib21"><span>21</span><span>Cockburn et al.</span><span>2014</span></a></cite></span>. Here, we did not observe positive learning rate asymmetries for free choices, and a model that included separate valenced learning rates for free versus forced choices was not favored by model comparison. Studies have also found that subsequent memory is facilitated for images associated with free, relative to forced, choices <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib49"><span>49</span><span>Katzman and Hartley</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib64"><span>64</span><span>Murty et al.</span><span>2015</span></a></cite></span>. In Experiment 1, there was no significant effect of agency on memory. However, in Experiment 2, in which participants provided explicit predictions of choice outcomes, but did not make free choices, the qualitative pattern of learning and memory biases differed from that observed in Experiment 1, and closely resembled the pattern present within the subset of forced-choice trials from that experiment. Namely, in each of these conditions where participants were not able to make free choices, all participants, regardless of AI, exhibited better memory for images presented with large positive PEs. Thus, while our study was not explicitly designed to test for such effects, this preliminary evidence suggests that choice agency may modulate the relation between valence biases in learning and corresponding biases in long-term memory, a hypothesis that should be directly assessed in future studies.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">While one interpretation of our results is that asymmetric value updating influences the prioritization of events in memory, recent theoretical proposals <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib8"><span>8</span><span>Biderman et al.</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib53"><span>53</span><span>Lengyel and Dayan</span><span>2008</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib87"><span>87</span><span>Shadlen and Shohamy</span><span>2016</span></a></cite></span> and empirical findings <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib1"><span>1</span><span>Bakkour et al.</span><span>2019</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib11"><span>11</span><span>Bornstein et al.</span><span>2017</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib32"><span>32</span><span>Duncan et al.</span><span>2019</span></a></cite></span> suggest a potential alternative account. According to this work, sampling of specific valenced episodes from memory can influence decision-making and serve as a different way of making choices under uncertainty than the sort of incremental value computation formalized in RL models. Under this conceptualization, a tendency to preferentially encode or retrieve past positive or negative experiences may, in turn, drive risk-averse or risk-seeking choice biases. While our task design does not enable clear arbitration between these alternative directional hypotheses, our results provide additional evidence of a tight coupling between valuation and episodic memory, and further underscore the importance in examining individual differences in valence asymmetries in these processes.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Traditional behavioral economic models of choice suggest that risk preferences stem from a nonlinear transformation of objective value into subjective utility <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib7"><span>7</span><span>Bernoulli</span><span>1954</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib46"><span>46</span><span>Kahneman and Tversky</span><span>1979</span></a></cite></span>, with decreases in the marginal utility produced by each unit of objective value (i.e., a concave utility curve) producing risk aversion. Our present study was motivated by the insight that such risk-averse, or risk-seeking, preferences can also arise from an RL process that asymmetrically integrates valenced prediction errors <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib61"><span>61</span><span>Mihatsch and Neuneier</span><span>2002</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib67"><span>67</span><span>Niv et al.</span><span>2012</span></a></cite></span>. In Experiment 1, we fit both a traditional behavioral economic model with exponential subjective utilities as well as a model with valenced learning rates. Notably, there was a very close correspondence between learning asymmetries derived from the valenced learning rate model and the risk preference parameter from the utility model, and model comparison indicated that these models provided comparably good accounts of participants’ choice data. Thus, future research will be needed to arbitrate between utility and valenced learning rate models of decisions under risk. However, a potential parsimonious account is that a risk-sensitive learning algorithm could represent a biologically plausible process for the construction of risk preferences <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib25"><span>25</span><span>Dabney et al.</span><span>2020</span></a></cite>, in which distortions of value are produced through differential subjective weighting of good and bad choice outcomes <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib61"><span>61</span><span>Mihatsch and Neuneier</span><span>2002</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib67"><span>67</span><span>Niv et al.</span><span>2012</span></a></cite></span>.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Contrary to our a priori hypothesis, and to epidemiological <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib48"><span>48</span><span>Kann et al.</span><span>2018</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib93"><span>93</span><span>Steinberg</span><span>2013</span></a></cite></span> and theoretical <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib15"><span>15</span><span>Casey et al.</span><span>2008</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib56"><span>56</span><span>Luna</span><span>2009</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib92"><span>92</span><span>Steinberg</span><span>2008</span></a></cite></span> work suggesting that adolescence is a period of increased risk taking, we found that adolescents took fewer risks than children or adults in our task. While at first glance these results might appear anomalous, within the same sample, we found that adolescents reported greater real-world risk taking than both children and adults. This lack of correspondence between task-based and self-reported indices of risk taking is consistent with previous findings in adults <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib76"><span>76</span><span>Radulescu et al.</span><span>2020</span></a></cite>, and suggests that these two measures reflect separable constructs. Past empirical studies assessing developmental changes in risky choice in laboratory tasks have observed varied results <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib30"><span>30</span><span>Defoe et al.</span><span>2015</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib79"><span>79</span><span>Rosenbaum et al.</span><span>2018</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib80"><span>80</span><span>Rosenbaum and Hartley</span><span>2019</span></a></cite></span>, but highlight two potential features of tasks that may elicit heightened adolescent risk taking. Adolescents may be more likely to take risks in tasks that require learning about risk through experience versus explicit description <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib79"><span>79</span><span>Rosenbaum et al.</span><span>2018</span></a></cite>, and in which the probabilistic negative outcomes are rare (e.g., the Iowa Gambling Task; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib6"><span>6</span><span>Bechara et al.</span><span>1997</span></a></cite>), qualities that are also true of many real-world risk-taking contexts. While our task involved experiential learning, risky choices resulted in rewarding outcomes on half of the trials and non-win outcomes on the other half. Thus, undesirable outcomes were not rare and there were no true negative outcomes. Highlighting the important influence of such contextual features on decision-making across development, a recent study found that adolescents were more prone than adults to ‘underweight’ rare outcomes in decision-making relative to their true probabilities, conferring a greater propensity to take risks in situations where rare outcomes are unfavorable <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib81"><span>81</span><span>Rosenbaum et al.</span><span>2021</span></a></cite>. Collectively, these findings suggest that specific details of an experimental design may influence the age-related patterns of risk taking observed in laboratory tasks <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib80"><span>80</span><span>Rosenbaum and Hartley</span><span>2019</span></a></cite> and suggest that greater ecological validity of task designs might be best achieved by mirroring the key statistical properties of real-world decision contexts of interest.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">The present findings raise the suggestion that, for a given individual, valence asymmetries in value-based learning might become more negative from childhood into adolescence, and more positive from adolescence into young adulthood. However, an important caveat is that such patterns of developmental change cannot be validly inferred from cross-sectional studies, which are confounded by potential effects of cohort <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib86"><span>86</span><span>Schaie</span><span>1965</span></a></cite>. Past studies have demonstrated that valence asymmetries in RL are indeed malleable within a given individual, exhibiting sensitivity to the statistics of the learning environment (e.g., the informativeness of positive versus negative outcomes; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib73"><span>73</span><span>Pulcu and Browning</span><span>2017</span></a></cite>) as well as to endogenous manipulations such as the pharmacological manipulation of neuromodulatory systems <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib60"><span>60</span><span>Michely et al.</span><span>2020</span></a></cite>. Future longitudinal studies will be needed to definitively establish whether valence biases in learning exhibit systematic age-related changes within an individual over developmental time.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Adolescence is conventionally viewed as a period of heightened reward-seeking, begging the question of why adolescents might exhibit the strongest negative valence bias in learning and memory. Theoretical consideration of the adaptive role of valence asymmetries may provide a parsimonious resolution to this apparent contradiction <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib16"><span>16</span><span>Cazé and Meer</span><span>2013</span></a></cite>. Somewhat counterintuitively, greater updating for negative versus positive prediction errors (i.e., a negative valence bias) yields systematic distortions in subjective value that effectively increase the contrast between outcomes in the reward domain (e.g., a participant with a negative learning asymmetry will represent the risky 80- and 40-point machines as being more different from each other than a participant with a positive learning asymmetry), facilitating optimal reward-motivated action selection. This tuning of learning rates is particularly beneficial in environments in which potential rewards are abundant <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib16"><span>16</span><span>Cazé and Meer</span><span>2013</span></a></cite>, which may be true during adolescence when social elements of the environment acquire unique reward value <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib10"><span>10</span><span>Blakemore</span><span>2008</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib66"><span>66</span><span>Nardou et al.</span><span>2019</span></a></cite></span>. While negative valence biases may be adaptive for reward-guided decision-making, a propensity to form more persistent memories for negative outcomes may also contribute to adolescents’ heightened vulnerability to psychopathology <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib51"><span>51</span><span>Lee et al.</span><span>2014</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib69"><span>69</span><span>Paus et al.</span><span>2008</span></a></cite></span>. A recent study using computational formalizations found that adults who were biased toward remembering images associated with negative, relative to positive, prediction errors also exhibited greater depressive symptoms <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib83"><span>83</span><span>Rouhani and Niv</span><span>2019</span></a></cite>. Moreover, negative biases in real-world autobiographical memory are a hallmark of depression and anxiety in both adolescents <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib50"><span>50</span><span>Kuyken and Howell</span><span>2006</span></a></cite> and adults <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib31"><span>31</span><span>Dillon and Pizzagalli</span><span>2018</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib37"><span>37</span><span>Gaddy and Ingram</span><span>2014</span></a></cite></span>. Future research should examine how valence biases in learning and memory, as well as the reward statistics of an individual’s real-world environment, relate to vulnerability or resilience to psychopathology across adolescent development. Finally, given an extensive literature demonstrating the pronounced influence of neuromodulatory systems on both valence biases in RL <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib24"><span>24</span><span>Cox et al.</span><span>2015</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib35"><span>35</span><span>Frank et al.</span><span>2004</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib36"><span>36</span><span>Frank et al.</span><span>2007</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib60"><span>60</span><span>Michely et al.</span><span>2020</span></a></cite></span> and value-guided memory <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib54"><span>54</span><span>Lisman and Grace</span><span>2005</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib84"><span>84</span><span>Sara</span><span>2009</span></a></cite></span>, future studies might examine how developmental changes within these systems relate to the age-related shifts in valence biases observed here.</p> <h2 itemscope="" itemtype="http://schema.stenci.la/Heading" id="materials-and-methods"> Materials and methods</h2> <h3 itemscope="" itemtype="http://schema.stenci.la/Heading" id="experiment-1-1">Experiment 1 </h3> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="participants">Participants </h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Sixty-two participants ages 8–27 years were included in our final sample (mean age = 17.63, SD = 5.76, 32 females). Nine additional participants completed the study but were removed from the sample due to poor task performance (described further below). This sample size is consistent with prior studies that used age as a continuous predictor and have found significant age differences in decision-making (e.g., <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib29"><span>29</span><span>Decker et al.</span><span>2015</span></a></cite>; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib71"><span>71</span><span>Potter et al.</span><span>2017</span></a></cite>; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib97"><span>97</span><span>Bos et al.</span><span>2015</span></a></cite>). All participants had no previous diagnosis of a learning disorder, no current psychiatric medication use, and normal color vision according to self- or parent report.</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="risk-sensitive-rl-task"> Risk-sensitive RL task</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">In the present study, participants completed a risk-sensitive RL task adapted from <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib67"><span>67</span><span>Niv et al.</span><span>2012</span></a></cite> in which participants learned, through trial and error, the values and probabilities associated with five ‘point machines’ (<a href="#fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 1A</a>). Three machines were deterministic and gave their respective payoffs 100% of the time (<a href="#fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 1B</a>). Two machines were probabilistic (or risky) and gave their respective payoffs 50% of the time and zero points the other 50% (<a href="#fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 1B</a>). Importantly, EV could be deconfounded from risk as there were two pairs of machines in which both probabilistic and deterministic options yielded the same EV (i.e., 100% 20 points and 50/50% 0/40 points; 100% 40 points and 50/50% 0/80 points). We presented each choice outcome on a ‘ticket’ that also displayed a trial-unique picture of an object. A subsequent memory test allowed us to explore the interaction between choice outcomes and memory encoding across age. The task was programmed in MATLAB Version R2017a (The MathWorks, Inc, Natick, MA).</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">All participants completed a tutorial that involved detailed instructions and practice trials with machines that had the same probability structure as the machines they would encounter in the later task (i.e., one machine always gave 1 point, the other gave 0 point on half of trials and 2 points on the other half). Then, participants completed the RL task, which included 183 trials. There were 66 total ‘risky’ choices between probabilistic and deterministic machines. 42 of these risky trials involved choices between machines with equal EV, while 24 trials required choices between the probabilistic 0/80 machine and the deterministic 20 point machine. Participants also experienced 75 single-option ‘forced’ trials (15 for each of the five machines) to ensure each participant learned about values and probabilities associated with all of the machines. During forced trials, only one machine appeared on the screen, and the participant pressed a button to indicate the location of the machine (left or right). Finally, there were 42 test trials in which one machine’s value had absolute dominance over the other, with all outcomes of one option being greater than or equal to all outcomes of the other option (e.g., 100% chance of 40 points versus 50% of 40 points and 50% of 0 points). Test trials allowed us to gauge participants’ learning and understanding of the task. We excluded nine participants who did not choose correctly on at least 60% of test trials in the last 2/3 of the task (four children ages 8–9, three adolescents ages 14–16, and two adults ages 24–25). The trials were divided into blocks with 1/3 of the trials in each block, and after each block, participants could choose to take a short break. Unbeknownst to participants, trials were pseudo-randomized, such that 1/3 of each type of trial was presented in each block of the task, with the order of trial types randomized within each block. Outcomes of risky machines were additionally pseudo-randomized so that within each series of eight choices from a given risky machine, four choices resulted in a win and four resulted in zero point, in a random order.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">On each trial, participants were asked to make a choice within 3 s after the machines were presented. If they chose in time, the outcome of the choice was presented on a ‘ticket’ along with a randomly selected, trial-unique picture of an object for 2 s (<a href="#fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 1A</a>). If they did not respond in time, the words ‘TOO SLOW’ were presented, without a picture, for 1 s before the task moved to the next trial. Across all participants, only 37 (out of 11,346) total trials were missed for slow responses, with a maximum of 7 missed trials for one participant.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">After completing the choice task, participants were probed for their explicit memory of points associated with each machine. For every machine, a participant was first asked, “Did this machine always give you the same number of points, or did it sometimes give 0 points and sometimes give you more points?” If the participant indicated that the machine always gave the same number of points, they were asked, “How many points did this machine give you each time you chose it?” Otherwise, they were asked, “How many points did this machine give you when it did not give 0 points?” To respond to this second question, participants selected from all possible point outcomes presented in the task (0, 20, 40, 80). There was no time limit for responding to these questions.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Next, participants completed a surprise memory test, in which all 183 images presented during the task and 183 novel images were presented in random order (<a href="#fig1" itemscope="" itemtype="http://schema.stenci.la/Link">Figure 1C</a>). Images corresponding to the few choice trials that were missed due to slow responses were recategorized as novel. Ratings were on a scale from 1 (definitely saw during the task) to 4 (definitely did not see during the task), and participants had unlimited time to indicate their responses. All images were obtained from the Bank of Standardized Stimuli (BOSS; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib13"><span>13</span><span>Brodeur et al.</span><span>2010</span></a></cite>; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib14"><span>14</span><span>Brodeur et al.</span><span>2014</span></a></cite>) and were selected to be familiar and nameable for the age range in our sample. For each participant, half of the set of photos was randomly chosen to be presented during the task and half were assigned to be novel images for the memory test.</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="self-reported-risk-taking-1">Self-reported risk taking</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">To assess the predictive validity of our findings for real-world risk taking, participants completed the DOSPERT scale <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib9"><span>9</span><span>Blais and Weber</span><span>2006</span></a></cite>. The DOSPERT indexes participants’ likelihood of taking risks in five domains: monetary, health and safety, recreational, ethical, and social. We computed the mean self-reported likelihood of risk taking across all behaviors on the DOSPERT as a measure of real-world risk taking. Age-appropriate variants of the DOSPERT were administered to children (8–12 years old), adolescents (13–17 years old), and adults (ages 18 and older) <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib3"><span>3</span><span>Barkley-Levenson et al.</span><span>2013</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib91"><span>91</span><span>Somerville et al.</span><span>2017</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib98"><span>98</span><span>Duijvenvoorde et al.</span><span>2016</span></a></cite></span>.</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="reasoning-assessment"> Reasoning assessment</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">We administered the Vocabulary and Matrix Reasoning sections of the Wechsler Abbreviated Scale of Intelligence (WASI; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib101"><span>101</span><span>Wechsler</span><span>2011</span></a></cite>), which index verbal cognition and abstract reasoning, to ensure that these measures were not confounded with age within our sample. WASI scores did not vary by linear or quadratic age (_p_s>.2). Thus, we did not include this measure in subsequent analyses.</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="procedure">Procedure</h4> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Participants first provided informed consent (adults) or assent and parental consent (children and adolescents). Next, participants completed the risk-sensitive RL task and memory test, followed by the DOSPERT questionnaire and the WASI. Participants were paid $15 for completing the experiment, which lasted approximately 1 hr. Although participants were told that an additional bonus payment would be based on the number of points they earned in the risk-sensitive RL task, all participants received the same $5 bonus payment. The study protocol was approved by the New York University Institutional Review Board.</p> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="analyses">Analyses</h4> <h5 itemscope="" itemtype="http://schema.stenci.la/Heading" id="reinforcement-learning-models">Reinforcement-learning models</h5> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Four RL models were fit to participants’ choices in the task.</p> <h6 itemscope="" itemtype="http://schema.stenci.la/Heading" id="td-model">TD model</h6> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">We fit a TD learning model <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib94"><span>94</span><span>Sutton and Barto</span><span>1998</span></a></cite>, in which the estimated value of choosing a given machine (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub></em>) is updated on each trial (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>) according to the following function: <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub></em>(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em> + 1) = <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub></em>(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>) + <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em> * δ(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>), in which δ(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>) = <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">r</em>(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>) – <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub></em>(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>) is the prediction error, representing how much better or worse the reward outcome (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">r</em>) is than the estimated value of that machine. δ is scaled by a learning rate <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em>, a free parameter that is estimated separately for each participant.</p> <h6 itemscope="" itemtype="http://schema.stenci.la/Heading" id="rstd-model">RSTD model</h6> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">The RSTD model is similar to the TD model but includes two separate learning rates for prediction errors of different signs. Specifically, when δ is positive, the value of the chosen machine is updated according to the equation: Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub>(t + 1) = Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub>(t) + <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> * δ(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>). When δ is negative, the chosen machine’s value is updated as Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub>(t + 1) = Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub>(t) + <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup> * δ(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>). Including two learning rates allows the model to be sensitive to the risk preferences revealed by participants’ choices across the probabilistic and deterministic (‘risky versus safe’) choice pairs in the paradigm <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib67"><span>67</span><span>Niv et al.</span><span>2012</span></a></cite>. For a given individual, if <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> is greater than <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup>, Q-values of the machines with variable outcomes will be greater than those of deterministic machines with equal EV, and the individual will be more likely to make risk-seeking choices. Conversely if <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup> is greater than <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup>, the Q-values of the risky machines will be lower than their EVs, making risk-averse choices more likely. To index the relative difference between <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> and <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup>, we computed an AI as AI = (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> - <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup>)/(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> + <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup></em>), where an AI > 0 reflects greater weighting of positive relative to negative prediction errors, whereas an AI < 0 reflects greater relative weighting of negative prediction errors <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib67"><span>67</span><span>Niv et al.</span><span>2012</span></a></cite>.</p> <h6 itemscope="" itemtype="http://schema.stenci.la/Heading" id="fourlr-model">FourLR model </h6> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">In our task, participants made both free and forced choices. Past research suggests that valence biases in learning may differ as a function of choice agency <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib17"><span>17</span><span>Chambon et al.</span><span>2020</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib21"><span>21</span><span>Cockburn et al.</span><span>2014</span></a></cite></span>. To test this possibility, we assessed the fit of a FourLR model, which was the same as the RSTD model except that it included four learning rates instead of two, with separate <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> and <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em><sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup> parameters for free and forced choices.</p> <h6 itemscope="" itemtype="http://schema.stenci.la/Heading" id="utility-model">Utility model </h6> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">As a further point of comparison with the TD, RSTD, and FourLR models, we estimated a utility model that employed the same value update equation as the TD model, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub></em>(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em> + 1) = <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub></em>(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>) + <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em> * δ(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>). However, δ was defined according to the equation δ(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>) = <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">r</em>(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>)<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">ρ</sup> – <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">Q<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M</sub></em>(<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>), in which the reward outcome is exponentially transformed by <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">ρ</em>, which represents the curvature of each individual’s subjective utility function <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib72"><span>72</span><span>Pratt</span><span>1964</span></a></cite>. <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">ρ</em> < 1 corresponds to a concave utility function, which yields risk aversion as a result of diminishing sensitivity to returns <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib95"><span>95</span><span>Tversky and Kahneman</span><span>1992</span></a></cite>. In contrast, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">ρ</em> > 1 corresponds to a convex utility function that yields risk-seeking behavior.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">In all models, Q-values were converted to probabilities of choosing each option in a trial using the softmax rule, P<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M1</sub> = e<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">β*Q(t)M1</sup>/(e<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">β*Q(t)M1</sup>+ e<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">β*Q(t)M2</sup>), where P<sub itemscope="" itemtype="http://schema.stenci.la/Subscript">M1</sub> is the predicted probability of choosing Machine 1, with the inverse temperature parameter <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">β</em> capturing how sensitive an individual’s choices are to the difference in value between the two machines. Notably, outcomes of the forced trials were included in the value updating step for each model. However, forced trials were not included in the modeling stage in which learned values are passed through the softmax function to determine choice probabilities as there was only a single-choice option on these trials.</p> <h3 itemscope="" itemtype="http://schema.stenci.la/Heading" id="model-fitting">Model fitting </h3> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Prior to model fitting, outcome values were rescaled between 0 and 1, with 1 representing the maximum possible point outcome (80). We fit all RL models for each participant via maximum a posteriori estimation in MATLAB using the optimization function fminunc. _Q-_values were initialized at 0.5 (equivalent to 40 points). Bounds and priors for each of the parameters are listed in <a href="#table1" itemscope="" itemtype="http://schema.stenci.la/Link">Table 1</a>. There was no linear or quadratic relationship between BIC and age in any of the models (all _p_s>0.1).</p> <table id="table1" itemscope="" itemtype="http://schema.org/Table"> <caption><label data-itemprop="label">Table 1.</label> <div itemprop="caption"> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="bounds-priors-and-recoverability-for-parameters-in-each-model">Bounds, priors, and recoverability for parameters in each model.</h4> </div> </caption> <thead> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <th itemscope="" itemtype="http://schema.stenci.la/TableCell">Model</th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell">Parameter</th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell">Bounds</th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell">Prior</th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell">Recoverability</th> </tr> </thead> <tbody> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">TD</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0,1</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Beta(2,2)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.84</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">β</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0.000001, 30</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Gamma(2,3)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.88</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">RSTD</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup></em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0,1</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Beta(2,2)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.79</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup></em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0,1</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Beta(2,2)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.88</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">β</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0.000001, 30</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Gamma(2,3)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.9</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">FourLR</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> free</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0,1</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Beta(2,2)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.79</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup> free</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0,1</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Beta(2,2)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.89</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">+</sup> forced</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0,1</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Beta(2,2)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.76</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α<sup itemscope="" itemtype="http://schema.stenci.la/Superscript">-</sup> forced</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0,1</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Beta(2,2)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.78</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">β</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0.000001, 30</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Gamma(2,3)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.9</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Utility</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">α</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0,1</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Beta(2,2)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.75</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">β</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0.000001, 30</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Gamma(2,3)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.88</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><em itemscope="" itemtype="http://schema.stenci.la/Emphasis">ρ</em></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">0, 2.5</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Gamma(1.5,1.5)</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.88</span></td> </tr> </tbody> </table> <h3 itemscope="" itemtype="http://schema.stenci.la/Heading" id="parameter-and-model-recovery">Parameter and model recovery</h3> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">For each model, we simulated data for 10,000 subjects with values of each parameter drawn randomly and uniformly from the range of possible parameter values. Next, we fit the simulated data using the same model. We tested for recoverability of model parameters by correlating the parameter that generated the data with the parameters produced through model fitting. These correlations are displayed in <a href="#table1" itemscope="" itemtype="http://schema.stenci.la/Link">Table 1</a>. All parameters for TD, RSTD, FourLR, and Utility models showed high recoverability.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">To examine the identifiability of the TD, RSTD, FourLR, and Utility models, we generated simulated data using each model and fit all four of the models, including those that were <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">not</em> used to generate the data to each simulated dataset (e.g., we fit all the TD-generated subjects with the TD model as well as the RSTD, FourLR, and Utility models). We then used BIC, a quality-of-fit metric that penalizes models for additional parameters, to assess whether the generating model was also the best-fitting model for each subject. Recoverability was reasonable for all models except the least-parsimonious FourLR model (<a href="#table2" itemscope="" itemtype="http://schema.stenci.la/Link">Table 2</a>). Aside from the subjects generated by the FourLR model, for all pairwise comparisons between generating and comparison models, the majority of simulated subjects were best fit by the generating model. The RSTD-simulated subjects who were better fit by the TD model were those who had less extreme AI values (<a href="#app1fig7" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 7</a>), and thus could be more parsimoniously captured by a model with a single learning rate. We also found that RSTD model parameters were reasonably well recovered across the range of AI observed in our empirical sample (see <a href="#app1fig8" itemscope="" itemtype="http://schema.stenci.la/Link">Appendix 1—figure 8</a>).</p> <table id="table2" itemscope="" itemtype="http://schema.org/Table"> <caption><label data-itemprop="label">Table 2.</label> <div itemprop="caption"> <h4 itemscope="" itemtype="http://schema.stenci.la/Heading" id="model-recovery">Model recovery.</h4> </div> </caption> <thead> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <th itemscope="" itemtype="http://schema.stenci.la/TableCell"></th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell"></th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell">Comparison model</th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell"></th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell"></th> <th itemscope="" itemtype="http://schema.stenci.la/TableCell"></th> </tr> </thead> <tbody> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">TD</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">RSTD</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">FourLR</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Utility</td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"> Generating model</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">TD</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">-</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.98</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">1</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.97</span></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">RSTD</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.57</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">-</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.99</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.65</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">FourLR</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.5</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.31</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">-</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.39</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> </tr> <tr itemscope="" itemtype="http://schema.stenci.la/TableRow"> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">Utility</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.58</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.76</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"><span data-itemtype="http://schema.org/Number">0.99</span></td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell">-</td> <td itemscope="" itemtype="http://schema.stenci.la/TableCell"></td> </tr> </tbody> </table> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Values in this table indicate the proportion of participants simulated by the generating model who are best fit by the generating model in a pairwise comparison with each alternative model.</p> <h3 itemscope="" itemtype="http://schema.stenci.la/Heading" id="statistical-analyses"> Statistical analyses</h3> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Statistical analyses were performed in R version 4.0.2 <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib74"><span>74</span><span>R Development Core Team</span><span>2016</span></a></cite> with a two-tailed alpha threshold of p<0.05. For tests of trial-wise effects, we ran linear mixed-effects regression (lmer) or generalized linear mixed-effects regression (glmer) models (lme4 package; <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib5"><span>5</span><span>Bates et al.</span><span>2015</span></a></cite>), which included participant as a random effect, and estimated random intercepts and slopes for each fixed effect. We used the ‘bobyqa’ optimizer with 1 million iterations. Trial number was included in lmer and glmer regression models. All independent variables were z-scored. We began with this maximal model, which converged for all analyses except one, for which we systematically reduced the complexity of the model until it converged <span itemscope="" itemtype="http://schema.stenci.la/CiteGroup"><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib4"><span>4</span><span>Barr et al.</span><span>2013</span></a></cite><cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib90"><span>90</span><span>Simonsohn</span><span>2018</span></a></cite></span>, which algorithmically determines a break point in the distribution and tests whether regression lines on either side of the break point have significant slopes with opposite signs.</p> <h3 itemscope="" itemtype="http://schema.stenci.la/Heading" id="reporting">Reporting</h3> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">For one-way and paired <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>-tests, we report <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>-statistics, p-values, and Cohen’s d with 95% confidence intervals (CIs; using the function cohens<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">d in the rstatix package [one-way _t</em>-test] or the effectsize package [paired <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>-test]).</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">For linear regressions, we report unstandardized regression coefficients, <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em>-statistics, and p-values. We also report Cohen’s <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">f<sup itemscope="" itemtype="http://schema.stenci.la/Superscript"><span data-itemtype="http://schema.org/Number">2</span></sup></em> with 95% CIs, a standardized effect size measure <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib22"><span>22</span><span>Cohen</span><span>1992</span></a></cite> computed by squaring the output of the function cohens_f in the effectsize package.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">For multilevel models, we report test statistics (<em itemscope="" itemtype="http://schema.stenci.la/Emphasis">t</em> for linear mixed-effects models and <em itemscope="" itemtype="http://schema.stenci.la/Emphasis">z</em> for generalized linear mixed-effects models), p-values, and unstandardized effect sizes with 95% CIs (unstandardized coefficients for linear mixed-effects models, and odds ratios for generalized linear mixed-effects models).</p> <h3 itemscope="" itemtype="http://schema.stenci.la/Heading" id="experiment-2-1">Experiment 2 </h3> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Next, we looked for evidence that valence biases in learning influence memory in a previously published independent dataset <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite>. Notably, results from this study suggested that unsigned PEs (i.e., PEs of greater magnitude whether negative or positive) facilitate subsequent memory, but no signed effect was observed. Here, we examined whether signed valence-specific effects might be evident when we account for individual differences in learning.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Briefly, adult participants completed a Pavlovian learning task (i.e., participants did not make choices and could not influence the observed outcomes) in which they encountered indoor and outdoor scenes. One type of scene had higher average value than the other. On each trial, an indoor or outdoor image was displayed, and participants provided an explicit prediction for the average value of that scene type. After the learning task, participants completed a memory test for the scenes. A detailed description of the experimental paradigm can be found in the original publication <cite itemscope="" itemtype="http://schema.stenci.la/Cite"><a href="#bib82"><span>82</span><span>Rouhani et al.</span><span>2018</span></a></cite>. </p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">In order to derive each participant’s AI, we fit an ‘Explicit Prediction’ RL model to the participants’ estimation data (see Appendix 1 for more details on our model specification and fitting procedure). Similar to our RSTD model, this model included separate learning rates for trials with positive and negative PEs.</p> <p itemscope="" itemtype="http://schema.stenci.la/Paragraph">Importantly, the RSTD model and the Explicit Prediction model differed in that the RSTD model included a β parameter, while the Explicit Prediction model did not. In Experiment 1, this extra parameter allowed us to use the softmax function to convert the relative estimated values of the two machines into a probability of choosing each machine presented, which we then compared to participants’ actual choices during maximum likelihood estimation. In contrast, in Experiment 2, participants explicitly reported their value predictions (and did not make choices), so the model’s free parameters were fit by minimizing the difference between the model’s value estimates and participants’ explicit predictions.</p> <section data-itemprop="references"> <h2 data-itemtype="http://schema.stenci.la/Heading">References</h2> <ol> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib1"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Bakkour"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bakkour</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="DJ Palombo"><span data-itemprop="givenNames"><span itemprop="givenName">DJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Palombo</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Zylberberg"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Zylberberg</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="YH Kang"><span data-itemprop="givenNames"><span itemprop="givenName">YH</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kang</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Reid"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Reid</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Verfaellie"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Verfaellie</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MN Shadlen"><span data-itemprop="givenNames"><span itemprop="givenName">MN</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shadlen</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Shohamy"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shohamy</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><span itemprop="headline">The hippocampus supports deliberation during value-based decisions</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">8</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">eLife</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20hippocampus%20supports%20deliberation%20during%20value-based%20decisions"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib2"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Bar-Haim"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bar-Haim</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Lamy"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lamy</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Pergamin"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Pergamin</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MJ Bakermans-Kranenburg"><span data-itemprop="givenNames"><span itemprop="givenName">MJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bakermans-Kranenburg</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MH IJzendoorn"><span data-itemprop="givenNames"><span itemprop="givenName">MH</span></span><span data-itemprop="familyNames"><span itemprop="familyName">IJzendoorn</span></span> </li> </ol><time itemprop="datePublished" datetime="2007">2007</time><span itemprop="headline">Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">133</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Psychological Bulletin</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">24</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Threat-related%20attentional%20bias%20in%20anxious%20and%20nonanxious%20individuals:%20a%20meta-analytic%20study"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib3"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EE Barkley-Levenson"><span data-itemprop="givenNames"><span itemprop="givenName">EE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Barkley-Levenson</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Van Leijenhorst"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Van Leijenhorst</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Galván"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Galván</span></span> </li> </ol><time itemprop="datePublished" datetime="2013">2013</time><span itemprop="headline">Behavioral and neural correlates of loss aversion and risk avoidance in adolescents and adults</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">3</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Developmental Cognitive Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">72</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">83</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Behavioral%20and%20neural%20correlates%20of%20loss%20aversion%20and%20risk%20avoidance%20in%20adolescents%20and%20adults"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib4"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="DJ Barr"><span data-itemprop="givenNames"><span itemprop="givenName">DJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Barr</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Levy"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Levy</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="C Scheepers"><span data-itemprop="givenNames"><span itemprop="givenName">C</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Scheepers</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="HJ Tily"><span data-itemprop="givenNames"><span itemprop="givenName">HJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Tily</span></span> </li> </ol><time itemprop="datePublished" datetime="2013">2013</time><span itemprop="headline">Random effects structure for confirmatory hypothesis testing: Keep it maximal</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">68</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Memory and Language</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">255</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">278</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Random%20effects%20structure%20for%20confirmatory%20hypothesis%20testing:%20Keep%20it%20maximal"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib5"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Bates"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bates</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Mächler"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Mächler</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="B Bolker"><span data-itemprop="givenNames"><span itemprop="givenName">B</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bolker</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Walker"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Walker</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline">Fitting Linear Mixed-Effects Models using lme4</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">67</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Statistical Software</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Fitting%20Linear%20Mixed-Effects%20Models%20using%20lme4"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib6"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Bechara"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bechara</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="H Damasio"><span data-itemprop="givenNames"><span itemprop="givenName">H</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Damasio</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Tranel"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Tranel</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AR Damasio"><span data-itemprop="givenNames"><span itemprop="givenName">AR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Damasio</span></span> </li> </ol><time itemprop="datePublished" datetime="1997">1997</time><span itemprop="headline">Deciding advantageously before knowing the advantageous strategy</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">275</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Science</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1293</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1295</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Deciding%20advantageously%20before%20knowing%20the%20advantageous%20strategy"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib7"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Bernoulli"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bernoulli</span></span> </li> </ol><time itemprop="datePublished" datetime="1954">1954</time><span itemprop="headline">Exposition of a New Theory on the Measurement of Risk</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">22</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Econometrica: Journal of the Econometric Society</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Exposition%20of%20a%20New%20Theory%20on%20the%20Measurement%20of%20Risk"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib8"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Biderman"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Biderman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Bakkour"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bakkour</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Shohamy"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shohamy</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><span itemprop="headline">What Are Memories For? The Hippocampus Bridges Past Experience with Future Decisions</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">24</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Trends in Cognitive Sciences</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">542</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">556</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=What%20Are%20Memories%20For?%20The%20Hippocampus%20Bridges%20Past%20Experience%20with%20Future%20Decisions"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib9"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AR Blais"><span data-itemprop="givenNames"><span itemprop="givenName">AR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Blais</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EU Weber"><span data-itemprop="givenNames"><span itemprop="givenName">EU</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Weber</span></span> </li> </ol><time itemprop="datePublished" datetime="2006">2006</time><span itemprop="headline">A Domain-Specific Risk-Taking (DOSPERT) scale for adult populations</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">1</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Judgment and Decision Making</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">33</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">47</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20Domain-Specific%20Risk-Taking%20(DOSPERT)%20scale%20for%20adult%20populations"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib10"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SJ Blakemore"><span data-itemprop="givenNames"><span itemprop="givenName">SJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Blakemore</span></span> </li> </ol><time itemprop="datePublished" datetime="2008">2008</time><span itemprop="headline">The social brain in adolescence</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">9</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Reviews. Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">267</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">277</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20social%20brain%20in%20adolescence"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib11"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AM Bornstein"><span data-itemprop="givenNames"><span itemprop="givenName">AM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bornstein</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MW Khaw"><span data-itemprop="givenNames"><span itemprop="givenName">MW</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Khaw</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Shohamy"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shohamy</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ND Daw"><span data-itemprop="givenNames"><span itemprop="givenName">ND</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Daw</span></span> </li> </ol><time itemprop="datePublished" datetime="2017">2017</time><span itemprop="headline">Reminders of past choices bias decisions for reward in humans</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">8</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Communications</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Reminders%20of%20past%20choices%20bias%20decisions%20for%20reward%20in%20humans"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib12"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BR Braams"><span data-itemprop="givenNames"><span itemprop="givenName">BR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Braams</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ACK Duijvenvoorde"><span data-itemprop="givenNames"><span itemprop="givenName">ACK</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Duijvenvoorde</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JS Peper"><span data-itemprop="givenNames"><span itemprop="givenName">JS</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Peper</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Crone"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Crone</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline" content="Longitudinal changes in adolescent risk-taking: a comprehensive study of neural responses to rewards, puberta…">Longitudinal changes in adolescent risk-taking: a comprehensive study of neural responses to rewards, pubertal development, and risk-taking behavior</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">35</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">The Journal of Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">7226</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">7238</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Longitudinal%20changes%20in%20adolescent%20risk-taking:%20a%20comprehensive%20study%20of%20neural%20responses%20to%20rewards,%20puberta%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib13"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MB Brodeur"><span data-itemprop="givenNames"><span itemprop="givenName">MB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Brodeur</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="E Dionne-Dostie"><span data-itemprop="givenNames"><span itemprop="givenName">E</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dionne-Dostie</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="T Montreuil"><span data-itemprop="givenNames"><span itemprop="givenName">T</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Montreuil</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Lepage"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lepage</span></span> </li> </ol><time itemprop="datePublished" datetime="2010">2010</time><span itemprop="headline" content="The Bank of Standardized Stimuli (BOSS), a new set of 480 normative photos of objects to be used as visual st…">The Bank of Standardized Stimuli (BOSS), a new set of 480 normative photos of objects to be used as visual stimuli in cognitive research</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">5</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">PLOS ONE</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20Bank%20of%20Standardized%20Stimuli%20(BOSS),%20a%20new%20set%20of%20480%20normative%20photos%20of%20objects%20to%20be%20used%20as%20visual%20st%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib14"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MB Brodeur"><span data-itemprop="givenNames"><span itemprop="givenName">MB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Brodeur</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Guérard"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Guérard</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Bouras"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bouras</span></span> </li> </ol><time itemprop="datePublished" datetime="2014">2014</time><span itemprop="headline">Bank of Standardized Stimuli (BOSS) phase II: 930 new normative photos</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">9</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">PLOS ONE</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Bank%20of%20Standardized%20Stimuli%20(BOSS)%20phase%20II:%20930%20new%20normative%20photos"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib15"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BJ Casey"><span data-itemprop="givenNames"><span itemprop="givenName">BJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Casey</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Getz"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Getz</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Galvan"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Galvan</span></span> </li> </ol><time itemprop="datePublished" datetime="2008">2008</time><span itemprop="headline">The adolescent brain</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">28</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Developmental Review</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">62</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">77</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20adolescent%20brain"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib16"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RD Cazé"><span data-itemprop="givenNames"><span itemprop="givenName">RD</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Cazé</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MAA Meer"><span data-itemprop="givenNames"><span itemprop="givenName">MAA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Meer</span></span> </li> </ol><time itemprop="datePublished" datetime="2013">2013</time><span itemprop="headline">Adaptive properties of differential learning rates for positive and negative outcomes</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">107</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Biological Cybernetics</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">711</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">719</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Adaptive%20properties%20of%20differential%20learning%20rates%20for%20positive%20and%20negative%20outcomes"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib17"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="V Chambon"><span data-itemprop="givenNames"><span itemprop="givenName">V</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Chambon</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="H Théro"><span data-itemprop="givenNames"><span itemprop="givenName">H</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Théro</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Vidal"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Vidal</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="H Vandendriessche"><span data-itemprop="givenNames"><span itemprop="givenName">H</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Vandendriessche</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="P Haggard"><span data-itemprop="givenNames"><span itemprop="givenName">P</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Haggard</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Palminteri"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Palminteri</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><span itemprop="headline">Information about action outcomes differentially affects learning from self-determined versus imposed choices</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">4</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Human Behaviour</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1067</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1079</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Information%20about%20action%20outcomes%20differentially%20affects%20learning%20from%20self-determined%20versus%20imposed%20choices"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib18"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Christakou"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Christakou</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SJ Gershman"><span data-itemprop="givenNames"><span itemprop="givenName">SJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Gershman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Niv"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Niv</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Simmons"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Simmons</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Brammer"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Brammer</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Rubia"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rubia</span></span> </li> </ol><time itemprop="datePublished" datetime="2013">2013</time><span itemprop="headline">Neural and Psychological Maturation of Decision-making in Adolescence and Young Adulthood</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">25</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Cognitive Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1807</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1823</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Neural%20and%20Psychological%20Maturation%20of%20Decision-making%20in%20Adolescence%20and%20Young%20Adulthood"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib19"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RHB Christensen"><span data-itemprop="givenNames"><span itemprop="givenName">RHB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Christensen</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><a itemprop="url" href="https://github.com/runehaubo/ordinal"><span itemprop="headline">ordinal: Regression Models for Ordinal Data</span></a><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"><span itemprop="name">https://github.com/runehaubo/ordinal</span><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=https://github.com/runehaubo/ordinal"> </span></span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=ordinal:%20Regression%20Models%20for%20Ordinal%20Data"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib20"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MM Chun"><span data-itemprop="givenNames"><span itemprop="givenName">MM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Chun</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="NB Turk-Browne"><span data-itemprop="givenNames"><span itemprop="givenName">NB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Turk-Browne</span></span> </li> </ol><time itemprop="datePublished" datetime="2007">2007</time><span itemprop="headline">Interactions between attention and memory</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">17</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Current Opinion in Neurobiology</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">177</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">184</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Interactions%20between%20attention%20and%20memory"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib21"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="J Cockburn"><span data-itemprop="givenNames"><span itemprop="givenName">J</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Cockburn</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AGE Collins"><span data-itemprop="givenNames"><span itemprop="givenName">AGE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Collins</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MJ Frank"><span data-itemprop="givenNames"><span itemprop="givenName">MJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Frank</span></span> </li> </ol><time itemprop="datePublished" datetime="2014">2014</time><span itemprop="headline">A reinforcement learning mechanism responsible for the valuation of free choice</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">83</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Neuron</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">551</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">557</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20reinforcement%20learning%20mechanism%20responsible%20for%20the%20valuation%20of%20free%20choice"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib22"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="J Cohen"><span data-itemprop="givenNames"><span itemprop="givenName">J</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Cohen</span></span> </li> </ol><time itemprop="datePublished" datetime="1992">1992</time><span itemprop="headline">A power primer</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">112</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Psychological Bulletin</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">155</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">159</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20power%20primer"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib23"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JR Cohen"><span data-itemprop="givenNames"><span itemprop="givenName">JR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Cohen</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RF Asarnow"><span data-itemprop="givenNames"><span itemprop="givenName">RF</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Asarnow</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="FW Sabb"><span data-itemprop="givenNames"><span itemprop="givenName">FW</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Sabb</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RM Bilder"><span data-itemprop="givenNames"><span itemprop="givenName">RM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bilder</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SY Bookheimer"><span data-itemprop="givenNames"><span itemprop="givenName">SY</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bookheimer</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BJ Knowlton"><span data-itemprop="givenNames"><span itemprop="givenName">BJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Knowlton</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RA Poldrack"><span data-itemprop="givenNames"><span itemprop="givenName">RA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Poldrack</span></span> </li> </ol><time itemprop="datePublished" datetime="2010">2010</time><span itemprop="headline">A unique adolescent response to reward prediction errors</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">13</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">669</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">671</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20unique%20adolescent%20response%20to%20reward%20prediction%20errors"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib24"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SML Cox"><span data-itemprop="givenNames"><span itemprop="givenName">SML</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Cox</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MJ Frank"><span data-itemprop="givenNames"><span itemprop="givenName">MJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Frank</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Larcher"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Larcher</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="LK Fellows"><span data-itemprop="givenNames"><span itemprop="givenName">LK</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Fellows</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CA Clark"><span data-itemprop="givenNames"><span itemprop="givenName">CA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Clark</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Leyton"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Leyton</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Dagher"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dagher</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline">Striatal D1 and D2 signaling differentially predict learning from positive and negative outcomes</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">109</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">NeuroImage</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">95</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">101</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Striatal%20D1%20and%20D2%20signaling%20differentially%20predict%20learning%20from%20positive%20and%20negative%20outcomes"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib25"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="W Dabney"><span data-itemprop="givenNames"><span itemprop="givenName">W</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dabney</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Z Kurth-Nelson"><span data-itemprop="givenNames"><span itemprop="givenName">Z</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kurth-Nelson</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Uchida"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Uchida</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CK Starkweather"><span data-itemprop="givenNames"><span itemprop="givenName">CK</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Starkweather</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Hassabis"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hassabis</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Munos"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Munos</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Botvinick"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Botvinick</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><span itemprop="headline">A distributional code for value in dopamine-based reinforcement learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">577</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">671</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">675</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20distributional%20code%20for%20value%20in%20dopamine-based%20reinforcement%20learning"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib26"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JY Davidow"><span data-itemprop="givenNames"><span itemprop="givenName">JY</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Davidow</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Foerde"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Foerde</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Galván"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Galván</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Shohamy"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shohamy</span></span> </li> </ol><time itemprop="datePublished" datetime="2016">2016</time><span itemprop="headline">An Upside to Reward Sensitivity: The Hippocampus Supports Enhanced Reinforcement Learning in Adolescence</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">92</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Neuron</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">93</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">99</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=An%20Upside%20to%20Reward%20Sensitivity:%20The%20Hippocampus%20Supports%20Enhanced%20Reinforcement%20Learning%20in%20Adolescence"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib27"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ND Daw"><span data-itemprop="givenNames"><span itemprop="givenName">ND</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Daw</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Kakade"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kakade</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="P Dayan"><span data-itemprop="givenNames"><span itemprop="givenName">P</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dayan</span></span> </li> </ol><time itemprop="datePublished" datetime="2002">2002</time><span itemprop="headline">Opponent interactions between serotonin and dopamine</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">15</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Neural Networks</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">603</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">616</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Opponent%20interactions%20between%20serotonin%20and%20dopamine"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib28"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="P Dayan"><span data-itemprop="givenNames"><span itemprop="givenName">P</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dayan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Kakade"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kakade</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="PR Montague"><span data-itemprop="givenNames"><span itemprop="givenName">PR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Montague</span></span> </li> </ol><time itemprop="datePublished" datetime="2000">2000</time><span itemprop="headline">Learning and selective attention</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">3</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1218</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1223</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Learning%20and%20selective%20attention"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib29"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JH Decker"><span data-itemprop="givenNames"><span itemprop="givenName">JH</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Decker</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="FS Lourenco"><span data-itemprop="givenNames"><span itemprop="givenName">FS</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lourenco</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BB Doll"><span data-itemprop="givenNames"><span itemprop="givenName">BB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Doll</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CA Hartley"><span data-itemprop="givenNames"><span itemprop="givenName">CA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hartley</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline">Experiential reward learning outweighs instruction prior to adulthood</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">15</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Cognitive, Affective & Behavioral Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">310</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">320</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Experiential%20reward%20learning%20outweighs%20instruction%20prior%20to%20adulthood"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib30"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="IN Defoe"><span data-itemprop="givenNames"><span itemprop="givenName">IN</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Defoe</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JS Dubas"><span data-itemprop="givenNames"><span itemprop="givenName">JS</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dubas</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="B Figner"><span data-itemprop="givenNames"><span itemprop="givenName">B</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Figner</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MAG Aken"><span data-itemprop="givenNames"><span itemprop="givenName">MAG</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Aken</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline">A meta-analysis on age differences in risky decision making: adolescents versus children and adults</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">141</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Psychological Bulletin</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">48</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">84</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20meta-analysis%20on%20age%20differences%20in%20risky%20decision%20making:%20adolescents%20versus%20children%20and%20adults"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib31"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="DG Dillon"><span data-itemprop="givenNames"><span itemprop="givenName">DG</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dillon</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="DA Pizzagalli"><span data-itemprop="givenNames"><span itemprop="givenName">DA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Pizzagalli</span></span> </li> </ol><time itemprop="datePublished" datetime="2018">2018</time><span itemprop="headline">Mechanisms of Memory Disruption in Depression</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">41</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Trends in Neurosciences</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">137</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">149</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Mechanisms%20of%20Memory%20Disruption%20in%20Depression"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib32"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Duncan"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Duncan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Semmler"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Semmler</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Shohamy"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shohamy</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><span itemprop="headline">Modulating the Use of Multiple Memory Systems in Value-based Decisions with Contextual Novelty</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">31</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Cognitive Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1455</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1467</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Modulating%20the%20Use%20of%20Multiple%20Memory%20Systems%20in%20Value-based%20Decisions%20with%20Contextual%20Novelty"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib33"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JE Dunsmoor"><span data-itemprop="givenNames"><span itemprop="givenName">JE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dunsmoor</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="VP Murty"><span data-itemprop="givenNames"><span itemprop="givenName">VP</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Murty</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Davachi"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Davachi</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Phelps"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Phelps</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline">Emotional learning selectively and retroactively strengthens memories for related events</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">520</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">345</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">348</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Emotional%20learning%20selectively%20and%20retroactively%20strengthens%20memories%20for%20related%20events"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib34"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Ergo"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ergo</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="E De Loof"><span data-itemprop="givenNames"><span itemprop="givenName">E</span></span><span data-itemprop="familyNames"><span itemprop="familyName">De Loof</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="T Verguts"><span data-itemprop="givenNames"><span itemprop="givenName">T</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Verguts</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><span itemprop="headline">Reward Prediction Error and Declarative Memory</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">24</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Trends in Cognitive Sciences</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">388</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">397</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Reward%20Prediction%20Error%20and%20Declarative%20Memory"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib35"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MJ Frank"><span data-itemprop="givenNames"><span itemprop="givenName">MJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Frank</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="LC Seeberger"><span data-itemprop="givenNames"><span itemprop="givenName">LC</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Seeberger</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RC O’reilly"><span data-itemprop="givenNames"><span itemprop="givenName">RC</span></span><span data-itemprop="familyNames"><span itemprop="familyName">O’reilly</span></span> </li> </ol><time itemprop="datePublished" datetime="2004">2004</time><span itemprop="headline">By carrot or by stick: cognitive reinforcement learning in parkinsonism</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">306</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Science</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1940</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1943</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=By%20carrot%20or%20by%20stick:%20cognitive%20reinforcement%20learning%20in%20parkinsonism"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib36"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MJ Frank"><span data-itemprop="givenNames"><span itemprop="givenName">MJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Frank</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AA Moustafa"><span data-itemprop="givenNames"><span itemprop="givenName">AA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Moustafa</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="HM Haughey"><span data-itemprop="givenNames"><span itemprop="givenName">HM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Haughey</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="T Curran"><span data-itemprop="givenNames"><span itemprop="givenName">T</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Curran</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="KE Hutchison"><span data-itemprop="givenNames"><span itemprop="givenName">KE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hutchison</span></span> </li> </ol><time itemprop="datePublished" datetime="2007">2007</time><span itemprop="headline">Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">104</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">PNAS</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">16311</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">16316</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Genetic%20triple%20dissociation%20reveals%20multiple%20roles%20for%20dopamine%20in%20reinforcement%20learning"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib37"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MA Gaddy"><span data-itemprop="givenNames"><span itemprop="givenName">MA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Gaddy</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RE Ingram"><span data-itemprop="givenNames"><span itemprop="givenName">RE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ingram</span></span> </li> </ol><time itemprop="datePublished" datetime="2014">2014</time><span itemprop="headline">A meta-analytic review of mood-congruent implicit memory in depressed mood</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">34</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Clinical Psychology Review</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">402</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">416</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20meta-analytic%20review%20of%20mood-congruent%20implicit%20memory%20in%20depressed%20mood"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib38"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Galvan"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Galvan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="TA Hare"><span data-itemprop="givenNames"><span itemprop="givenName">TA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hare</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CE Parra"><span data-itemprop="givenNames"><span itemprop="givenName">CE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Parra</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="J Penn"><span data-itemprop="givenNames"><span itemprop="givenName">J</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Penn</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="H Voss"><span data-itemprop="givenNames"><span itemprop="givenName">H</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Voss</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="G Glover"><span data-itemprop="givenNames"><span itemprop="givenName">G</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Glover</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BJ Casey"><span data-itemprop="givenNames"><span itemprop="givenName">BJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Casey</span></span> </li> </ol><time itemprop="datePublished" datetime="2006">2006</time><span itemprop="headline" content="Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in …">Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">26</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">The Journal of Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">6885</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">6892</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Earlier%20development%20of%20the%20accumbens%20relative%20to%20orbitofrontal%20cortex%20might%20underlie%20risk-taking%20behavior%20in%20%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib39"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Galván"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Galván</span></span> </li> </ol><time itemprop="datePublished" datetime="2013">2013</time><span itemprop="headline">The Teenage Brain: Sensitivity to Rewards</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">22</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Current Directions in Psychological Science</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">88</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">93</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20Teenage%20Brain:%20Sensitivity%20to%20Rewards"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib40"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Galván"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Galván</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="KM McGlennen"><span data-itemprop="givenNames"><span itemprop="givenName">KM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">McGlennen</span></span> </li> </ol><time itemprop="datePublished" datetime="2013">2013</time><span itemprop="headline">Enhanced striatal sensitivity to aversive reinforcement in adolescents versus adults</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">25</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Cognitive Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">284</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">296</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Enhanced%20striatal%20sensitivity%20to%20aversive%20reinforcement%20in%20adolescents%20versus%20adults"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib41"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SJ Gershman"><span data-itemprop="givenNames"><span itemprop="givenName">SJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Gershman</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline">Do learning rates adapt to the distribution of rewards?</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">22</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Psychonomic Bulletin & Review</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1320</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1327</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Do%20learning%20rates%20adapt%20to%20the%20distribution%20of%20rewards?"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib42"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="TU Hauser"><span data-itemprop="givenNames"><span itemprop="givenName">TU</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hauser</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Iannaccone"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Iannaccone</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Walitza"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Walitza</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Brandeis"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Brandeis</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Brem"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Brem</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline" content="Cognitive flexibility in adolescence: neural and behavioral mechanisms of reward prediction error processing …">Cognitive flexibility in adolescence: neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">104</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">NeuroImage</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">347</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">354</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Cognitive%20flexibility%20in%20adolescence:%20neural%20and%20behavioral%20mechanisms%20of%20reward%20prediction%20error%20processing%20%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib43"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="PC Holland"><span data-itemprop="givenNames"><span itemprop="givenName">PC</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Holland</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="FL Schiffino"><span data-itemprop="givenNames"><span itemprop="givenName">FL</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Schiffino</span></span> </li> </ol><time itemprop="datePublished" datetime="2016">2016</time><span itemprop="headline">Mini-review: Prediction errors, attention and associative learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">131</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Neurobiology of Learning and Memory</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">207</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">215</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Mini-review:%20Prediction%20errors,%20attention%20and%20associative%20learning"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib44"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AI Jang"><span data-itemprop="givenNames"><span itemprop="givenName">AI</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Jang</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MR Nassar"><span data-itemprop="givenNames"><span itemprop="givenName">MR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Nassar</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="DG Dillon"><span data-itemprop="givenNames"><span itemprop="givenName">DG</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dillon</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MJ Frank"><span data-itemprop="givenNames"><span itemprop="givenName">MJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Frank</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><span itemprop="headline">Positive reward prediction errors during decision-making strengthen memory encoding</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">3</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Human Behaviour</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">719</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">732</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Positive%20reward%20prediction%20errors%20during%20decision-making%20strengthen%20memory%20encoding"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib45"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RM Jones"><span data-itemprop="givenNames"><span itemprop="givenName">RM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Jones</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="LH Somerville"><span data-itemprop="givenNames"><span itemprop="givenName">LH</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Somerville</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="J Li"><span data-itemprop="givenNames"><span itemprop="givenName">J</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Li</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EJ Ruberry"><span data-itemprop="givenNames"><span itemprop="givenName">EJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ruberry</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Powers"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Powers</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Mehta"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Mehta</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="J Dyke"><span data-itemprop="givenNames"><span itemprop="givenName">J</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dyke</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BJ Casey"><span data-itemprop="givenNames"><span itemprop="givenName">BJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Casey</span></span> </li> </ol><time itemprop="datePublished" datetime="2014">2014</time><span itemprop="headline">Adolescent-specific patterns of behavior and neural activity during social reinforcement learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">14</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Cognitive, Affective & Behavioral Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">683</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">697</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Adolescent-specific%20patterns%20of%20behavior%20and%20neural%20activity%20during%20social%20reinforcement%20learning"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib46"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Kahneman"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kahneman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Tversky"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Tversky</span></span> </li> </ol><time itemprop="datePublished" datetime="1979">1979</time><span itemprop="headline">Prospect Theory: An Analysis of Decision under Risk</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">47</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Econometrica: Journal of the Econometric Society</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Prospect%20Theory:%20An%20Analysis%20of%20Decision%20under%20Risk"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib47"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="F Kalbe"><span data-itemprop="givenNames"><span itemprop="givenName">F</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kalbe</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Schwabe"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Schwabe</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><span itemprop="headline">Beyond arousal: Prediction error related to aversive events promotes episodic memory formation</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">46</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Experimental Psychology. Learning, Memory, and Cognition</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">234</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">246</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Beyond%20arousal:%20Prediction%20error%20related%20to%20aversive%20events%20promotes%20episodic%20memory%20formation"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib48"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Kann"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kann</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="T McManus"><span data-itemprop="givenNames"><span itemprop="givenName">T</span></span><span data-itemprop="familyNames"><span itemprop="familyName">McManus</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="WA Harris"><span data-itemprop="givenNames"><span itemprop="givenName">WA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Harris</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SL Shanklin"><span data-itemprop="givenNames"><span itemprop="givenName">SL</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shanklin</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="KH Flint"><span data-itemprop="givenNames"><span itemprop="givenName">KH</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Flint</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="B Queen"><span data-itemprop="givenNames"><span itemprop="givenName">B</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Queen</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Lowry"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lowry</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Chyen"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Chyen</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Whittle"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Whittle</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="J Thornton"><span data-itemprop="givenNames"><span itemprop="givenName">J</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Thornton</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="C Lim"><span data-itemprop="givenNames"><span itemprop="givenName">C</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lim</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Bradford"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bradford</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Yamakawa"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Yamakawa</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Leon"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Leon</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Brener"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Brener</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="KA Ethier"><span data-itemprop="givenNames"><span itemprop="givenName">KA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ethier</span></span> </li> </ol><time itemprop="datePublished" datetime="2018">2018</time><span itemprop="headline">Youth Risk Behavior Surveillance — United States, 2017</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">67</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">MMWR. Surveillance Summaries</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">114</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Youth%20Risk%20Behavior%20Surveillance%20%E2%80%94%20United%20States,%202017"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib49"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="PL Katzman"><span data-itemprop="givenNames"><span itemprop="givenName">PL</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Katzman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CA Hartley"><span data-itemprop="givenNames"><span itemprop="givenName">CA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hartley</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><span itemprop="headline">The value of choice facilitates subsequent memory across development</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">199</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Cognition</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20value%20of%20choice%20facilitates%20subsequent%20memory%20across%20development"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib50"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="W Kuyken"><span data-itemprop="givenNames"><span itemprop="givenName">W</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kuyken</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Howell"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Howell</span></span> </li> </ol><time itemprop="datePublished" datetime="2006">2006</time><span itemprop="headline">Facets of autobiographical memory in adolescents with major depressive disorder and never-depressed controls</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">20</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Cognition & Emotion</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">466</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">487</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Facets%20of%20autobiographical%20memory%20in%20adolescents%20with%20major%20depressive%20disorder%20and%20never-depressed%20controls"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib51"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="FS Lee"><span data-itemprop="givenNames"><span itemprop="givenName">FS</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lee</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="H Heimer"><span data-itemprop="givenNames"><span itemprop="givenName">H</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Heimer</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JN Giedd"><span data-itemprop="givenNames"><span itemprop="givenName">JN</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Giedd</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ES Lein"><span data-itemprop="givenNames"><span itemprop="givenName">ES</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lein</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Šestan"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Šestan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="DR Weinberger"><span data-itemprop="givenNames"><span itemprop="givenName">DR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Weinberger</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BJ Casey"><span data-itemprop="givenNames"><span itemprop="givenName">BJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Casey</span></span> </li> </ol><time itemprop="datePublished" datetime="2014">2014</time><span itemprop="headline">Mental health. Adolescent mental health–opportunity and obligation</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">346</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Science</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">547</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">549</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Mental%20health.%20Adolescent%20mental%20health%E2%80%93opportunity%20and%20obligation"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib52"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="G Lefebvre"><span data-itemprop="givenNames"><span itemprop="givenName">G</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lefebvre</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Lebreton"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lebreton</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="F Meyniel"><span data-itemprop="givenNames"><span itemprop="givenName">F</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Meyniel</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Bourgeois-Gironde"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bourgeois-Gironde</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Palminteri"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Palminteri</span></span> </li> </ol><time itemprop="datePublished" datetime="2017">2017</time><span itemprop="headline">Behavioural and neural characterization of optimistic reinforcement learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">1</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Human Behaviour</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Behavioural%20and%20neural%20characterization%20of%20optimistic%20reinforcement%20learning"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib53"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Lengyel"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lengyel</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="P Dayan"><span data-itemprop="givenNames"><span itemprop="givenName">P</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dayan</span></span> </li> </ol><time itemprop="datePublished" datetime="2008">2008</time><span itemprop="headline">Advances in Neural Information Processing Systems</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Advances%20in%20Neural%20Information%20Processing%20Systems"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib54"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JE Lisman"><span data-itemprop="givenNames"><span itemprop="givenName">JE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lisman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AA Grace"><span data-itemprop="givenNames"><span itemprop="givenName">AA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Grace</span></span> </li> </ol><time itemprop="datePublished" datetime="2005">2005</time><span itemprop="headline">The hippocampal-VTA loop: controlling the entry of information into long-term memory</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">46</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Neuron</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">703</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">713</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20hippocampal-VTA%20loop:%20controlling%20the%20entry%20of%20information%20into%20long-term%20memory"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib55"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Ludvig"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ludvig</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CR Madan"><span data-itemprop="givenNames"><span itemprop="givenName">CR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Madan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N McMillan"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">McMillan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Xu"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Xu</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ML Spetch"><span data-itemprop="givenNames"><span itemprop="givenName">ML</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Spetch</span></span> </li> </ol><time itemprop="datePublished" datetime="2018">2018</time><span itemprop="headline">Living near the edge: How extreme outcomes and their neighbors drive risky choice</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">147</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Experimental Psychology. General</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1905</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1918</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Living%20near%20the%20edge:%20How%20extreme%20outcomes%20and%20their%20neighbors%20drive%20risky%20choice"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib56"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="B Luna"><span data-itemprop="givenNames"><span itemprop="givenName">B</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Luna</span></span> </li> </ol><time itemprop="datePublished" datetime="2009">2009</time><span itemprop="headline">Developmental changes in cognitive control through adolescence</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">37</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Advances in Child Development and Behavior</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">233</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">278</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Developmental%20changes%20in%20cognitive%20control%20through%20adolescence"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib57"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CR Madan"><span data-itemprop="givenNames"><span itemprop="givenName">CR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Madan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Ludvig"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ludvig</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ML Spetch"><span data-itemprop="givenNames"><span itemprop="givenName">ML</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Spetch</span></span> </li> </ol><time itemprop="datePublished" datetime="2014">2014</time><span itemprop="headline">Remembering the best and worst of times: memories for extreme outcomes bias risky decisions</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">21</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Psychonomic Bulletin & Review</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">629</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">636</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Remembering%20the%20best%20and%20worst%20of%20times:%20memories%20for%20extreme%20outcomes%20bias%20risky%20decisions"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib58"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CR Madan"><span data-itemprop="givenNames"><span itemprop="givenName">CR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Madan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Ludvig"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ludvig</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ML Spetch"><span data-itemprop="givenNames"><span itemprop="givenName">ML</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Spetch</span></span> </li> </ol><time itemprop="datePublished" datetime="2017">2017</time><span itemprop="headline">The role of memory in distinguishing risky decisions from experience and description</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">70</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Quarterly Journal of Experimental Psychology</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">2048</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">2059</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20role%20of%20memory%20in%20distinguishing%20risky%20decisions%20from%20experience%20and%20description"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib59"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SL Master"><span data-itemprop="givenNames"><span itemprop="givenName">SL</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Master</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MK Eckstein"><span data-itemprop="givenNames"><span itemprop="givenName">MK</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Eckstein</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Gotlieb"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Gotlieb</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Dahl"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dahl</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Wilbrecht"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Wilbrecht</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AGE Collins"><span data-itemprop="givenNames"><span itemprop="givenName">AGE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Collins</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><span itemprop="headline">Distentangling the systems contributing to changes in learning during adolescence</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">41</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Developmental Cognitive Neuroscience</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Distentangling%20the%20systems%20contributing%20to%20changes%20in%20learning%20during%20adolescence"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib60"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="J Michely"><span data-itemprop="givenNames"><span itemprop="givenName">J</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Michely</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="E Eldar"><span data-itemprop="givenNames"><span itemprop="givenName">E</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Eldar</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Erdman"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Erdman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="IM Martin"><span data-itemprop="givenNames"><span itemprop="givenName">IM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Martin</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RJ Dolan"><span data-itemprop="givenNames"><span itemprop="givenName">RJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dolan</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><span itemprop="headline">SSRIs Modulate Asymmetric Learning from Reward and Punishment</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">bioRxiv</span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=SSRIs%20Modulate%20Asymmetric%20Learning%20from%20Reward%20and%20Punishment"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib61"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="O Mihatsch"><span data-itemprop="givenNames"><span itemprop="givenName">O</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Mihatsch</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Neuneier"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Neuneier</span></span> </li> </ol><time itemprop="datePublished" datetime="2002">2002</time><span itemprop="headline">Risk-Sensitive Reinforcement Learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">49</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Machine Learning</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">267</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">290</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Risk-Sensitive%20Reinforcement%20Learning"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib62"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Mogg"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Mogg</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BP Bradley"><span data-itemprop="givenNames"><span itemprop="givenName">BP</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bradley</span></span> </li> </ol><time itemprop="datePublished" datetime="2016">2016</time><span itemprop="headline">Anxiety and attention to threat: Cognitive mechanisms and treatment with attention bias modification</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">87</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Behaviour Research and Therapy</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">76</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">108</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Anxiety%20and%20attention%20to%20threat:%20Cognitive%20mechanisms%20and%20treatment%20with%20attention%20bias%20modification"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib63"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Moutoussis"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Moutoussis</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ET Bullmore"><span data-itemprop="givenNames"><span itemprop="givenName">ET</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bullmore</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="IM Goodyer"><span data-itemprop="givenNames"><span itemprop="givenName">IM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Goodyer</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="P Fonagy"><span data-itemprop="givenNames"><span itemprop="givenName">P</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Fonagy</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="PB Jones"><span data-itemprop="givenNames"><span itemprop="givenName">PB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Jones</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RJ Dolan"><span data-itemprop="givenNames"><span itemprop="givenName">RJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dolan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="P Dayan"><span data-itemprop="givenNames"><span itemprop="givenName">P</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dayan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Organization" itemprop="author"><span itemprop="name">Neuroscience in Psychiatry Network Research Consortium</span> </li> </ol><time itemprop="datePublished" datetime="2018">2018</time><span itemprop="headline">Change, stability, and instability in the Pavlovian guidance of behaviour from adolescence to young adulthood</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">14</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">PLOS Computational Biology</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Change,%20stability,%20and%20instability%20in%20the%20Pavlovian%20guidance%20of%20behaviour%20from%20adolescence%20to%20young%20adulthood"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib64"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="VP Murty"><span data-itemprop="givenNames"><span itemprop="givenName">VP</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Murty</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S DuBrow"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">DuBrow</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Davachi"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Davachi</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline">The simple act of choosing influences declarative memory</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">35</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">The Journal of Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">6255</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">6264</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20simple%20act%20of%20choosing%20influences%20declarative%20memory"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib65"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="VP Murty"><span data-itemprop="givenNames"><span itemprop="givenName">VP</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Murty</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="O FeldmanHall"><span data-itemprop="givenNames"><span itemprop="givenName">O</span></span><span data-itemprop="familyNames"><span itemprop="familyName">FeldmanHall</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="LE Hunter"><span data-itemprop="givenNames"><span itemprop="givenName">LE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hunter</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Phelps"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Phelps</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Davachi"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Davachi</span></span> </li> </ol><time itemprop="datePublished" datetime="2016">2016</time><span itemprop="headline">Episodic memories predict adaptive value-based decision-making</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">145</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Experimental Psychology</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">548</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">558</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Episodic%20memories%20predict%20adaptive%20value-based%20decision-making"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib66"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Nardou"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Nardou</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EM Lewis"><span data-itemprop="givenNames"><span itemprop="givenName">EM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Lewis</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Rothhaas"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rothhaas</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Xu"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Xu</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Yang"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Yang</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="E Boyden"><span data-itemprop="givenNames"><span itemprop="givenName">E</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Boyden</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="G Dölen"><span data-itemprop="givenNames"><span itemprop="givenName">G</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dölen</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><span itemprop="headline">Oxytocin-dependent reopening of a social reward learning critical period with MDMA</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">569</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">116</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">120</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Oxytocin-dependent%20reopening%20of%20a%20social%20reward%20learning%20critical%20period%20with%20MDMA"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib67"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Niv"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Niv</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JA Edlund"><span data-itemprop="givenNames"><span itemprop="givenName">JA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Edlund</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="P Dayan"><span data-itemprop="givenNames"><span itemprop="givenName">P</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dayan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JP O’Doherty"><span data-itemprop="givenNames"><span itemprop="givenName">JP</span></span><span data-itemprop="familyNames"><span itemprop="familyName">O’Doherty</span></span> </li> </ol><time itemprop="datePublished" datetime="2012">2012</time><span itemprop="headline">Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">32</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">The Journal of Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">551</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">562</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Neural%20prediction%20errors%20reveal%20a%20risk-sensitive%20reinforcement-learning%20process%20in%20the%20human%20brain"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib68"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Nussenbaum"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Nussenbaum</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CA Hartley"><span data-itemprop="givenNames"><span itemprop="givenName">CA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hartley</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><span itemprop="headline">Reinforcement learning across development: What insights can we draw from a decade of research?</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">40</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Developmental Cognitive Neuroscience</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Reinforcement%20learning%20across%20development:%20What%20insights%20can%20we%20draw%20from%20a%20decade%20of%20research?"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib69"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="T Paus"><span data-itemprop="givenNames"><span itemprop="givenName">T</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Paus</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Keshavan"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Keshavan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JN Giedd"><span data-itemprop="givenNames"><span itemprop="givenName">JN</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Giedd</span></span> </li> </ol><time itemprop="datePublished" datetime="2008">2008</time><span itemprop="headline">Why do many psychiatric disorders emerge during adolescence?</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">9</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Reviews. Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">947</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">957</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Why%20do%20many%20psychiatric%20disorders%20emerge%20during%20adolescence?"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib70"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JM Pearce"><span data-itemprop="givenNames"><span itemprop="givenName">JM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Pearce</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="G Hall"><span data-itemprop="givenNames"><span itemprop="givenName">G</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hall</span></span> </li> </ol><time itemprop="datePublished" datetime="1980">1980</time><span itemprop="headline" content="A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimu…">A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">87</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Psychological Review</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">532</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">552</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20model%20for%20Pavlovian%20learning:%20variations%20in%20the%20effectiveness%20of%20conditioned%20but%20not%20of%20unconditioned%20stimu%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib71"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="TCS Potter"><span data-itemprop="givenNames"><span itemprop="givenName">TCS</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Potter</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="NV Bryce"><span data-itemprop="givenNames"><span itemprop="givenName">NV</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bryce</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CA Hartley"><span data-itemprop="givenNames"><span itemprop="givenName">CA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hartley</span></span> </li> </ol><time itemprop="datePublished" datetime="2017">2017</time><span itemprop="headline">Cognitive components underpinning the development of model-based learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">25</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Developmental Cognitive Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">272</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">280</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Cognitive%20components%20underpinning%20the%20development%20of%20model-based%20learning"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib72"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JW Pratt"><span data-itemprop="givenNames"><span itemprop="givenName">JW</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Pratt</span></span> </li> </ol><time itemprop="datePublished" datetime="1964">1964</time><span itemprop="headline">Risk Aversion in the Small and in the Large</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">32</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Econometrica: Journal of the Econometric Society</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Risk%20Aversion%20in%20the%20Small%20and%20in%20the%20Large"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib73"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="E Pulcu"><span data-itemprop="givenNames"><span itemprop="givenName">E</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Pulcu</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Browning"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Browning</span></span> </li> </ol><time itemprop="datePublished" datetime="2017">2017</time><span itemprop="headline">Affective bias as a rational response to the statistics of rewards and punishments</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">6</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">eLife</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Affective%20bias%20as%20a%20rational%20response%20to%20the%20statistics%20of%20rewards%20and%20punishments"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib74"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Organization" itemprop="author"><span itemprop="name">R Development Core Team</span></li> </ol><time itemprop="datePublished" datetime="2016">2016</time><span itemprop="headline">R: A language and environment for statistical computing</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"><span itemprop="name">R Foundation for Statistical Computing</span><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=R%20Foundation%20for%20Statistical%20Computing"> </span></span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=R:%20A%20language%20and%20environment%20for%20statistical%20computing"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib75"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Radulescu"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Radulescu</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Niv"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Niv</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="I Ballard"><span data-itemprop="givenNames"><span itemprop="givenName">I</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ballard</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><span itemprop="headline">Holistic Reinforcement Learning: The Role of Structure and Attention</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">23</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Trends in Cognitive Sciences</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">278</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">292</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Holistic%20Reinforcement%20Learning:%20The%20Role%20of%20Structure%20and%20Attention"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib76"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Radulescu"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Radulescu</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Holmes"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Holmes</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Niv"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Niv</span></span> </li> </ol><time itemprop="datePublished" datetime="2020">2020</time><a itemprop="url" href="https://doi.org/10.31234/osf.io/qdhx4"><span itemprop="headline">On the Convergent Validity of Risk Sensitivity Measures</span></a><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">PsyArXiv</span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"><span itemprop="name">https://doi.org/10.31234/osf.io/qdhx4</span><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=https://doi.org/10.31234/osf.io/qdhx4"> </span></span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=On%20the%20Convergent%20Validity%20of%20Risk%20Sensitivity%20Measures"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib77"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AE Raftery"><span data-itemprop="givenNames"><span itemprop="givenName">AE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Raftery</span></span> </li> </ol><time itemprop="datePublished" datetime="1995">1995</time><span itemprop="headline">Bayesian Model Selection in Social Research</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">25</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Sociological Methodology</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Bayesian%20Model%20Selection%20in%20Social%20Research"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib78"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AM Rodman"><span data-itemprop="givenNames"><span itemprop="givenName">AM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rodman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="KE Powers"><span data-itemprop="givenNames"><span itemprop="givenName">KE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Powers</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="LH Somerville"><span data-itemprop="givenNames"><span itemprop="givenName">LH</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Somerville</span></span> </li> </ol><time itemprop="datePublished" datetime="2017">2017</time><span itemprop="headline">Development of self-protective biases in response to social evaluative feedback</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">114</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">PNAS</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">13158</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">13163</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Development%20of%20self-protective%20biases%20in%20response%20to%20social%20evaluative%20feedback"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib79"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="GM Rosenbaum"><span data-itemprop="givenNames"><span itemprop="givenName">GM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rosenbaum</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="V Venkatraman"><span data-itemprop="givenNames"><span itemprop="givenName">V</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Venkatraman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Steinberg"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Steinberg</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JM Chein"><span data-itemprop="givenNames"><span itemprop="givenName">JM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Chein</span></span> </li> </ol><time itemprop="datePublished" datetime="2018">2018</time><span itemprop="headline">The Influences of Described and Experienced Information on Adolescent Risky Decision Making</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">47</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Developmental Review</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">23</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">43</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20Influences%20of%20Described%20and%20Experienced%20Information%20on%20Adolescent%20Risky%20Decision%20Making"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib80"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="GM Rosenbaum"><span data-itemprop="givenNames"><span itemprop="givenName">GM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rosenbaum</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CA Hartley"><span data-itemprop="givenNames"><span itemprop="givenName">CA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Hartley</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><span itemprop="headline">Developmental perspectives on risky and impulsive choice</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">374</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Developmental%20perspectives%20on%20risky%20and%20impulsive%20choice"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib81"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="GM Rosenbaum"><span data-itemprop="givenNames"><span itemprop="givenName">GM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rosenbaum</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="V Venkatraman"><span data-itemprop="givenNames"><span itemprop="givenName">V</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Venkatraman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Steinberg"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Steinberg</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JM Chein"><span data-itemprop="givenNames"><span itemprop="givenName">JM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Chein</span></span> </li> </ol><time itemprop="datePublished" datetime="2021">2021</time><span itemprop="headline" content="Do adolescents always take more risks than adults? A within-subjects developmental study of context effects o…">Do adolescents always take more risks than adults? A within-subjects developmental study of context effects on decision making and processing</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">16</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">PLOS ONE</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Do%20adolescents%20always%20take%20more%20risks%20than%20adults?%20A%20within-subjects%20developmental%20study%20of%20context%20effects%20o%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib82"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Rouhani"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rouhani</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="KA Norman"><span data-itemprop="givenNames"><span itemprop="givenName">KA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Norman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Niv"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Niv</span></span> </li> </ol><time itemprop="datePublished" datetime="2018">2018</time><span itemprop="headline">Dissociable effects of surprising rewards on learning and memory</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">44</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Experimental Psychology. Learning, Memory, and Cognition</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1430</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1443</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Dissociable%20effects%20of%20surprising%20rewards%20on%20learning%20and%20memory"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib83"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Rouhani"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rouhani</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="Y Niv"><span data-itemprop="givenNames"><span itemprop="givenName">Y</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Niv</span></span> </li> </ol><time itemprop="datePublished" datetime="2019">2019</time><span itemprop="headline" content="Depressive symptoms bias the prediction-error enhancement of memory towards negative events in reinforcement …">Depressive symptoms bias the prediction-error enhancement of memory towards negative events in reinforcement learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">236</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Psychopharmacology</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">2425</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">2435</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Depressive%20symptoms%20bias%20the%20prediction-error%20enhancement%20of%20memory%20towards%20negative%20events%20in%20reinforcement%20%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib84"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SJ Sara"><span data-itemprop="givenNames"><span itemprop="givenName">SJ</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Sara</span></span> </li> </ol><time itemprop="datePublished" datetime="2009">2009</time><span itemprop="headline">The locus coeruleus and noradrenergic modulation of cognition</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">10</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Reviews. Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">211</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">223</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20locus%20coeruleus%20and%20noradrenergic%20modulation%20of%20cognition"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib85"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CL Satterwhite"><span data-itemprop="givenNames"><span itemprop="givenName">CL</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Satterwhite</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="E Torrone"><span data-itemprop="givenNames"><span itemprop="givenName">E</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Torrone</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="E Meites"><span data-itemprop="givenNames"><span itemprop="givenName">E</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Meites</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EF Dunne"><span data-itemprop="givenNames"><span itemprop="givenName">EF</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Dunne</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="R Mahajan"><span data-itemprop="givenNames"><span itemprop="givenName">R</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Mahajan</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MCB Ocfemia"><span data-itemprop="givenNames"><span itemprop="givenName">MCB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Ocfemia</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="J Su"><span data-itemprop="givenNames"><span itemprop="givenName">J</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Su</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="F Xu"><span data-itemprop="givenNames"><span itemprop="givenName">F</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Xu</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="H Weinstock"><span data-itemprop="givenNames"><span itemprop="givenName">H</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Weinstock</span></span> </li> </ol><time itemprop="datePublished" datetime="2013">2013</time><span itemprop="headline">Sexually transmitted infections among US women and men: prevalence and incidence estimates, 2008</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">40</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Sexually Transmitted Diseases</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">187</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">193</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Sexually%20transmitted%20infections%20among%20US%20women%20and%20men:%20prevalence%20and%20incidence%20estimates,%202008"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib86"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="KW Schaie"><span data-itemprop="givenNames"><span itemprop="givenName">KW</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Schaie</span></span> </li> </ol><time itemprop="datePublished" datetime="1965">1965</time><span itemprop="headline">A general model for the study of developmental problems</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">64</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Psychological Bulletin</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">92</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">107</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20general%20model%20for%20the%20study%20of%20developmental%20problems"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib87"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MN Shadlen"><span data-itemprop="givenNames"><span itemprop="givenName">MN</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shadlen</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Shohamy"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Shohamy</span></span> </li> </ol><time itemprop="datePublished" datetime="2016">2016</time><span itemprop="headline">Decision Making and Sequential Sampling from Memory</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">90</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Neuron</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">927</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">939</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Decision%20Making%20and%20Sequential%20Sampling%20from%20Memory"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib88"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="T Sharot"><span data-itemprop="givenNames"><span itemprop="givenName">T</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Sharot</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Garrett"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Garrett</span></span> </li> </ol><time itemprop="datePublished" datetime="2016">2016</time><span itemprop="headline">Forming Beliefs: Why Valence Matters</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">20</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Trends in Cognitive Sciences</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">25</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">33</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Forming%20Beliefs:%20Why%20Valence%20Matters"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib89"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MH Silverman"><span data-itemprop="givenNames"><span itemprop="givenName">MH</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Silverman</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="K Jedd"><span data-itemprop="givenNames"><span itemprop="givenName">K</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Jedd</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="M Luciana"><span data-itemprop="givenNames"><span itemprop="givenName">M</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Luciana</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline" content="Neural networks involved in adolescent reward processing: An activation likelihood estimation meta-analysis o…">Neural networks involved in adolescent reward processing: An activation likelihood estimation meta-analysis of functional neuroimaging studies</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">122</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">NeuroImage</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">427</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">439</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Neural%20networks%20involved%20in%20adolescent%20reward%20processing:%20An%20activation%20likelihood%20estimation%20meta-analysis%20o%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib90"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="U Simonsohn"><span data-itemprop="givenNames"><span itemprop="givenName">U</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Simonsohn</span></span> </li> </ol><time itemprop="datePublished" datetime="2018">2018</time><span itemprop="headline">Two Lines: A Valid Alternative to the Invalid Testing of U-Shaped Relationships With Quadratic Regressions</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">1</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Advances in Methods and Practices in Psychological Science</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">538</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">555</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Two%20Lines:%20A%20Valid%20Alternative%20to%20the%20Invalid%20Testing%20of%20U-Shaped%20Relationships%20With%20Quadratic%20Regressions"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib91"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="LH Somerville"><span data-itemprop="givenNames"><span itemprop="givenName">LH</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Somerville</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SF Sasse"><span data-itemprop="givenNames"><span itemprop="givenName">SF</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Sasse</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MC Garrad"><span data-itemprop="givenNames"><span itemprop="givenName">MC</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Garrad</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AT Drysdale"><span data-itemprop="givenNames"><span itemprop="givenName">AT</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Drysdale</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="N Abi Akar"><span data-itemprop="givenNames"><span itemprop="givenName">N</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Abi Akar</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="C Insel"><span data-itemprop="givenNames"><span itemprop="givenName">C</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Insel</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RC Wilson"><span data-itemprop="givenNames"><span itemprop="givenName">RC</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Wilson</span></span> </li> </ol><time itemprop="datePublished" datetime="2017">2017</time><span itemprop="headline">Charting the expansion of strategic exploratory behavior during adolescence</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">146</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Experimental Psychology. General</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">155</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">164</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Charting%20the%20expansion%20of%20strategic%20exploratory%20behavior%20during%20adolescence"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib92"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Steinberg"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Steinberg</span></span> </li> </ol><time itemprop="datePublished" datetime="2008">2008</time><span itemprop="headline">A Social Neuroscience Perspective on Adolescent Risk-Taking</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">28</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Developmental Review</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">78</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">106</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=A%20Social%20Neuroscience%20Perspective%20on%20Adolescent%20Risk-Taking"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib93"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Steinberg"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Steinberg</span></span> </li> </ol><time itemprop="datePublished" datetime="2013">2013</time><span itemprop="headline">The influence of neuroscience on US Supreme Court decisions about adolescents’ criminal culpability</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">14</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Nature Reviews. Neuroscience</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">513</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">518</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=The%20influence%20of%20neuroscience%20on%20US%20Supreme%20Court%20decisions%20about%20adolescents%E2%80%99%20criminal%20culpability"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib94"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="RS Sutton"><span data-itemprop="givenNames"><span itemprop="givenName">RS</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Sutton</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="AG Barto"><span data-itemprop="givenNames"><span itemprop="givenName">AG</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Barto</span></span> </li> </ol><time itemprop="datePublished" datetime="1998">1998</time><span itemprop="headline">Reinforcement Learning: An Introduction</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">9</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">IEEE Transactions on Neural Networks</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Reinforcement%20Learning:%20An%20Introduction"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib95"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="A Tversky"><span data-itemprop="givenNames"><span itemprop="givenName">A</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Tversky</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Kahneman"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kahneman</span></span> </li> </ol><time itemprop="datePublished" datetime="1992">1992</time><span itemprop="headline">Advances in prospect theory: Cumulative representation of uncertainty</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">5</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Journal of Risk and Uncertainty</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">297</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">323</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Advances%20in%20prospect%20theory:%20Cumulative%20representation%20of%20uncertainty"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib96"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="W Bos"><span data-itemprop="givenNames"><span itemprop="givenName">W</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bos</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="MX Cohen"><span data-itemprop="givenNames"><span itemprop="givenName">MX</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Cohen</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="T Kahnt"><span data-itemprop="givenNames"><span itemprop="givenName">T</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Kahnt</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Crone"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Crone</span></span> </li> </ol><time itemprop="datePublished" datetime="2012">2012</time><span itemprop="headline">Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">22</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Cerebral Cortex</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">1247</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">1255</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Striatum-medial%20prefrontal%20cortex%20connectivity%20predicts%20developmental%20changes%20in%20reinforcement%20learning"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib97"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="W Bos"><span data-itemprop="givenNames"><span itemprop="givenName">W</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Bos</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="CA Rodriguez"><span data-itemprop="givenNames"><span itemprop="givenName">CA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rodriguez</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JB Schweitzer"><span data-itemprop="givenNames"><span itemprop="givenName">JB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Schweitzer</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SM McClure"><span data-itemprop="givenNames"><span itemprop="givenName">SM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">McClure</span></span> </li> </ol><time itemprop="datePublished" datetime="2015">2015</time><span itemprop="headline">Adolescent impatience decreases with increased frontostriatal connectivity</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">112</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">PNAS</span></span></span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Adolescent%20impatience%20decreases%20with%20increased%20frontostriatal%20connectivity"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib98"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ACK Duijvenvoorde"><span data-itemprop="givenNames"><span itemprop="givenName">ACK</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Duijvenvoorde</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="S Peters"><span data-itemprop="givenNames"><span itemprop="givenName">S</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Peters</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="BR Braams"><span data-itemprop="givenNames"><span itemprop="givenName">BR</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Braams</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Crone"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Crone</span></span> </li> </ol><time itemprop="datePublished" datetime="2016">2016</time><span itemprop="headline" content="What motivates adolescents? Neural responses to rewards and their influence on adolescents’ risk taking, lear…">What motivates adolescents? Neural responses to rewards and their influence on adolescents’ risk taking, learning, and cognitive control</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">70</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Neuroscience and Biobehavioral Reviews</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">135</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">147</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=What%20motivates%20adolescents?%20Neural%20responses%20to%20rewards%20and%20their%20influence%20on%20adolescents%E2%80%99%20risk%20taking,%20lear%E2%80%A6"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib99"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ACK Duijvenvoorde"><span data-itemprop="givenNames"><span itemprop="givenName">ACK</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Duijvenvoorde</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="NE Blankenstein"><span data-itemprop="givenNames"><span itemprop="givenName">NE</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Blankenstein</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Crone"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Crone</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="B Figner"><span data-itemprop="givenNames"><span itemprop="givenName">B</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Figner</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ME Toplak"><span data-itemprop="givenNames"><span itemprop="givenName">ME</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Toplak</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="JA Weller"><span data-itemprop="givenNames"><span itemprop="givenName">JA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Weller</span></span> </li> </ol><time itemprop="datePublished" datetime="2017">2017</time><span itemprop="headline">Towards a better understanding of adolescent risk taking: Contextual moderators and model-based analysis</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">Individual Differences in Judgment and Decision Making from a Developmental Perspective</span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">8</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">27</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"><span itemprop="name">Routledge</span><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Routledge"> </span></span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Towards%20a%20better%20understanding%20of%20adolescent%20risk%20taking:%20Contextual%20moderators%20and%20model-based%20analysis"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib100"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="L Van Leijenhorst"><span data-itemprop="givenNames"><span itemprop="givenName">L</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Van Leijenhorst</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="B Gunther Moor"><span data-itemprop="givenNames"><span itemprop="givenName">B</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Gunther Moor</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="ZA Macks"><span data-itemprop="givenNames"><span itemprop="givenName">ZA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Macks</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="SARB Rombouts"><span data-itemprop="givenNames"><span itemprop="givenName">SARB</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Rombouts</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="PM Westenberg"><span data-itemprop="givenNames"><span itemprop="givenName">PM</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Westenberg</span></span> </li> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="EA Crone"><span data-itemprop="givenNames"><span itemprop="givenName">EA</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Crone</span></span> </li> </ol><time itemprop="datePublished" datetime="2010">2010</time><span itemprop="headline">Adolescent risky decision-making: neurocognitive development of reward and control regions</span><span itemscope="" itemtype="http://schema.org/PublicationVolume" itemprop="isPartOf"><span itemprop="volumeNumber" data-itemtype="http://schema.org/Number">51</span><span itemscope="" itemtype="http://schema.org/Periodical" itemprop="isPartOf"><span itemprop="name">NeuroImage</span></span></span><span itemprop="pageStart" data-itemtype="http://schema.org/Number">345</span><span itemprop="pageEnd" data-itemtype="http://schema.org/Number">355</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"> <meta itemprop="name" content="Unknown"><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=Unknown"> </span> </span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Adolescent%20risky%20decision-making:%20neurocognitive%20development%20of%20reward%20and%20control%20regions"> </li> <li itemscope="" itemtype="http://schema.org/Article" itemprop="citation" id="bib101"> <ol data-itemprop="authors"> <li itemscope="" itemtype="http://schema.org/Person" itemprop="author"> <meta itemprop="name" content="D Wechsler"><span data-itemprop="givenNames"><span itemprop="givenName">D</span></span><span data-itemprop="familyNames"><span itemprop="familyName">Wechsler</span></span> </li> </ol><time itemprop="datePublished" datetime="2011">2011</time><span itemprop="headline">Wechsler Abbreviated Scale of Intelligence–Second Edition</span><span itemscope="" itemtype="http://schema.org/Organization" itemprop="publisher"><span itemprop="name">NCS Pearson</span><span itemscope="" itemtype="http://schema.org/ImageObject" itemprop="logo"> <meta itemprop="url" content="https://via.placeholder.com/600x60/dbdbdb/4a4a4a.png?text=NCS%20Pearson"> </span></span> <meta itemprop="image" content="https://via.placeholder.com/1200x714/dbdbdb/4a4a4a.png?text=Wechsler%20Abbreviated%20Scale%20of%20Intelligence%E2%80%93Second%20Edition"> </li> </ol> </section> </article> </main> </body> </html>