6 research outputs found

    The influence of the noradrenergic system on optimal control of neural plasticity

    No full text
    Decision making under uncertainty is challenging for any autonomous agent. The challenge increases when the environment’s stochastic properties change over time, i.e. when the environment is volatile. In order to efficiently adapt to volatile environments, agents must primarily rely on recent outcomes to quickly change their decision strategies; in other words, they need to increase their knowledge plasticity. On the contrary, in stable environments, knowledge stability must be preferred to preserve useful information against noise. Here we propose that in mammalian brain, the locus coeruleus (LC) is one of the nuclei involved in volatility estimation and in the subsequent control of neural plasticity. During a reinforcement learning task, LC activation, measured by means of pupil diameter, coded both for environmental volatility and learning rate. We hypothesize that LC could be responsible, through norepinephrinic modulation, for adaptations to optimize decision making in volatile environments. We also suggest a computational model on the interaction between the anterior cingulate cortex and LC for volatility estimation

    Adaptive Effort Investment in Cognitive and Physical Tasks: A Neurocomputational Model

    No full text
    Despite its importance in everyday life, the computational nature of effort investment remains poorly understood. We propose an effort model obtained from optimality considerations, and a neurocomputational approximation to the optimal model. Both are couched in the framework of reinforcement learning. It is shown that choosing when or when not to exert effort can be adaptively learned, depending on rewards, costs, and task difficulty. In the neurocomputational model, the limbic loop comprising anterior cingulate cortex and ventral striatum in the basal ganglia allocates effort to cortical stimulus-action pathways whenever this is valuable. We demonstrate that the model approximates optimality. Next, we consider two hallmark effects from the cognitive control literature, namely proportion congruency and sequential congruency effects. It is shown that the model exerts both proactive and reactive cognitive control. Then, we simulate two physical effort tasks. In line with empirical work, impairing the model’s dopaminergic pathway leads to apathetic behavior. Thus, we conceptually unify the exertion of cognitive and physical effort, studied across a variety of literatures (e.g., motivation and cognitive control) and animal species

    Disentangling conscious and unconscious processing: a subjective trial-based assessment approach.

    No full text
    The most common method for assessing similarities and differences between conscious and unconscious processing is to compare the effects of unconscious (perceptually weak) stimuli, with conscious (perceptually strong) stimuli. Awareness of these stimuli is then assessed by objective performance on prime identification tasks. While this approach has proven extremely fruitful in furthering our understanding of unconscious cognition, it also suffers from some critical problems. We present an alternative methodology for comparing conscious and unconscious cognition. We used a priming version of a Stroop paradigm and after each trial, participants gave a subjective rating of the degree to which they were aware of the prime. Based on this trial-by-trial awareness assessment, conscious, uncertain, and unconscious trials were separated. Crucially, in all these conditions, the primes have identical perceptual strength. Significant priming was observed for all conditions, but the effects for conscious trials were significantly stronger, and no difference was observed between uncertain and unconscious trials. Thus, awareness of the prime has a large impact on congruency effects, even when signal strength is controlled for.Journal ArticleSCOPUS: ar.jinfo:eu-repo/semantics/publishe
    corecore