Prefrontal Cortex Basal Ganglia Working Memory

Prefrontal Cortex Basal Ganglia Working Memory

Prefrontal Cortex Basal Ganglia Working Memory (PBWM) is an algorithm which models the working memory in the prefrontal cortex and the basal ganglia.[1] It can be compared to Long short-term memory (LSTM) in functionality but is more biologically explainable.[1]

It uses the Primary Value Learned Value model to train Prefrontal cortex working memory updating system, based on the biology of the prefrontal cortex and basal ganglia.[2]

It is used as part of the Leabra framework and was implemented in Emergent.



The prefrontal cortex has long been thought to subserve both working memory (the holding of information online for processing) and "executive" functions (deciding how to manipulate working memory and perform processing). Although many computational models of working memory have been developed, the mechanistic basis of executive function remains elusive.

PBWM is a computational model of the prefrontal cortex to control both itself and other brain areas in a strategic, task-appropriate manner. These learning mechanisms are based on subcortical structures in the midbrain, basal ganglia and amygdala, which together form an actor/critic architecture. The critic system learns which prefrontal representations are task-relevant and trains the actor, which in turn provides a dynamic gating mechanism for controlling working memory updating. Computationally, the learning mechanism is designed to simultaneously solve the temporal and structural credit assignment problems.

The model's performance compares favorably with standard backpropagation-based temporal learning mechanisms on the challenging 1-2-AX working memory task, and other benchmark working memory tasks.[1]


First, there are multiple separate stripes (groups of units) in the Prefrontal cortex and Striatum layers. Each stripe can be independently updated, such that this system can remember several different things at the same time, each with a different "updating policy" of when memories are updated and maintained. The active maintenance of the memory is in Prefrontal cortex (PFC), and the updating signals (and updating policy more generally) come from the Striatum units (a subset of basal ganglia units).[2]

PVLV provides reinforcement learning signals to train up the dynamic gating system in the basal ganglia.

Sensory input and motor output

The sensory input is connected to the posterior cortex which is connected to the motor output. The sensory input is also linked to the PVLV system.

Posterior cortex

The posterior cortex form the hidden layers of the input/output mapping. The PFC is connected with the posterior cortex to contextualize this input/output mapping.


The PFC (for output gating) has a localist one-to-one representation of the input units for every stripe. Thus, you can look at these PFC representations and see directly what the network is maintaining. The PFC maintains the working memory needed to perform the task.


This is the dynamic gating system representing the striatum units of the basal ganglia. Every even-index unit within a stripe represents "Go", while the odd-index units represent "NoGo." The Go units cause updating of the PFC, while the NoGo units cause the PFC to maintain its existing memory representation.

There are groups of units for every stripe.

In the PBWM model in Emergent, the Matrices represent the striatum.


All these layers are part of PVLV system. The PVLV system controls the dopaminergic modulation of the basal ganglia (BG). Thus, BG/PVLV form an actor-critic architecture where the PVLV system learns when to update.


SNrThal represents the substantia nigra pars reticulata (SNr) and the associated area of the thalamus, which produce a competition among the Go/NoGo units within a given stripe and mediates competition using k-winners-take-all dynamics. If there is more overall Go activity in a given stripe, then the associated SNrThal unit gets activated, and it drives updating in PFC.

For every stripe, there is one unit in SNrThal.

VTA and SNc

Ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) are part of the dopamine layer. This layer models midbrain dopamine neurons. They control the dopaminergic modulation of the basal ganglia.


  1. ^ a b c
  2. ^ a b

Wikimedia Foundation. 2010.

Игры ⚽ Поможем написать курсовую

Look at other dictionaries:

  • Working memory — (also referred to as short term memory, depending on the specific theory) is a theoretical construct within cognitive psychology that refers to the structures and processes used for temporarily storing and manipulating information. There are… …   Wikipedia

  • Dorsolateral prefrontal cortex — Brain: Dorsolateral prefrontal cortex Latin Cortex praefrontalis dorsolateralis The dorsolateral prefrontal cortex (DL PFC or DLPFC), according to a more restricted definition, is roughly equivalent to Brodmann areas 9 and 46.[1] According to a… …   Wikipedia

  • Memory — For other uses, see Memory (disambiguation). Neuropsychology Topics …   Wikipedia

  • Muscle memory — For the term muscle memory as related to strength training, see Muscle memory (strength training). Muscle memory has been used synonymously with motor learning, which is a form of procedural memory that involves consolidating a specific motor… …   Wikipedia

  • Brain — This article is about the brains of all types of animals, including humans. For information specific to the human brain, see Human brain. For other uses, see Brain (disambiguation). A chimpanzee brain The brain is …   Wikipedia

  • Cerebrum — Brain: Cerebrum Diagram depicting the main subdivisions of the embryonic vertebrate brain. Artery anterior cerebral, middle cerebral, poster …   Wikipedia

  • Dopamine — For other uses, see Dopamine (disambiguation). Dopamine …   Wikipedia

  • Reelin — is a protein found mainly in the brain, but also in the spinal cord, blood and other body organs and tissues. Reelin is crucial for regulating the processes of neuronal migration and positioning in the developing brain.Besides this important role …   Wikipedia

  • Hippocampus — For other uses, see Hippocampus (disambiguation). Brain: Hippocampus The hippocampus is located in the medial temporal lobe of the brain. In this lateral view of the human brain, the frontal lobe is at le …   Wikipedia

  • Рилин — Обозначения Символы …   Википедия

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”