Results are shown for a representative example optimized network as in Fig 3. Each point represents one compartment. The horizontal axis denotes the corresponding entry of Wreadout and the vertical axis denotes the difference between that compartment’s dopamine neuron’s response to a positive and negative valence US. Consistent with learning involving depression of KC-to-MBON synapses, compartments whose output neuron activity biases the readout toward negative valence (avoidance) have dopamine neurons that preferentially respond to positive valence US. (EPS)</p
<p>In this schematic, V1 is simplified to contain only two kinds of neurons, one tuned to color (the...
Dopamine neurons are thought to facilitate learning by signaling reward prediction errors (RPEs), th...
A. Responses of the ‘Down’ output neurons during a trial with input sensory cue as ‘Up’ or ‘Down’, f...
(A) Illustration of non-specific potentiation following dopamine neuron activity (compare with Fig 1...
(A) Behavior during first-order conditioning, similar to Fig 3A, but for a non-plastic network. Beca...
(A) First-order conditioning trials with positive or negative valence US. (B) Responses of model dop...
(A) Behavior of output neurons (MBONs) during first-order conditioning. During training, a CS+ (blue...
Here, we introduce a spiking actor-critic network model of learning from both reward and punishment ...
The basal ganglia network is thought to be involved in adaptation oforganism's behavior when facing ...
Abstract. Extending previous work, we introduce a spiking actor-critic network model of learning fro...
<p>The dynamics of intrinsic oscillations can be combined with the characteristic time scale of the ...
The network is similar to Fig 5 but a second readout that computes novelty is added. The novelty rea...
<p>Tuning properties of excitatory and inhibitory neurons. (<b>A</b>) Representative tuning curves f...
Ventral tegmental area (VTA) dopamine (DA) neurons play a central role in mediating motivated behavi...
Many previous studies of the brain areas involved in reward prediction errors have not accounted for...
<p>In this schematic, V1 is simplified to contain only two kinds of neurons, one tuned to color (the...
Dopamine neurons are thought to facilitate learning by signaling reward prediction errors (RPEs), th...
A. Responses of the ‘Down’ output neurons during a trial with input sensory cue as ‘Up’ or ‘Down’, f...
(A) Illustration of non-specific potentiation following dopamine neuron activity (compare with Fig 1...
(A) Behavior during first-order conditioning, similar to Fig 3A, but for a non-plastic network. Beca...
(A) First-order conditioning trials with positive or negative valence US. (B) Responses of model dop...
(A) Behavior of output neurons (MBONs) during first-order conditioning. During training, a CS+ (blue...
Here, we introduce a spiking actor-critic network model of learning from both reward and punishment ...
The basal ganglia network is thought to be involved in adaptation oforganism's behavior when facing ...
Abstract. Extending previous work, we introduce a spiking actor-critic network model of learning fro...
<p>The dynamics of intrinsic oscillations can be combined with the characteristic time scale of the ...
The network is similar to Fig 5 but a second readout that computes novelty is added. The novelty rea...
<p>Tuning properties of excitatory and inhibitory neurons. (<b>A</b>) Representative tuning curves f...
Ventral tegmental area (VTA) dopamine (DA) neurons play a central role in mediating motivated behavi...
Many previous studies of the brain areas involved in reward prediction errors have not accounted for...
<p>In this schematic, V1 is simplified to contain only two kinds of neurons, one tuned to color (the...
Dopamine neurons are thought to facilitate learning by signaling reward prediction errors (RPEs), th...
A. Responses of the ‘Down’ output neurons during a trial with input sensory cue as ‘Up’ or ‘Down’, f...