1,720,996 research outputs found
An analysis of synaptic normalisation in a general class of Hebbian models.
In standard Hebb models of developmental synaptic plasticity, synaptic normalisation must be introduced in order to constrain synaptic growth and ensure the presence of activity-dependent, competitive dynamics. In such models, multiplicative normalisation cannot segregate afferents whose patterns of electrical activity are positively correlated, while subtractive normalisation can. It is now widely believed that multiplicative normalisation cannot segregate positively correlated afferents in any Hebb model. However, we recently provided a counter-example to this belief by demonstrating that our own neurotrophic model of synaptic plasticity, which can segregate positively correlated afferents, can be reformulated as a non-linear Hebb model with competition implemented through multiplicative normalisation. We now perform an analysis of a general class of Hebb models under general forms of synaptic normalisation. In particular, we extract conditions on the forms of these rules that guarantee that such models possess a fixed point structure permitting the segregation of all but perfectly correlated afferents. We find that the failure of multiplicative normalisation to segregate positively correlated afferents in a standard Hebb model is quite atypical
Dynamic integrative synaptic plasticity explains the spacing effect in the transition from short- to long-term memory
Repeated stimuli that are spaced apart in time promote the transition from short- to long-term memory, while massing repetitions together does not. Previously, we showed that a model of integrative synaptic plasticity, in which plasticity induction signals are integrated by a low-pass filter before plasticity is expressed, gives rise to a natural timescale at which to repeat stimuli, hinting at a partial account of this spacing effect. The account was only partial because the important role of neuromodulation was not considered. We now show that by extending the model to allow dynamic integrative synaptic plasticity, the model permits synapses to robustly discriminate between spaced and massed repetition protocols, suppressing the response to massed stimuli while maintaining that to spaced stimuli. This is achieved by dynamically coupling the filter decay rate to neuromodulatory signaling in a very simple model of the signaling cascades downstream from cAMP production. In particular, the model's parameters may be interpreted as corresponding to the duration and amplitude of the waves of activity in the MAPK pathway. We identify choices of parameters and repetition times for stimuli in this model that optimize the ability of synapses to discriminate between spaced and massed repetition protocols. The model is very robust to reasonable changes around these optimal parameters and times, but for large changes in parameters, the model predicts that massed and spaced stimuli cannot be distinguished or that the responses to both patterns are suppressed. A model of dynamic integrative synaptic plasticity therefore explains the spacing effect under normal conditions and also predicts its breakdown under abnormal conditions
Variations on the theme of synaptic filtering: a comparison of integrate-and-express models of synaptic plasticity for memory lifetimes
Integrate-and-express models of synaptic plasticity propose that synapses integrate plasticity induction signals before expressing synaptic plasticity. By discerning trends in their induction signals, synapses can control destabilizing fluctuations in synaptic strength. In a feedforward perceptron framework with binary-strength synapses for associative memory storage, we have previously shown that such a filter-based model outperforms other, nonintegrative, “cascade”-type models of memory storage in most regions of biologically relevant parameter space. Here, we consider some natural extensions of our earlier filter model, including one specifically tailored to binary-strength synapses and one that demands a fixed, consecutive number of same-type induction signals rather than merely an excess before expressing synaptic plasticity. With these extensions, we show that filter-based models outperform nonintegrative models in all regions of biologically relevant parameter space except for a small sliver in which all models encode memories only weakly. In this sliver, which model is superior depends on the metric used to gauge memory lifetimes (whether a signal-to-noise ratio or a mean first passage time). After comparing and contrasting these various filter models, we discuss the multiple mechanisms and timescales that underlie both synaptic plasticity and memory phenomena and suggest that multiple, different filtering mechanisms may operate at single synapses
Discrete states of synaptic strength in a stochastic model of spike-timing-dependent plasticity
A stochastic model of spike-timing-dependent plasticity (STDP) postulates that single synapses presented with a single spike pair exhibit all-or-none quantal jumps in synaptic strength. The amplitudes of the jumps are independent of spiking timing, but their probabilities do depend on spiking timing. By making the amplitudes of both upward and downward transitions equal, synapses then occupy only a discrete set of states of synaptic strength. We explore the impact of a finite, discrete set of strength states on our model, finding three principal results. First, a finite set of strength states limits the capacity of a single synapse to express the standard, exponential STDP curve. We derive the expression for the expected change in synaptic strength in response to a standard, experimental spike pair protocol, finding a deviation from exponential behavior. We fit our prediction to recent data from single dendritic spine heads, finding results that are somewhat better than exponential fits. Second, we show that the fixed-point dynamics of our model regulate the upward and downward transition probabilities so that these are on average equal, leading to a uniform distribution of synaptic strength states. However, third, under long-term potentiation (LTP) and long-term depression (LTD) protocols, these probabilities are unequal, skewing the distribution away from uniformity. If the number of states of strength is at least of order 10, then we find that three effective states of synaptic strength appear, consistent with some experimental data on ternary-strength synapses. On this view, LTP and LTD protocols may therefore be saturating protocols
Sparseness, anti-sparseness and anything in between: The operating point of a neuron determines its computational repertoire
Stability against fluctuations: a two-dimensional study of scaling, bifurcations and spontaneous symmetry breaking in stochastic models of synaptic plasticity
Stochastic models of synaptic plasticity must confront the corrosive influence of fluctuations in synaptic strength on patterns of synaptic connectivity. To solve this problem, we have proposed that synapses act as filters, integrating plasticity induction signals and expressing changes in synaptic strength only upon reaching filter threshold. Our earlier analytical study calculated the lifetimes of quasi-stable patterns of synaptic connectivity with synaptic filtering. We showed that the plasticity step size in a stochastic model of spike-timing-dependent plasticity (STDP) acts as a temperature-like parameter, exhibiting a critical value below which neuronal structure formation occurs. The filter threshold scales this temperature-like parameter downwards, cooling the dynamics and enhancing stability. A key step in this calculation was a resetting approximation, essentially reducing the dynamics to one-dimensional processes. Here, we revisit our earlier study to examine this resetting approximation, with the aim of understanding in detail why it works so well by comparing it, and a simpler approximation, to the system’s full dynamics consisting of various embedded two-dimensional processes without resetting. Comparing the full system to the simpler approximation, to our original resetting approximation, and to a one-afferent system, we show that their equilibrium distributions of synaptic strengths and critical plasticity step sizes are all qualitatively similar, and increasingly quantitatively similar as the filter threshold increases. This increasing similarity is due to the decorrelation in changes in synaptic strength between different afferents caused by our STDP model, and the amplification of this decorrelation with larger synaptic filters
A non-Markovian random walk underlies a stochastic model of spike-timing-dependent plasticity
A stochastic model of spike-timing-dependent plasticity (STDP) proposes that spike timing influences the probability but not the amplitude of synaptic strength change at single synapses. The classic, biphasic STDP profile emerges as a spatial average over many synapses presented with a single spike pair or as a temporal average over a single synapse presented with many spike pairs. We have previously shown that the model accounts for a variety of experimental data, including spike triplet results, and has a number of desirable theoretical properties, including being entirely self-stabilizing in all regions of parameter space. Our earlier analyses of the model have employed cumbersome spike-to-spike averaging arguments to derive results. Here, we show that the model can be reformulated as a non-Markovian random walk in synaptic strength, the step sizes being fixed as postulated. This change of perspective greatly simplifies earlier calculations by integrating out the proposed switch mechanism by which changes in strength are driven and instead concentrating on the changes in strength themselves. Moreover, this change of viewpoint is generative, facilitating further calculations that would be intractable, if not impossible, with earlier approaches. We prepare the machinery here for these later calculations but also briefly indicate how this machinery may be used by considering two particular applications
First passage time memory lifetimes for simple, multistate synapses: beyond the eigenvector requirement
Memory models based on synapses with discrete and bounded strengths store new memories by forgetting old ones. Memory lifetimes in such memory systems may be defined in a variety of ways. A mean first passage time (MFPT) definition overcomes much of the arbitrariness and many of the problems associated with the more usual signal-to-noise ratio (SNR) definition. We have previously computed MFPT lifetimes for simple, binary-strength synapses that lack internal, plasticity-related states. In simulation we have also seen that for multistate synapses, optimality conditions based on SNR lifetimes are absent with MFPT lifetimes, suggesting that such conditions may be artifactual. Here we extend our earlier work by computing the entire first passage time (FPT) distribution for simple, multistate synapses, from which all statistics, including the MFPT lifetime, may be extracted. For this, we develop a Fokker-Planck equation using the jump moments for perceptron activation. Two models are considered that satisfy a particular eigenvector condition that this approach requires. In these models, MFPT lifetimes do not exhibit optimality conditions, while in one but not the other, SNR lifetimes do exhibit optimality. Thus, not only are such optimality conditions artifacts of the SNR approach, but they are also strongly model dependent. By examining the variance in the FPT distribution, we may identify regions in which memory storage is subject to high variability, although MFPT lifetimes are nevertheless robustly positive. In such regions, SNR lifetimes are typically (defined to be) zero. FPT-defined memory lifetimes therefore provide an analytically superior approach and also have the virtue of being directly related to a neuron's firing properties
- …
