Skip to main content
Log in

A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Analysis and an Application to Orientation Tuning

  • Published:
Journal of Computational Neuroscience Aims and scope Submit manuscript

Abstract

We explore a computationally efficient method of simulating realistic networks of neurons introduced by Knight, Manin, and Sirovich (1996) in which integrate-and-fire neurons are grouped into large populations of similar neurons. For each population, we form a probability density that represents the distribution of neurons over all possible states. The populations are coupled via stochastic synapses in which the conductance of a neuron is modulated according to the firing rates of its presynaptic populations. The evolution equation for each of these probability densities is a partial differential-integral equation, which we solve numerically. Results obtained for several example networks are tested against conventional computations for groups of individual neurons.

We apply this approach to modeling orientation tuning in the visual cortex. Our population density model is based on the recurrent feedback model of a hypercolumn in cat visual cortex of Somers et al. (1995). We simulate the response to oriented flashed bars. As in the Somers model, a weak orientation bias provided by feed-forward lateral geniculate input is transformed by intracortical circuitry into sharper orientation tuning that is independent of stimulus contrast.

The population density approach appears to be a viable method for simulating large neural networks. Its computational efficiency overcomes some of the restrictions imposed by computation time in individual neuron simulations, allowing one to build more complex networks and to explore parameter space more easily. The method produces smooth rate functions with one pass of the stimulus and does not require signal averaging. At the same time, this model captures the dynamics of single-neuron activity that are missed in simple firing-rate models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Abbott LF, van Vreeswijk C (1993) Asynchronous states in networks of pulse-coupled oscillators. Phys. Rev. E 48:1483-1490.

    Google Scholar 

  • Adorján P, Barna G, Érdi P, Obermayer K (1999) A statistical neural field approach to orientation selectivity. Neurocomputing, 26-27:477-482.

    Google Scholar 

  • Amari S (1974) A method of statistical neurodynamics. Kybernetik 14:201-215.

    Google Scholar 

  • Barna G, Gröbler T, Érdi P (1998) Statistical model of the hippocampal CA3 region, II. The population framework: Model of rhythmic activity in the CA3 slice. Biol. Cybern. 79:309-321.

    Google Scholar 

  • Ben-Yishai R, Lev Bar-Or R, Sompolinsky H (1995) Theory of orientation tuning in visual cortex. Proc. Natl. Acad. Sci. USA 92:3844-3848.

    Google Scholar 

  • Brunel N, Hakim V (1999) Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Comput. 11:1621-1671.

    Google Scholar 

  • Carandini M, Ringach D (1997) Predictions of a recurrent model of orientation selectivity. Vision Res. 21:3061-3071.

    Google Scholar 

  • Chawanya T, Aoyagi A, Nishikawa I, Okuda K, Kuramoto Y (1993) A model for feature linking via collective oscillations in the primary visual cortex. Biol. Cybern. 68:483-490.

    Google Scholar 

  • Çinlar E (1972) Superposition of point processes. In PAW Lewis, ed. Stochastic Point Processes: Statistical Analysis, Theory, and Applications. Wiley, New York, NY. pp. 549-606.

    Google Scholar 

  • Crank J, Nicolson P (1947) A practical method for numerical evaluation of solutions for partial differential equations of the heat conduction type. Proc. Camb. Philos. Sco. 43:50-67.

    Google Scholar 

  • Gerstner W (1995) Time structure of the activity in neural network models. Phys. Rev. E 51:738-758.

    Google Scholar 

  • Gerstner W (1999) Population dynamics of spiking neurons: fast transients, asynchronous states, and locking. Neural Comput. (to appear).

  • Gerstner W, van Hemmen JL (1994) Coding and information processing in neural networks. In E Domany, JL van Hemmen, K Schulten, eds. Models of Neural Networks II. Springer-Verlag, New York, NY. pp. 1-93.

    Google Scholar 

  • Hansel D, Sompolinsky H (1996) Chaos and synchrony in a model of a hypercolumn in visual cortex. J. Comp. Neurosci. 3:7-34.

    Google Scholar 

  • Howe JR, Sutor B, Zieglgansberger W (1987) Baclofen reduces post-synaptic potentials of rat cortical neurones by an action other than its hyperpolarizing action. J. Physiology 384:539-569.

    Google Scholar 

  • Knight BW (1972a) Dynamics of encoding in a population of neurons. J. Gen. Physiol. 59:734-766.

    Google Scholar 

  • Knight BW (1972b) The relationship between the firing rate of a single neuron and the level of activity in a population of neurons: Experimental evidence for resonant enhancement in the population response. J. Gen. Physiol. 59:767-778.

    Google Scholar 

  • Knight BW (2000) Dynamics of encoding in neuron populations: Some general mathematical features. Neural Comput. (to appear).

  • Knight BW, Manin D, Sirovich L (1996) Dynamical models of interacting neuron populations. In EC Gerf, ed. Symposium on Robotics and Cybernetics: Computational Engineering in Systems Applications. Cite Scientifique, Lille, France.

    Google Scholar 

  • Kuramoto Y (1991) Collective synchronization of pulse-coupled oscillators and excitable units. Physica D 50:15-30.

    Google Scholar 

  • Omurtag A, Knight BW, Sirovich L (2000) On the simulation of large populations of neurons. J. Comp. Neurosci. 8:51-53.

    Google Scholar 

  • Pham J, Pakdaman K, Champagnat J, Vibert JF (1998) Activity in sparsely connected excitatory neural networks: Effect of connectivity. Neural Networks 11:415-434.

    Google Scholar 

  • Shapley R, Sompolinsky H (1997) New perspectives on the mechanisms for orientation selectivity. Curr. Op. Biol. 7:514-522.

    Google Scholar 

  • Sirovich L, Knight BW, Omurtag A (1999) Dynamics of neuronal populations: The equilibrium solution. SIAM (to appear).

  • Somers DC, Nelson SB, Sur M (1995) An emergent model of orientation selectivity in cat visual cortical simple cells. J. Neurosci. 15:5448-5465.

    Google Scholar 

  • Strogatz SH, Mirollo RE (1991) Stability of incoherence in a population of coupled oscillators. J. Stat. Phys. 63:613-635.

    Google Scholar 

  • Tanabe S, Pakdaman K, Nomura T, Sato S (1998) Dynamics of an ensemble of leaky integrate-and-fire neuron models and its response to a pulse input. Technical Report of IEICE, NLP98-14:41-48.

    Google Scholar 

  • Treves A (1993) Mean-field analysis of neuronal spike dynamics. Network 4:259-284.

    Google Scholar 

  • Tuckwell HC (1988) Introduction to Theoretic Neurobiology. Cambridge University Press, New York, NY. Vol. 2, pp. 111-189.

    Google Scholar 

  • Victor JD (1987) The dynamics of the cat retinal X cell centre. J. Physiol. 386:219-246.

    Google Scholar 

  • Wilbur WJ, Rinzel J (1983) A theoretical basis for large coefficient of variation and bimodality in neuronal interspike interval distributions. J. Theor. Biol. 105:345-368.

    Google Scholar 

  • Wilson HR, Cowan JD (1972) Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical J. 12:1-24.

    Google Scholar 

  • Wilson HR, Cowan JD (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik13:55-80.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nykamp, D.Q., Tranchina, D. A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Analysis and an Application to Orientation Tuning. J Comput Neurosci 8, 19–50 (2000). https://doi.org/10.1023/A:1008912914816

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008912914816

Navigation