Abstract
We explore a computationally efficient method of simulating realistic networks of neurons introduced by Knight, Manin, and Sirovich (1996) in which integrate-and-fire neurons are grouped into large populations of similar neurons. For each population, we form a probability density that represents the distribution of neurons over all possible states. The populations are coupled via stochastic synapses in which the conductance of a neuron is modulated according to the firing rates of its presynaptic populations. The evolution equation for each of these probability densities is a partial differential-integral equation, which we solve numerically. Results obtained for several example networks are tested against conventional computations for groups of individual neurons.
We apply this approach to modeling orientation tuning in the visual cortex. Our population density model is based on the recurrent feedback model of a hypercolumn in cat visual cortex of Somers et al. (1995). We simulate the response to oriented flashed bars. As in the Somers model, a weak orientation bias provided by feed-forward lateral geniculate input is transformed by intracortical circuitry into sharper orientation tuning that is independent of stimulus contrast.
The population density approach appears to be a viable method for simulating large neural networks. Its computational efficiency overcomes some of the restrictions imposed by computation time in individual neuron simulations, allowing one to build more complex networks and to explore parameter space more easily. The method produces smooth rate functions with one pass of the stimulus and does not require signal averaging. At the same time, this model captures the dynamics of single-neuron activity that are missed in simple firing-rate models.
Similar content being viewed by others
References
Abbott LF, van Vreeswijk C (1993) Asynchronous states in networks of pulse-coupled oscillators. Phys. Rev. E 48:1483-1490.
Adorján P, Barna G, Érdi P, Obermayer K (1999) A statistical neural field approach to orientation selectivity. Neurocomputing, 26-27:477-482.
Amari S (1974) A method of statistical neurodynamics. Kybernetik 14:201-215.
Barna G, Gröbler T, Érdi P (1998) Statistical model of the hippocampal CA3 region, II. The population framework: Model of rhythmic activity in the CA3 slice. Biol. Cybern. 79:309-321.
Ben-Yishai R, Lev Bar-Or R, Sompolinsky H (1995) Theory of orientation tuning in visual cortex. Proc. Natl. Acad. Sci. USA 92:3844-3848.
Brunel N, Hakim V (1999) Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Comput. 11:1621-1671.
Carandini M, Ringach D (1997) Predictions of a recurrent model of orientation selectivity. Vision Res. 21:3061-3071.
Chawanya T, Aoyagi A, Nishikawa I, Okuda K, Kuramoto Y (1993) A model for feature linking via collective oscillations in the primary visual cortex. Biol. Cybern. 68:483-490.
Çinlar E (1972) Superposition of point processes. In PAW Lewis, ed. Stochastic Point Processes: Statistical Analysis, Theory, and Applications. Wiley, New York, NY. pp. 549-606.
Crank J, Nicolson P (1947) A practical method for numerical evaluation of solutions for partial differential equations of the heat conduction type. Proc. Camb. Philos. Sco. 43:50-67.
Gerstner W (1995) Time structure of the activity in neural network models. Phys. Rev. E 51:738-758.
Gerstner W (1999) Population dynamics of spiking neurons: fast transients, asynchronous states, and locking. Neural Comput. (to appear).
Gerstner W, van Hemmen JL (1994) Coding and information processing in neural networks. In E Domany, JL van Hemmen, K Schulten, eds. Models of Neural Networks II. Springer-Verlag, New York, NY. pp. 1-93.
Hansel D, Sompolinsky H (1996) Chaos and synchrony in a model of a hypercolumn in visual cortex. J. Comp. Neurosci. 3:7-34.
Howe JR, Sutor B, Zieglgansberger W (1987) Baclofen reduces post-synaptic potentials of rat cortical neurones by an action other than its hyperpolarizing action. J. Physiology 384:539-569.
Knight BW (1972a) Dynamics of encoding in a population of neurons. J. Gen. Physiol. 59:734-766.
Knight BW (1972b) The relationship between the firing rate of a single neuron and the level of activity in a population of neurons: Experimental evidence for resonant enhancement in the population response. J. Gen. Physiol. 59:767-778.
Knight BW (2000) Dynamics of encoding in neuron populations: Some general mathematical features. Neural Comput. (to appear).
Knight BW, Manin D, Sirovich L (1996) Dynamical models of interacting neuron populations. In EC Gerf, ed. Symposium on Robotics and Cybernetics: Computational Engineering in Systems Applications. Cite Scientifique, Lille, France.
Kuramoto Y (1991) Collective synchronization of pulse-coupled oscillators and excitable units. Physica D 50:15-30.
Omurtag A, Knight BW, Sirovich L (2000) On the simulation of large populations of neurons. J. Comp. Neurosci. 8:51-53.
Pham J, Pakdaman K, Champagnat J, Vibert JF (1998) Activity in sparsely connected excitatory neural networks: Effect of connectivity. Neural Networks 11:415-434.
Shapley R, Sompolinsky H (1997) New perspectives on the mechanisms for orientation selectivity. Curr. Op. Biol. 7:514-522.
Sirovich L, Knight BW, Omurtag A (1999) Dynamics of neuronal populations: The equilibrium solution. SIAM (to appear).
Somers DC, Nelson SB, Sur M (1995) An emergent model of orientation selectivity in cat visual cortical simple cells. J. Neurosci. 15:5448-5465.
Strogatz SH, Mirollo RE (1991) Stability of incoherence in a population of coupled oscillators. J. Stat. Phys. 63:613-635.
Tanabe S, Pakdaman K, Nomura T, Sato S (1998) Dynamics of an ensemble of leaky integrate-and-fire neuron models and its response to a pulse input. Technical Report of IEICE, NLP98-14:41-48.
Treves A (1993) Mean-field analysis of neuronal spike dynamics. Network 4:259-284.
Tuckwell HC (1988) Introduction to Theoretic Neurobiology. Cambridge University Press, New York, NY. Vol. 2, pp. 111-189.
Victor JD (1987) The dynamics of the cat retinal X cell centre. J. Physiol. 386:219-246.
Wilbur WJ, Rinzel J (1983) A theoretical basis for large coefficient of variation and bimodality in neuronal interspike interval distributions. J. Theor. Biol. 105:345-368.
Wilson HR, Cowan JD (1972) Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical J. 12:1-24.
Wilson HR, Cowan JD (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik13:55-80.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Nykamp, D.Q., Tranchina, D. A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Analysis and an Application to Orientation Tuning. J Comput Neurosci 8, 19–50 (2000). https://doi.org/10.1023/A:1008912914816
Issue Date:
DOI: https://doi.org/10.1023/A:1008912914816