Abstract
Reports of columnar organization of the macaque inferotemporal cortex (Tanaka, 1992, 1993a) indicate that ensembles of cells responding to particular objects may be both sufficiently extensive and properly localized to allow their detection and discrimination by means of functional magnetic resonance imaging (fMRI). A recently developed theory of object representation by ensembles of coarsely tuned units (Edelman, 1998; Edelman & Duvdevani-Bar, 1997b) and its implementation as a computer model of recognition and categorization (Cutzu & Edelman, 1998; Edelman & Duvdevani-Bar, 1997a) provide a computational framework in which such findings can be interpreted in a straightforward fashion. Taken together, these developments in the study of object representation and recognition suggest that direct visualization of the internal representations may be easier than was previously thought. In this paper, we show how fMRI techniques can be used to investigate the internal representation of objects in the human visual cortex. Our initial results reveal that the activation of most voxels in object-related areas remains unaffected by a coarse scrambling of the natural images used as stimuli and that a map of the representation space of object categories in individual subjects can be derived from the distributed pattern of voxel activation in those areas.
Article PDF
Similar content being viewed by others
References
Albright, T. D. (1991). Motion perception and the mind-body problem. Current Biology, 1, 391–393.
Allison, T., Ginter, H., McCarthy, G., Nobre, A., & Puce, A. (1994). Face recognition in human extrastriate cortex. Journal of Neurophysiology, 71, 821–825.
Allison, T., McCarthy, G., Nobre, A., Puce, A., & Belger, A. (1994). Human extrastriate visual cortex and the perception of faces, words, numbers and colors. Cerebral Cortex, 5, 544–554.
Baker, J. R., Hoppel, B. E., & Stern, C. E. (1993). Dynamic functional imaging of the complete human cortex using gradient-echo and asymmetric spin-echo echo planar magnetic resonance imaging. Society for Magnetic Resonance in Medicine Abstracts, 12, 1400.
Barlow, R. B. (1990). What the brain tells the eye. Scientific American, 262, 66–70.
Biederman, I. (1987). Recognition by components: A theory of human image understanding. Psychological Review, 94, 115–147.
Boynton, G. A., Engel, S. A., Glover, G. H., & Heeger, D. J. (1996). Linear systems analysis of functional magnetic resonance imaging in human v1. Journal of Neuroscience, 16, 4207–4221.
Brown, J. M., Weisstein, N., & May, J. G. (1992). Visual search for simple volumetric shapes. Perception & Psychophysics, 51, 40–48.
Buckner, R. L., Bandettini, P. A., O’Craven, K., Savoy, R. L., Peterson, S., Raichle, M., & Rosen, B. (1997). Detection of cortical activation during average single trials of a cognitive task using functional magnetic resonance imaging. Proceedings of the National Academy of Sciences, 93, 14878–14883.
Bülthoff, H. H., Edelman, S., & Tarr, M. J. (1995). How are three-dimensional objects represented in the brain? Cerebral Cortex, 5, 247–260.
Chelazzi, L., Miller, E., & Desimone, R. (1993). A neural basis for visual search in inferior temporal cortex. Nature, 363, 345–347.
Cutzu, F., & Edelman, S. (1996). Faithful representation of similarities among three-dimensional shapes in human vision. Proceedings of the National Academy of Sciences, 93, 12046–12050.
Cutzu, F., & Edelman, S. (1998). Representation of object similarity in human vision: Psychophysics and a computational model. Vision Research, 38, 2227–2257.
DeYoe, E. A., Carman, G. J., Bandettini, P., Glickman, S., Wieser, J. R., Cox, D. M., & Neitz, J. (1996). Mapping striate and extrastriate visual areas in human cerebral cortex. Proceedings of the National Academy of Sciences, 93, 2382–2386.
Duvdevani-Bar, S., Edelman, S., Howell, A. J., & Buxton, H. (1998). A similarity-based method for the generalization of face recognition over pose and expression. In S. Akamatsu & K. Mase (Eds.), Proceedings of the 3rd International Symposium on Face and Gesture Recognition (FG98) (pp. 118–123). Washington, DC: IEEE Press.
Edelman, S. (1995). Representation of similarity in 3D object discrimination. Neural Computation, 7, 407–422.
Edelman, S. (1997). Computational theories of object recognition. Trends in Cognitive Science, 1, 296–304.
Edelman, S. (1998). Representation is representation of similarity. Behavioral & Brain Sciences, 21, 449–498.
Edelman, S., & Duvdevani-Bar, S. (1997a). A model of visual recognition and categorization. Philosophical Transactions of the Royal Society of London: Series B, 352, 1191–1202.
Edelman, S., & Duvdevani-Bar, S. (1997b). Similarity, connectionism, and the problem of representation in vision. Neural Computation, 9, 701–720.
Edelman, S., & Weinshall, D. (in press). Computational approaches to shape constancy. In V. Walsh & J. Kulikowski (Eds.), Perceptual constancies: Why things look as they do. Cambridge: Cambridge University Press.
Efron, B., & Tibshirani, R. (1993). An introduction to the bootstrap. London: Chapman & Hall.
Farah, M. J. (1990). Visual agnosia. Cambridge, MA: MIT Press.
Fillenbaum, S., & Rapoport, A. (1979). Structures in the subjective lexicon. New York: Academic Press.
Fujita, I., Tanaka, K., Ito, M., & Cheng, K. (1992). Columns for visual features of objects in monkey inferotemporal cortex. Nature, 360, 343–346.
Grill-Spector, K., Kushnir, T., Hendler, T., Edelman, S., Itzchak, Y., & Malach, R. (1998). A sequence of early object processing stages revealed by fMRI in human occipital lobe. Human Brain Mapping, 6, 316–328.
Haxby, J. V., Horwitz, B., Ungerleider, L. G., Maisog, J. M., Pietrini, P., & Grady, C. L. (1994). The functional organization of human extrastriate cortex: A PET-rCBF study of selective attention to faces and locations. Journal of Neuroscience, 14, 6336–6353.
Hinton, G. E. (1984). Distributed representations (Tech. Rep. No. CMUCS 84-157). Carnegie Mellon University, Department of Computer Science.
Hummel, J. E., & Biederman, I. (1992). Dynamic binding in a neural network for shape recognition. Psychological Review, 99, 480–517.
Ishai, A., Ungerleider, L. G., Martin, A., Maisog, J., & Haxby, J. (1997). fMRI reveals differential activation in the ventral object recognition pathway during the perception of faces, houses and chairs. NeuroImage, 5, S149.
Kanwisher, N., Chun, M. M., McDermott, J., & Ledden, P. J. (1996). Functional imaging of human visual recognition. Cognitive Brain Research, 5, 55–67.
Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302–4311.
Kanwisher, N., Woods, R. P., Iacoboni, M., & Mazziota, J. (1997). A locus in human extrastriate cortex for visual shape analysis. Journal of Cognitive Neuroscience, 9, 133–142.
Keele, S. W., & Neill, W. T. (1978). Mechanisms of attention. In E. C. Carterette & M. P. Friedman (Eds.), Handbook of perception (Vol. 9, pp. 3–47). New York: Academic Press.
Kobatake, E., & Tanaka, K. (1994). Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. Journal of Neurophysiology, 71, 856–867.
Kruskal, J. B. (1964). Non-metric multidimensional scaling: A numerical method. Psychometrika, 29, 115–129.
Kruskal, J. B., & Wish, M. (1978). Multidimensional scaling. Beverly Hills, CA: Sage.
Logothetis, N. K., Pauls, J., & Poggio, T. (1995). Shape representation in the inferior temporal cortex of monkeys. Current Biology, 5, 552–563.
Logothetis, N. K., Pauls, J., Bülthoff, H. H., & Poggio, T. (1994). View-dependent object recognition by monkeys. Current Biology, 4, 404–414.
Logothetis, N. K., & Scheinberg, D. L. (1996). Visual object recognition. Annual Review of Neuroscience, 19, 577–621.
Malach, R., Reppas, J. B., Benson, R. R., Kwong, K. K., Jiang, J., Kennedy, W. A., Ledden, P. J., Brady, T. J., Rosen, B. R., & Tootell, R. B. H. (1995). Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proceedings of the National Academy of Sciences, 92, 8135–8139.
Martin, A., Wiggs, C. L., Ungerleider, L. G., & Haxby, J. V. (1996). Neural correlates of category-specific knowledge. Nature, 379, 649–652.
Miller, E. K., Li, L., & Desimone, R. (1993). Activity of neurons in anterior inferior temporal cortex during a short-term memory task. Journal of Neuroscience, 13, 1460–1478.
Moran, J., & Desimone, R. (1985). Selective attention gates visual processing in the extrastriate cortex. Science, 229, 782–784.
Nissen, M. J. (1985). Accessing features and objects: Is location special? In M. I. Posner & O. S. M. Marin (Eds.), Attention and performance XI (pp. 205–219). Hillsdale, NJ: Erlbaum.
O’Toole, A. J., Edelman, S., & Bülthoff, H. H. (1998). Stimulus-specific effects in face recognition over changes in viewpoint. Vision Research, 38, 2351–2363.
Poggio, T. (1990). A theory of how the brain might work. Cold Spring Harbor Symposia on Quantitative Biology, LV, 899–910.
Poggio, T., & Edelman, S. (1990). A network that learns to recognize three-dimensional objects. Nature, 343, 263–266.
Puce, A., Allison, T., Asgari, M., Gore, J. C., & McCarthy, G. (1996). Differential sensitivity of human visual cortex to faces, letterstrings and textures: A functional magnetic resonance imaging study. Journal of Neuroscience, 16, 5205–5215.
Reyment, R., & Jöreskog, K. (1993). Applied factor analysis in the natural sciences. Cambridge: Cambridge University Press.
SAS Institute, Inc. (1989). SAS/STAT User’s Guide, Version 6. Cary, NC: Author.
Sereno, M. I., Dale, A. M., Reppas, J. B., Kwong, K. K., Belliveau, J. W., Brady, T. J., Rosen, R. B., & Tootell, R. B. H. (1995, May 12). Borders of multiple visual areas revealed by functional magnetic resonance. Science, 268, 889–893.
Shepard, R. N. (1962). The analysis of proximities: Multidimensional scaling with unknown distance function: Part I. Psychometrika, 27, 125–140.
Shepard, R. N. (1980). Multidimensional scaling, tree-fitting, and clustering. Science, 210, 390–397.
Shepard, R. N., & Cermak, G. W. (1973). Perceptual-cognitive explorations of a toroidal set of free-form stimuli. Cognitive Psychology, 4, 351–377.
Shepard, R. N., & Chipman, S. (1970). Second-order isomorphism of internal representations: Shapes of states. Cognitive Psychology, 1, 1–17.
Siegel, S. (1956). Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill.
Snippe, H. P., & Koenderink, J. J. (1992). Discrimination thresholds for channel-coded systems. Biological Cybernetics, 66, 543–551.
Spitzer, H., Desimone, R., & Moran, J. (1988). Increased attention enhances both behavioral and neuronal performance. Science, 240, 338–340.
Sugihara, T., Edelman, S., & Tanaka, K. (1998). Representation of objective similarity among three-dimensional shapes in the monkey. Biological Cybernetics, 78, 1–7.
Tanaka, K. (1992). Inferotemporal cortex and higher visual functions. Current Opinion in Neurobiology, 2, 502–505.
Tanaka, K. (1993a). Column structure of inferotemporal cortex: “Visual alphabet” or “differential amplifiers”? In Proceedings of the International Joint Conference on Neural Networks (pp. 1095–1099). Washington, DC: IEEE Press.
Tanaka, K. (1993b). Neuronal mechanisms of object recognition. Science, 262, 685–688.
Tanaka, K. (1996). Inferotemporal cortex and object vision. Annual Review of Neuroscience, 19, 109–139.
Tanaka, K. (1997). Mechanisms of visual object recognition: Monkey and human studies. Current Opinion in Neurobiology, 7, 523–529.
Tomasi, C., & Kanade, T. (1992). Shape and motion from image streams under orthography: A factorization method. International Journal of Computer Vision, 9, 137–154.
Tootell, R. B. H., Dale, A. M., Sereno, M. I., & Malach, R. (1996). New images from human visual cortex. Trends in Neurosciences, 19, 481–489.
Ullman, S. (1989). Aligning pictorial descriptions: An approach to object recognition. Cognition, 32, 193–254.
Ullman, S. (1995). Sequence-seeking and counter-streams: A model for information flow in the cortex. Cerebral Cortex, 5, 1–11.
Ullman, S. (1996). High level vision. Cambridge, MA: MIT Press.
Ullman, S., & Basri, R. (1991). Recognition by linear combinations of models. IEEE Transactions on Pattern Analysis & Machine Intelligence, 13, 992–1005.
Wachsmuth, E., Oram, M. W., & Perrett, D. I. (1994). Recognition of objects and their component parts: Responses of single units in the temporal cortex of the macaque. Cerebral Cortex, 5, 509–522.
Wang, G., Tanaka, K., & Tanifuji, M. (1996). Optical imaging of functional organization in the monkey inferotemporal cortex. Science, 272, 1665–1668.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Edelman, S., Grill-Spector, K., Kushnir, T. et al. Toward direct visualization of the internal shape representation space by fMRI. Psychobiology 26, 309–321 (1998). https://doi.org/10.3758/BF03330618
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/BF03330618