Classification methods show that the spatial pattern of a functional magnetic resonance imaging response across the cortex contains category information, but whether such patterns are used, or 'read out', in behavioral performance remains untested. We show that although the spatial pattern in both the retinotopic and lateral occipital cortex (LOC) in humans contains category information, only in the LOC is the pattern stronger for correct than for incorrect trials. Thus, some, but not all, spatial patterns are read out during task performance.