Abstract
Visual field maps in human early extrastriate areas (V2 and V3) are traditionally thought to form mirror-image representations which surround the primary visual cortex (V1). According to this scheme, V2 and V3 form nearly symmetrical halves with respect to the calcarine sulcus, with the dorsal halves representing the lower contralateral quadrants, and the ventral halves representing the upper contra lateral quadrants. This arrangement is considered to be consistent across individuals, and thus predictable with reasonable accuracy using templates. However, data that deviate from this expected pattern have been observed, but mainly treated as artifactual. Here we systematically investigate individual variability in the visual field maps of human early visual cortex using the large-scale 7T Human Connectome Project (HCP) retinotopy dataset. Our results demonstrate substantial and principled inter-individual variability in early visual retinotopy. Visual field representation in the dorsal portions of V2 and V3 were more variable than their ventral counterparts, including substantial departures from the expected mirror-symmetrical patterns. Surprisingly, only one-third of individuals had maps that conformed to the expected pattern. In addition, retinotopic maps in the left hemisphere were more variable than those in the right hemisphere. Our findings challenge the current view that interindividual variability in early extrastriate cortex is negligible, and that the dorsal portions of V2 and V3 are roughly mirror images of their ventral counterparts.
Introduction
Non-invasive imaging has been instrumental in mapping the topographic organization of human visual cortex (Wandell and Winawer, 2010). The visual field maps in early visual areas (V1, V2, and V3) have been reported to be remarkably consistent across people, and predictable with reasonable accuracy using a template (Benson et al., 2014, 2012; Schira et al., 2010). While V1 contains a complete, first-order (continuous) representation of the contralateral visual hemifield, areas V2 and V3 form second- order (discontinuous) representations (Rosa, 2002). In these areas, a field discontinuity near the horizontal meridian splits the maps into upper and lower field representations that are only connected at the foveal confluence (Figure 1a,b). Accordingly, in parcellation schemes (Glasser et al., 2016; Wang et al., 2015), early visual areas form concentric bands, arranged in nearly symmetrical halves with respect to the calcarine sulcus. These bands, each containing the representation of a contralateral visual field quadrant, are referred to as the dorsal and ventral portions of V2 and V3 (Figure 1a). However, observations originating in several laboratories has indicated departures from this pattern, particularly in the dorsal region (Allen et al., 2021; Arcaro and Kastner, 2015; Benson and Winawer, 2018; Van Essen and Glasser, 2018). Even so, small-sized datasets, variability in acquisition sites and protocols, and methodological constraints have limited the investigation of this variability. As a result, no consensus exists about deviations from the canonical mirror-symmetrical organization of V2 and V3.
In humans, empirical visual field mapping using functional MRI (fMRI) is the primary means of delineating precise visual area boundaries in individuals. Visual field maps are typically defined in polar coordinates, resulting in two maps: one representing polar angle (or clock position) and the other eccentricity (or distance away from the fixation point) (Wandell and Winawer, 2010). In primates, isoangle bands representing the vertical and the horizontal meridians are thought to delineate boundaries between V1 and V2, V2 and V3, and V3 and higher-order visual areas (Figure 1b). Particularly, in human probabilistic maps, boundaries between the dorsal portions of early visual areas are roughly mirror images of their ventral counterparts (Figure 1c). Nevertheless, boundaries that deviate from the expected ones exist, but these have been mainly treated as artifactual, with researchers often overlooking the irregularities by simply drawing the boundaries to resemble that of a typical map as best as possible (Figure 1d). Here, it may be important to remark that the border between the dorsal parts of V2 and V3 is well known to be variable in other mammals, and that it typically does not coincide with the representation of the horizontal meridian (see Rosa and Manger, 2005 for review).
Although previous reports of individual variability in the dorsal portion of human early visual cortex were primarily anecdotal (Allen et al., 2021; Arcaro and Kastner, 2015; Benson and Winawer, 2018; Van Essen and Glasser, 2018), a recently developed deep learning model predicts that individual variability in retinotopy exists, and that this is correlated with variations in gross anatomy (e.g., the pattern of sulci and gyri) (Ribeiro et al., 2021). Moreover, studies modelling the formation of retinotopic maps in non-human primates also indicate that different variants could develop based on application of similar rules (Yu et al., 2020).
Motivated by these findings, here we systematically investigate individual variability in visual field maps of human early visual cortex using a recently released, large-scale dataset: the 181 participants, 7T Human Connectome Project (HCP) retinotopy dataset (Benson et al., 2018). Our aims were to quantify the level of individual variability throughout early visual cortex (V1-V3) and to determine whether there are common modes of retinotopic organization that differ from the established view (i.e., whether individual retinotopic maps differ from a template in similar ways). Our results challenge the current view that individual differences in retinotopic organization reflect experimental artifacts that may be dismissed for practical purposes. In particular, they demonstrate that the dorsal portions of human early visual areas are more heterogeneous than previously acknowledged.
Materials and Methods
Dataset
We used the Human Connectome Project (HCP) 7T Retinotopy dataset (Benson et al., 2018) to investigate individual variability in retinotopic maps of human early visual cortex. This dataset consists of high-resolution functional retinotopic mapping and structural data from 181 participants (109 females, age 22-35) with normal or corrected-to-normal visual acuity. Participant recruitment and data collection were led by Washington University and the University of Minnesota. The Institutional Review Board (IRB) at Washington University approved all experimental procedures (IRB number 201204036; “Mapping the Human Connectome: Structure, Function, and Heritability”), and all participants provided written informed consent before data collection (Van Essen et al., 2013). Additionally, the acquisition protocol has been described in previous work (Benson et al., 2018; Van Essen et al., 2013).
Structural data were acquired at 0.7 mm isotropic resolution in a customized Siemens 3T Connectome scanner (Van Essen et al., 2013). Briefly, cortical surfaces were reconstructed from T1w structural images using FreeSurfer and aligned to the 32k fs_LR standard surface space. This standard 32k fs_LR cortical surface consists of 32,492 vertices sparsely connected, forming triangular faces. Functional data were later aligned with this standard surface space.
Functional retinotopic mapping data were acquired using a Siemens 7T Magnetom scanner at 1.6 mm isotropic resolution and 1 s TR. Data were preprocessed following the HCP pipeline (Glasser et al., 2013), which included correction for head motion and EPI spatial distortion, alignment of the fMRI data with the HCP standard surface space, and denoising for spatially specific structured noise. Retinotopic mapping stimuli comprised rotating wedges, expanding and contracting rings, and bars of different orientations moving across different directions in the visual field. A population receptive field (pRF) modeling procedure was then used to reconstruct visual field maps (Benson et al., 2018; Dumoulin and Wandell, 2008; Kay et al., 2013), which encompasses estimating the spatial preference of cortical surface vertices to different locations of the visual field (i.e., its receptive field) defined in polar coordinates – for more, see Benson et al, (2018). Hence, polar angle maps are retinotopic maps reflecting the polar angle (angle relative to the horizontal vertical meridian) in the visual field to which a vertex is most responsive, while eccentricity maps reflect the distance from the center of the visual field (i.e., the fixation point). The combination of a polar angle map and an eccentricity map completely specifies a map of the visual field.
Region of Interest
Early visual areas were defined by a surface-based probabilistic atlas (Wang et al., 2015). This probabilistic atlas includes the dorsal and ventral portions of V1, V2 and V3, not including the foveal confluence. For the clustering analysis, we slightly modified the atlas by extending the dorsal border of V3 and including V1/V2/V3 foveal confluence (Schira et al., 2009), in line with our previous work (Ribeiro et al., 2021).
Individual variability
We determined individual variability in visual field maps to quantify how variable these maps were across visual areas (V1, V2, and V3), portions (dorsal and ventral), and hemispheres (left and right) in human early visual cortex. First, we computed the average retinotopic maps across all 181 individuals from the HCP retinotopy dataset for both left and right hemispheres. Then, we iteratively calculated the vertex-wise difference between an individual’s retinotopic map and the average map. The difference between two angles is given by: for 0< θ< 2π.
Finally, vertex-wise difference scores were averaged over vertices in the range of 1-8° of eccentricity within the dorsal and ventral portions of early visual areas, resulting in one scalar value per individual per visual area, which we refer to as the individual variability. The eccentricity mask was defined using the group-average eccentricity map. This range of eccentricity values was chosen because, in the original population receptive field mapping experiment of the HCP, the visual stimulus extended to 8° of eccentricity (Benson et al., 2018). Additionally, due to the inherent difficulty in mapping the foveal confluence (Schira et al., 2009), we constrained our comparison to eccentricity values above 1°. According to studies in non-human primates, this corresponds approximately to half of the expected extent of V1, V2 and V3 (Gattass et al., 1988, 1981).
Linear mixed-effects model
We determined whether there were main effects and interactions of hemispheres (left, right), visual areas (V1, V2, V3), and portions (dorsal, ventral) on individual variability of retinotopic maps using linear mixed-effect (LME) models. Standard ANOVAs and t- tests assume statistical independence of individuals’ data (Yu et al., 2022), which is often not the case. For example, the 7T HCP retinotopy dataset includes data from 50 monozygotic and 34 dizygotic twins, totaling 168 individuals out of 181. Therefore, to meet the statistical independence criterion, many data points would have to be disregarded for standard statistical inference. However, LME models allow us to take full advantage of the dataset by explicitly modeling cluster-specific means (random intercepts). Indeed, individual variability from different visual areas is naturally clustered by individuals (Magezi, 2015). Therefore, using this statistical model, we can appropriately model individual-specific effects (Magezi, 2015; Yu et al., 2022).
In our linear mixed effect model, the dependent variable is the individual variability (Y), which is modeled as a function of the fixed effects (β) of three factors (x) and their interactions. These three factors are: hemisphere, visual area, and portion. Additionally, we also consider the random effects (γi) associated with the individual (i = 1, …, 181), and the random effects of each factor nested within the individual (γij, with j = 1, 2, and 3). This model is expressed as:
where β¤ is the intercept and ε is the residual random error. We built two separate models for individual variability associated with polar angle and eccentricity maps using Jamovi (“The jamovi project (2021),” n.d.).
Clusters of spatial organization
Lastly, we performed an exploratory clustering analysis to determine whether retinotopic maps differ from the average map in similar ways, particularly in the dorsal portion of early visual cortex. Specifically, we investigated the spatial overlap between retinotopic maps as an unambiguous indicator of the similarity between two maps. First, to obtain such a measure of the spatial overlap, the continuous polar angle maps were converted into discrete maps, such that each vertex was categorized into one out of four possible labels: these categories were chosen because they highlight the location of visual area
boundaries. Discrete eccentricity maps were determined by: Next, the spatial overlap between discrete maps from all possible pairs of individuals was estimated using the Jaccard similarity coefficient (Levandowsky and Winter, 1971; Taha and Hanbury, 2015). The Jaccard index estimates similarity between two maps by taking the size of the intersection (in number of vertices) divided by the size of the union of two label sets. Hence, the Jaccard score ranges from 0 to 1; the closer to 1 the score is, the more similar the two maps are. For our data and each pair of individuals, the Jaccard index is determined from the two possible individuals’ combinations (i.e., individual 1 vs. individual 2 and individual 2 vs. individual 1) since the order of the maps determines which map is the reference one. For each combination, we estimated the Jaccard index for each label, and their weighted average was determined using the number of labels’ instances in the reference map to account for label imbalance. Then, these two estimates were averaged, resulting in one estimate of the spatial overlap between two individuals’ discrete retinotopic maps.
To assess whether inter-individual differences fell into stereotyped patterns, we applied a spectral clustering algorithm from Scikit-learn (Abraham et al., 2014; Pedregosa et al., 2011). This algorithm operates on the low-dimensional embedding of the affinity matrix (our Jaccard index-based similarity matrix), followed by K-means clustering of the components of the eigenvectors in the low-dimensional space. This low dimensional space is determined by selecting the most relevant eigenvectors of the graph Laplacian of the affinity matrix, of which corresponding eigenvalues reflect important properties of the affinity matrix that can be used to partition it (Luxburg, 2007). In implementing the spectral clustering algorithm, we set the number of clusters to 6 and fixed the random state for replication purposes. We selected this number of clusters as there are at least five different models of third-tier visual cortex organization in non-human primates (Angelucci and Rosa, 2015), with a sixth cluster intended to capture noisy or unclear retinotopic organization. After clustering, we computed each cluster’s mean map by averaging the continuous retinotopic maps across individuals within each cluster.
Data and code availability
The data used in this study is publicly available at BALSA (https://balsa.wustl.edu/study/show/9Zkk). All accompanying Python source code will be available upon publication on GitHub.
Results
We defined an individual variability metric to quantify how variable visual field maps are across visual areas (V1, V2, and V3), portions (dorsal and ventral), and hemispheres (left and right) in human early visual cortex. First, we computed the average visual field maps across all 181 individuals from the HCP retinotopy dataset for both left and right hemispheres. Then, we iteratively calculated the difference between an individual’s visual field map and the average map. Finally, these differences were averaged over all vertices within the dorsal and ventral portions of early visual areas, resulting in one scalar value per individual per visual area, which is our individual variability metric. Figure 2 shows the distribution of individual variability scores across all participants.
We built a linear mixed effect model (Yu et al., 2022) to test the fixed effects of hemispheres, visual areas, and portions on individual variability of polar angle (Table 1) and eccentricity (Table 2) maps. Table 1 shows statistically significant main effects of all factors on individual variability of polar angle maps. Specifically, polar angle maps of the left hemisphere show higher individual variability than those found in the right hemisphere (mean difference = 3.35, p<.001). The dorsal portions of early visual areas are also more variable than the ventral portions (mean difference = 3.30, p<.001). Finally, post-hoc comparisons of visual areas indicated that V3 has higher individual variability than V2 (mean difference = 1.60, p<.001) and V1 (mean difference = 3.99, p<.001); V2 also has higher individual variability than V1 (mean difference = 2.38, p<.001). For brevity, we only show the main effects in Table 1, although we also found statistically significant interactions. Briefly, each visual area in the left hemisphere has significantly higher individual variability than its analogous area in the right hemisphere. In addition, the dorsal portion of each visual area of the left hemisphere is significantly more variable than its dorsal analogue in the right hemisphere and the ventral analogue of both the left and right hemispheres (for more, see the Supplementary Material). These findings suggest that individual variability in polar angle representations varies across hemispheres, visual areas, and according to dorsal/ventral locations.
Moreover, Table 2 shows statistically significant main effects of the hemisphere, visual area, and the visual area portion on individual variability of eccentricity maps. Like polar angle maps, eccentricity maps of the left hemisphere show higher individual variability than those in the right hemisphere (mean difference = 0.14, p<.001). The dorsal portion of early visual areas is also more variable than the ventral portion (mean difference = 0.13, p<.001). For visual areas, post-hoc comparisons indicated that the only statistically significant difference was that of V3 versus V1, with V3 having higher individual variability than V1 (mean difference = 0.05, p<.004). In addition, statistically significant interactions were also found (Supplementary Material). Each visual area in the left hemisphere has significantly higher individual variability than analogous areas in the right hemisphere, except for V3. Eccentricity maps of each visual area’s dorsal portion in the left hemisphere are significantly more variable than the dorsal counterpart in the right hemisphere, and the ventral analogues in both the left and the right hemispheres.
Next, we performed an exploratory analysis to determine whether retinotopic maps differ from the average map in similar ways, particularly in the dorsal portion of early visual cortex of the left hemisphere. We focus on results for polar angle maps here as no meaningful differences were observed across eccentricity map clusters (Supplementary Figure 1). We computed the extent of overlap between discrete polar angle maps from all possible pairs of individuals using the Jaccard index, resulting in a similarity matrix (Figure 3a). Next, we applied a spectral clustering algorithm with a fixed number of clusters equal to 6 (Figure 3b). Finally, we averaged the continuous polar angle maps across individuals within each cluster to visualize common patterns of retinotopic organization in the dorsal portion of early visual cortex (Figure 3c).
Our findings clearly indicate shared patterns of retinotopic organization that deviate from the typical polar angle representation in the dorsal portion of early visual cortex (Figure 1c). Specifically, average maps from clusters 1 and 5 capture nearly a third of individuals and show typical polar angle representations, with clear boundaries between V1/V2 and V2/V3 (Figure 1c and Figure 3c). However, clusters 2, 3, and 4 capture nearly two thirds of individuals and deviate from this typical polar angle representation (Figure 3c). The average map from cluster 2 shows that the boundaries between V1 and V2, and the most anterior portion of V3 and higher-order visual areas, merge to form a Y-shaped (or forked) lower vertical representation. Clusters 3 and 4 show a truncated V3 boundary, indicating that dorsal V3 does not cover the entire quarter visual field (i.e., from 360° to 270°) either throughout its length or only in its most anterior portion. Finally, cluster 6 reflects unclear retinotopic organization, with a handful of individuals’ retinotopic maps showing overall low correspondence with the typical retinotopic organization.
Qualitatively, individual maps seem to agree with their corresponding average cluster map, but there are some exceptions (Figure 4, Supplementary Figure 2). Figure 4 shows the average cluster maps from each cluster and examples of individuals’ maps that are qualitatively similar and dissimilar to their corresponding average cluster map. While most polar angle maps correspond well with their average cluster maps (as seen in the middle row of Figure 4), there is also an apparent mismatch between a few maps and their corresponding cluster average (bottom row in Figure 4). For example, individual #132118 was assigned to Cluster 4, but their polar angle map is qualitatively more similar to Cluster 5. These mismatches are likely due to the extensive overlap between within-cluster and between-clusters distributions of pairwise Jaccard scores (Figure 5). Note in Figure 5 that the within-cluster distributions highlighted in grey are generally shifted to the right compared to the between-clusters distributions, indicating their higher Jaccard scores. However, the overlap between these distributions is substantial. For example, the between cluster 1 and 5 distribution overlaps with within- cluster 1 distribution throughout its entirety, which is justified by the significant similarity between their average maps. Despite this, we found that the average within- cluster Jaccard score is 0.54 (SD = 0.07), while the average between-clusters score is 0.46 (SD = .08), showing that pairs of maps within a cluster are, on average, more similar than between-clusters.
Discussion
We systematically investigated individual variability in visual field representation of human early visual cortex using the HCP 7T retinotopy dataset. We found that retinotopic maps in the left hemisphere were more variable than those in the right hemisphere. Moreover, in the left hemisphere the dorsal portions of early visual areas were more variable than their ventral counterparts. Additionally, we investigated whether there are common motifs in the observed individual variability in retinotopic maps. This analysis showed that deviations from the canonical model of continuous, alternating bands of vertical and horizontal meridian representation in V2 and V3 exist in the majority of individuals. Overall, our findings challenge the current view that the dorsal portions of early visual areas form retinotopic maps which are consistent between individuals as roughly mirror images of their ventral counterparts.
Although previous evidence for the variability seen across dorsal early visual cortex in humans has been mostly anecdotal, a number of studies have indicated a complex, retinotopic organization of dorsal early visual areas in non-human primates, using both electrophysiological recordings and high-resolution fMRI (Angelucci and Rosa, 2015; Gattass et al., 1988; Sereno et al., 2015; Zhu and Vanduffel, 2019). Accordingly, there is a long-standing debate about the number of visual areas – and their boundaries – in the third-tier visual cortex of New and Old-World monkeys (Angelucci and Rosa, 2015; Hadjidimitrakis et al., 2019). However, the question of whether the areal boundaries in this region show significant individual variability has not been studied systematically in non-human primates. Only Gattass et al. (1988) reported, in the macaque monkey, that the representation of the lower vertical meridian in dorsal V3 varied across individuals, but firm conclusions could not be drawn due to the small sample. These authors indicated that some animals showed a continuous representation of this meridian along the rostral border of this area, whereas in others additional field discontinuities created a discontinuous representation. Notably, the same discontinuities in the anterior border of dorsal V3 were also found in our systematic investigation of individual variability in human polar angle maps. It is also significant that the same pattern of variation (relatively simple and reproducible representations of the upper contralateral quadrant, and complex and variable representations of the lower quadrant) characterize V2 and V3 in at least one non-primate, the cat (Rosa and Manger, 2005; Tusa et al., 1979). Overall, our findings in humans demonstrate that the organization of dorsal early visual areas is more heterogeneous than previously acknowledged and suggest that this may be a common feature of mammals with developed vision.
Although different models of third-tier visual cortex organization in non-human primates (Angelucci and Rosa, 2015) also suggest unusual eccentricity mapping, we did not find meaningful differences in clusters of eccentricity maps. This may be associated with the limited extent of the visual stimulus (up to 8° of eccentricity) (Benson et al., 2018) and remains to be further investigated. Another alternative is having a complex pattern of polar angle representation coexisting with a preserved eccentricity gradient, as demonstrated by previous work in areas V2 and V3 of cats (Tusa et al., 1979), flying foxes (Rosa, 1999), ferrets (Manger et al., 2002) and tree shrews (Sedigh-Sarvestani et al., 2021).
Our investigation provides firm evidence for individual variability in the retinotopic organization across parts of early visual areas in the human visual cortex. Moreover, the exploratory analysis indicates the presence of shared patterns of retinotopic organization that deviate from the typical polar angle representation in the dorsal portion of early visual cortex. Future work could extend these insights through additional analyses – for example, by employing different similarity metrics, using different features, or changing the number of clusters. Here, we limited our analysis to the spatial overlap of discrete polar angle maps, which means that a pair of qualitatively similar but spatially misaligned polar angle maps, for example, might have a low Jaccard score. If another more suitable metric can consider the topographic organization of polar angle maps regardless of the spatial location, it would be possible to increase the consistency between an individual’s map and their cluster average map. It would also be possible to estimate the similarity between two individuals’ retinotopic maps from specific features extracted from the maps (such as linear magnification along isoeccentricity lines), to provide insights into changes in these properties as a function of cortical location (Schira et al., 2010). Finally, it is important to note that selecting the ideal number of clusters depends on the similarity metric employed, prior knowledge, and the clustering algorithm. Therefore, future work could be performed to explore the effect of the number of clusters on clustering quality (perhaps as indicated by within- vs. between-cluster similarity measures).
Given the presence of the variability across early visual cortex in humans, another potential line of investigation involves the origin of this variability. Pertinently, we recently developed a deep learning model of retinotopy able to predict this individual variability from individual-specific cortical curvature and myelin maps (Ribeiro et al., 2021), suggesting that it is a structure-related variation. In our subsequent work (Ribeiro et al., 2022), we further explored this model of retinotopy to unravel which anatomical feature (curvature or myelin) was the most important for individual variability in the dorsal portion of early visual cortex. Although we found neither feature was redundant, the model seems to be differentially relying on myelin feature maps to determine individual variability in the dorsal portion of early visual cortex. Studies modelling the formation of retinotopic maps in development have suggested that multistable solutions may occur depending on factors such as the degree of elongation of the area (Sedigh-Sarvestani et al., 2021; Wolf et al., 1994) and adjacency with other areas (Yu et al., 2020), which do not violate the need to minimize the length of connections (Durbin and Mitchison, 1990; Swindale, 1996). Therefore, future work could evaluate whether there is an overlap between function- and anatomy-based clusters to help elucidate the developmental mechanisms underlying the variability of human dorsal extrastriate cortex.
Finally, another finding that requires consideration is the interhemispheric difference revealed in our data: retinotopic maps in the left hemisphere showed more variation than those in the right hemisphere. To date, there has been no report of interhemispheric differences in early visual cortex of other mammals, including non-human primates. In part, this may be traced to the relatively small samples in these studies, in comparison with those possible using human fMRI. However, another possibility is that such differences may arise more frequently in human brains, due to the scaling of callosal connections with brain size (Rilling and Insel, 1999), which may promote a higher degree of connectional independence during development.
In conclusion, using a large-scale brain imaging dataset, we provide new insights into the variability in the topographical organization of human visual cortex. These insights may prove crucial in guiding further experimental investigations and theories about retinotopic organization differentiation across species, development, and individuals.
Competing financial interests
The authors declare no competing financial interests.
Acknowledgments
This work was supported by the Australian Research Council (DE180100433 and DP210101042). Data were provided by the Human Connectome Project, WU-Minn Consortium (Principal Investigators: David Van Essen and Kamil Ugurbil; 1U54MH091657) funded by the 16 NIH Institutes and Centers that support the NIH Blueprint for Neuroscience Research; and by the McDonnell Center for Systems Neuroscience at Washington University. In addition, FLR acknowledges support through the Australian Government Research Training Program Scholarship.
Footnotes
↵¶ Joint senior authors