Analysis of regional corpus callosum fiber composition reveals that callosal regions connecting primary and secondary sensory areas tend to have higher proportions of coarse-diameter, highly myelinated fibers than callosal regions connecting so-called higher-order areas. This suggests that in primary/secondary sensory areas there are strong timing constraints for interhemispheric communication, which may be related to the process of midline fusion of the two sensory hemifields across the hemispheres. We postulate that the evolutionary origin of the corpus callosum in placental mammals is related to the mechanism of midline fusion in the sensory cortices, which only in mammals receive a topographically organized representation of the sensory surfaces. The early corpus callosum may have also served as a substrate for growth of fibers connecting higher-order areas, which possibly participated in the propagation of neuronal ensembles of synchronized activity between the hemispheres. However, as brains became much larger, the increasingly longer interhemispheric distance may have worked as a constraint for efficient callosal transmission. Callosal fiber composition tends to be quite uniform across species with different brain sizes, suggesting that the delay in callosal transmission is longer in bigger brains. There is only a small subset of large-diameter callosal fibers whose size increases with increasing interhemispheric distance. These limitations in interhemispheric connectivity may have favored the development of brain lateralization in some species like humans.