Detecting the direction of motion of an object is essential for our representation of the visual environment. The visual cortex is one of the main stages in the mammalian nervous system in which the direction of motion may be computed de novo. Experiments and theories indicate that cortical neurons respond selectively to motion direction by combining inputs that provide information about distinct spatial locations with distinct time delays. Despite the importance of this spatiotemporal offset for direction selectivity, its origin and cellular mechanisms are not fully understood. We show that approximately 80 ± 10 thalamic neurons, which respond with distinct time courses to stimuli in distinct locations, excite mouse visual cortical neurons during visual stimulation. The integration of thalamic inputs with the appropriate spatiotemporal offset provides cortical neurons with a primordial bias for direction selectivity. These data show how cortical neurons selectively combine the spatiotemporal response diversity of thalamic neurons to extract fundamental features of the visual world.