The selectivity of neuronal responses arises from the architecture of excitatory and inhibitory connections. In the primary visual cortex, the selectivity of a neuron in layer 2/3 for stimulus orientation and direction is thought to arise from intracortical inputs that are similarly selective1-8. However, the excitatory inputs of a neuron can have diverse stimulus preferences1-4,6,7,9, and inhibitory inputs can be promiscuous10 and unselective11. Here we show that the excitatory and inhibitory intracortical connections to a layer 2/3 neuron accord with its selectivity by obeying precise spatial patterns. We used rabies tracing1,12 to label and functionally image the excitatory and inhibitory inputs to individual pyramidal neurons of layer 2/3 of the mouse visual cortex. Presynaptic excitatory neurons spanned layers 2/3 and 4 and were distributed coaxial to the preferred orientation of the postsynaptic neuron, favouring the region opposite to its preferred direction. By contrast, presynaptic inhibitory neurons resided within layer 2/3 and favoured locations near the postsynaptic neuron and ahead of its preferred direction. The direction selectivity of a postsynaptic neuron was unrelated to the selectivity of presynaptic neurons, but correlated with the spatial displacement between excitatory and inhibitory presynaptic ensembles. Similar asymmetric connectivity establishes direction selectivity in the retina13-17. This suggests that this circuit motif might be canonical in sensory processing.