The latency of saccadic movements to targets appearing at various positions in three-dimensional visual space was measured in four experiments. The first experiment confirmed that latencies of saccades to visual targets are greater in the lower visual field and showed that the increase is not influenced by the vertical starting position of the eye in the orbit, nor by a time gap between the fixation offset and the target onset. A hypothesis that this visual field difference was caused by a link between downward saccades and convergence movements was tested by recording saccade latencies when the targets were in a different depth plane from that of the original fixation. We did not find any direct support for the vergence involvement hypothesis, although the lower/upper visual field effect was shown to decrease consistently in monocular viewing. It was also shown that saccades to targets positioned in a different depth plane have longer latencies. In a final experiment, the visual field effect was shown to depend on the egocentric rather than the gravitational vertical.