Over the last four decades, a range of different neuroimaging tools have been used to study
human auditory attention, spanning from classic event-related potential studies using …

Crossmodal integration is a term applicable to many phenomena in which one sensory
modality influences task performance or perception in another sensory modality. We distinguish …

We devise a cascade GAN approach to generate talking face video, which is robust to different
face shapes, view angles, facial characteristics, and noisy audio conditions. Instead of …

Cross-modality generation is an emerging topic that aims to synthesize data in one modality
based on information in a different modality. In this paper, we consider a task of such: given …

… The same measures were quantified for 38% of the responses by the other author (RK M).
The intraclass correlation coefficient (ICC3) for each frequency and measure was ≥ 0.9 (the …

How and where in the brain audio-visual signals are bound to create multimodal objects
remains unknown. One hypothesis is that temporal coherence between dynamic multisensory …

10.7554/eLife.04995.001 In noisy settings, listening is aided by correlated dynamic visual
cues gleaned from a talker's face—an improvement often attributed to visually reinforced …

The presence of a corresponding talking face has been shown to significantly improve
speech intelligibility in noisy conditions and for hearing impaired population. In this paper, we …

Speech is an ecologically essential signal, whose processing crucially involves the subcortical
nuclei of the auditory brainstem, but there are few experimental options for studying these …

The present study demonstrates, for the first time, a specific enhancement of auditory spatial
cue discrimination due to eye gaze. Whereas the region of sharpest visual acuity, called the …