Automatically describing an image with a sentence is a long-standing challenge in computer
vision and natural language processing. Due to recent progress in object detection, …

When building artificial intelligence systems that can reason and answer questions about
visual data, we need diagnostic tests to analyze our progress and discover short-comings. …

This paper presents a novel approach for automatically generating image descriptions:
visual detectors, language models, and multimodal similarity models learnt directly from a …

We present a new dataset with the goal of advancing the state-of-the-art in object recognition
by placing the question of object recognition in the context of the broader question of scene …

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given
an image and a natural language question about the image, the task is to provide an …

The use of object proposals is an effective recent approach for increasing the computational
efficiency of object detection. We propose a novel method for generating object bounding …

In this paper we describe the Microsoft COCO Caption dataset and evaluation server. When
completed, the dataset will contain over one and a half million captions describing over …

The ability to interactively control viewpoint while watching a video is an exciting application
of image-based rendering. The goal of our work is to render dynamic scenes with interactive …

It is well known that contextual and multi-scale representations are important for accurate
visual recognition. In this paper we present the Inside-Outside Net (ION), an object detector that …

In the field of artificial intelligence, a combination of scale in data and model capacity
enabled by unsupervised learning has led to major advances in representation learning and …