User profiles for J. Uszkoreit

Jakob Uszkoreit

- Verified email at uszkoreit.net - Cited by 173722

Julian Uszkoreit

- Verified email at rub.de - Cited by 7915

The PRIDE database and related tools and resources in 2019: improving support for quantification data

…, E Pérez, J Uszkoreit, J Pfeuffer… - Nucleic acids …, 2019 - academic.oup.com
The PRoteomics IDEntifications (PRIDE) database ( https://www.ebi.ac.uk/pride/ ) is the
world’s largest data repository of mass spectrometry-based proteomics data, and is one of the …

Mlp-mixer: An all-mlp architecture for vision

…, A Steiner, D Keysers, J Uszkoreit… - Advances in neural …, 2021 - proceedings.neurips.cc
Convolutional Neural Networks (CNNs) are the go-to model for computer vision. Recently,
attention-based networks, such as the Vision Transformer, have also become popular. In this …

Attention is all you need

A Waswani, N Shazeer, N Parmar, J Uszkoreit, L Jones… - NIPS, 2017 - aiotlab.org
… 𝒌 𝒋 𝒗 𝒋 … 𝒌 𝒋,𝟐 𝒌 𝒋,𝟏 𝒗 𝒋,𝟐 𝒗 𝒋,𝟏 …

An image is worth 16x16 words: Transformers for image recognition at scale

…, M Minderer, G Heigold, S Gelly, J Uszkoreit… - arXiv preprint arXiv …, 2020 - arxiv.org
While the Transformer architecture has become the de-facto standard for natural language
processing tasks, its applications to computer vision remain limited. In vision, attention is …

Attention is all you need

…, N Shazeer, N Parmar, J Uszkoreit… - Advances in neural …, 2017 - proceedings.neurips.cc
The dominant sequence transduction models are based on complex recurrent orconvolutional
neural networks in an encoder and decoder configuration. The best performing such …

Natural questions: a benchmark for question answering research

…, M Kelcey, MW Chang, AM Dai, J Uszkoreit… - Transactions of the …, 2019 - direct.mit.edu
… ) is the associated Wikipedia document, and a (i) is a vector with components a j ( i ) for j =
1 … 5. Each a j ( i ) is the output from the j’th annotator, and can be a paragraph in d (i) , or can …

[HTML][HTML] A proteomics sample metadata representation for multiomics integration and big data analysis

…, M Turewicz, M Eisenacher, J Uszkoreit… - Nature …, 2021 - nature.com
The amount of public proteomics data is rapidly increasing but there is no standardized format
to describe the sample metadata and their relationship with the dataset files in a way that …

Self-attention with relative position representations

P Shaw, J Uszkoreit, A Vaswani - arXiv preprint arXiv:1803.02155, 2018 - arxiv.org
Relying entirely on an attention mechanism, the Transformer introduced by Vaswani et al. (2017)
achieves state-of-the-art results for machine translation. In contrast to recurrent and …

A decomposable attention model for natural language inference

AP Parikh, O Täckström, D Das, J Uszkoreit - arXiv preprint arXiv …, 2016 - arxiv.org
We propose a simple neural architecture for natural language inference. Our approach uses
attention to decompose the problem into subproblems that can be solved separately, thus …

Image transformer

N Parmar, A Vaswani, J Uszkoreit… - International …, 2018 - proceedings.mlr.press
Image generation has been successfully cast as an autoregressive sequence generation or
transformation problem. Recent work has shown that self-attention is an effective way of …