New Results

Transformer protein language models are unsupervised structure learners

Roshan Rao, Joshua Meier, Tom Sercu, Sergey Ovchinnikov, Alexander Rives
doi: https://doi.org/10.1101/2020.12.15.422761

Article Information

doi 
https://doi.org/10.1101/2020.12.15.422761
History 
  • December 15, 2020.
Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.

Author Information

  1. Roshan Rao1,*,*,
  2. Joshua Meier2,
  3. Tom Sercu3,
  4. Sergey Ovchinnikov4 and
  5. Alexander Rives5
  1. 1UC Berkeley, rmrao{at}berkeley.edu
  2. 2Facebook AI Research, jmeier{at}fb.com
  3. 3Facebook AI Research, tsercu{at}fb.com
  4. 4Harvard University, so{at}g.harvard.edu
  5. 5Facebook AI Research & New York University, arives{at}cs.nyu.edu
  1. ↵* Corresponding author; email: roshan_rao{at}berkeley.edu
Back to top
Posted December 15, 2020.
Download PDF
Data/Code
Email
Transformer protein language models are unsupervised structure learners
Roshan Rao, Joshua Meier, Tom Sercu, Sergey Ovchinnikov, Alexander Rives
bioRxiv 2020.12.15.422761; doi: https://doi.org/10.1101/2020.12.15.422761
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools

Subject Area