Language models generalize beyond natural proteins

Robert Verkuil; Ori Kabeli; Yilun Du; Basile I. M. Wicky; Lukas F. Milles; Justas Dauparas; David Baker; Sergey Ovchinnikov; Tom Sercu; Alexander Rives

doi:10.1101/2022.12.21.521521

New Results

Language models generalize beyond natural proteins

Robert Verkuil, Ori Kabeli, Yilun Du, Basile I. M. Wicky, Lukas F. Milles, Justas Dauparas, David Baker, Sergey Ovchinnikov, Tom Sercu, Alexander Rives

doi: https://doi.org/10.1101/2022.12.21.521521

Robert Verkuil

1Meta Fundamental AI Research Protein Team (FAIR)

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Ori Kabeli

1Meta Fundamental AI Research Protein Team (FAIR)

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Yilun Du

1Meta Fundamental AI Research Protein Team (FAIR)

2Massachusetts Institute of Technology. Work performed as visiting researcher at Meta FAIR

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Basile I. M. Wicky

3Department of Biochemistry, University of Washington, Seattle, WA, USA

4Institute for Protein Design, University of Washington, Seattle, WA, USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Lukas F. Milles

3Department of Biochemistry, University of Washington, Seattle, WA, USA

4Institute for Protein Design, University of Washington, Seattle, WA, USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Justas Dauparas

3Department of Biochemistry, University of Washington, Seattle, WA, USA

4Institute for Protein Design, University of Washington, Seattle, WA, USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

David Baker

3Department of Biochemistry, University of Washington, Seattle, WA, USA

4Institute for Protein Design, University of Washington, Seattle, WA, USA

5Howard Hughes Medical Institute, University of Washington, Seattle, WA, USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Sergey Ovchinnikov

6John Harvard Distinguished Science Fellowship Program, Harvard University, Cambridge, MA, USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Tom Sercu

1Meta Fundamental AI Research Protein Team (FAIR)

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Alexander Rives

1Meta Fundamental AI Research Protein Team (FAIR)

7New York University

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
For correspondence: arives@meta.com

Abstract
Full Text
Info/History
Metrics
Data/Code
Preview PDF

https://github.com/facebookresearch/esm

View the discussion thread.

PreviousNext

Posted December 22, 2022.

Download PDF

Data/Code

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Your Email *

Your Name *

Send To *

Enter multiple addresses on separate lines or separate them with commas.

You are going to email the following Language models generalize beyond natural proteins

Message Subject (Your Name) has forwarded a page to you from bioRxiv

Message Body (Your Name) thought you would like to see this page from the bioRxiv website.

Your Personal Message

CAPTCHA

This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Language models generalize beyond natural proteins

Robert Verkuil, Ori Kabeli, Yilun Du, Basile I. M. Wicky, Lukas F. Milles, Justas Dauparas, David Baker, Sergey Ovchinnikov, Tom Sercu, Alexander Rives

bioRxiv 2022.12.21.521521; doi: https://doi.org/10.1101/2022.12.21.521521

Share This Article:

Citation Tools

Language models generalize beyond natural proteins

Robert Verkuil, Ori Kabeli, Yilun Du, Basile I. M. Wicky, Lukas F. Milles, Justas Dauparas, David Baker, Sergey Ovchinnikov, Tom Sercu, Alexander Rives

bioRxiv 2022.12.21.521521; doi: https://doi.org/10.1101/2022.12.21.521521

Citation Manager Formats

BibTeX
Bookends
EasyBib
EndNote (tagged)
EndNote 8 (xml)
Medlars
Mendeley
Papers
RefWorks Tagged
Ref Manager
RIS
Zotero

Tweet Widget
Facebook Like
Google Plus One

Subject Area

Synthetic Biology

Subject Areas

All Articles

Animal Behavior and Cognition (4854)
Biochemistry (10796)
Bioengineering (8045)
Bioinformatics (27306)
Biophysics (13987)
Cancer Biology (11127)
Cell Biology (16057)
Clinical Trials (138)
Developmental Biology (8784)
Ecology (13292)
Epidemiology (2067)
Evolutionary Biology (17363)
Genetics (11689)
Genomics (15923)
Immunology (11033)
Microbiology (26089)
Molecular Biology (10649)
Neuroscience (56558)
Paleontology (418)
Pathology (1732)
Pharmacology and Toxicology (3005)
Physiology (4547)
Plant Biology (9630)
Scientific Communication and Education (1615)
Synthetic Biology (2689)
Systems Biology (6978)
Zoology (1510)