New Results
Convolutions are competitive with transformers for protein sequence pretraining
Kevin K. Yang, View ORCID ProfileAlex X. Lu, Nicolo Fusi
doi: https://doi.org/10.1101/2022.05.19.492714
Kevin K. Yang
1Microsoft Research New England Cambridge, MA, USA
Alex X. Lu
1Microsoft Research New England Cambridge, MA, USA
Nicolo Fusi
1Microsoft Research New England Cambridge, MA, USA
Posted November 21, 2022.
Convolutions are competitive with transformers for protein sequence pretraining
Kevin K. Yang, Alex X. Lu, Nicolo Fusi
bioRxiv 2022.05.19.492714; doi: https://doi.org/10.1101/2022.05.19.492714
Subject Area
Subject Areas
- Biochemistry (11736)
- Bioengineering (8749)
- Bioinformatics (29186)
- Biophysics (14964)
- Cancer Biology (12086)
- Cell Biology (17403)
- Clinical Trials (138)
- Developmental Biology (9418)
- Ecology (14176)
- Epidemiology (2067)
- Evolutionary Biology (18299)
- Genetics (12235)
- Genomics (16795)
- Immunology (11863)
- Microbiology (28066)
- Molecular Biology (11582)
- Neuroscience (60936)
- Paleontology (451)
- Pathology (1870)
- Pharmacology and Toxicology (3238)
- Physiology (4956)
- Plant Biology (10423)
- Synthetic Biology (2883)
- Systems Biology (7338)
- Zoology (1650)