Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Reproducible big data science: A case study in continuous FAIRness

View ORCID ProfileRavi Madduri, Kyle Chard, Mike D’ Arcy, Segun C. Jung, Alexis Rodriguez, Dinanath Sulakhe, Eric W. Deutsch, Cory Funk, Ben Heavner, Matthew Richards, Paul Shannon, Gustavo Glusman, Nathan Price, Carl Kesselman, View ORCID ProfileIan Foster
doi: https://doi.org/10.1101/268755
Ravi Madduri
1Globus, University of Chicago, Chicago, Illinois, United States of America
2Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ravi Madduri
Kyle Chard
1Globus, University of Chicago, Chicago, Illinois, United States of America
2Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mike D’ Arcy
3Information Sciences Institute, University of Southern California, Los Angeles, California, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Segun C. Jung
1Globus, University of Chicago, Chicago, Illinois, United States of America
2Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexis Rodriguez
1Globus, University of Chicago, Chicago, Illinois, United States of America
2Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dinanath Sulakhe
1Globus, University of Chicago, Chicago, Illinois, United States of America
2Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eric W. Deutsch
4Institute for Systems Biology, Seattle, Washington, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Cory Funk
4Institute for Systems Biology, Seattle, Washington, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ben Heavner
5Department of Biostatistics, School of Public Health, University of Washington, Seattle, Washington, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew Richards
4Institute for Systems Biology, Seattle, Washington, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul Shannon
4Institute for Systems Biology, Seattle, Washington, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gustavo Glusman
4Institute for Systems Biology, Seattle, Washington, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nathan Price
4Institute for Systems Biology, Seattle, Washington, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carl Kesselman
3Information Sciences Institute, University of Southern California, Los Angeles, California, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ian Foster
1Globus, University of Chicago, Chicago, Illinois, United States of America
2Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois, United States of America
6Department of Computer Science, University of Chicago, Chicago, Illinois, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ian Foster
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

Abstract

Big biomedical data create exciting opportunities for discovery, but make it difficult to capture analyses and outputs in forms that are findable, accessible, interoperable, and reusable (FAIR). In response, we describe tools that make it easy to capture, and assign identifiers to, data and code throughout the data lifecycle. We illustrate the use of these tools via a case study involving a multi-step analysis that creates an atlas of putative transcription factor binding sites from terabytes of ENCODE DNase I hypersensitive sites sequencing data. We show how the tools automate routine but complex tasks, capture analysis algorithms in understandable and reusable forms, and harness fast networks and powerful cloud computers to process data rapidly, all without sacrificing usability or reproducibility—thus ensuring that big data are not hard-to-(re)use data. We compare and contrast our approach with other approaches to big data analysis and reproducibility.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted June 20, 2018.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Reproducible big data science: A case study in continuous FAIRness
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Reproducible big data science: A case study in continuous FAIRness
Ravi Madduri, Kyle Chard, Mike D’ Arcy, Segun C. Jung, Alexis Rodriguez, Dinanath Sulakhe, Eric W. Deutsch, Cory Funk, Ben Heavner, Matthew Richards, Paul Shannon, Gustavo Glusman, Nathan Price, Carl Kesselman, Ian Foster
bioRxiv 268755; doi: https://doi.org/10.1101/268755
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Reproducible big data science: A case study in continuous FAIRness
Ravi Madduri, Kyle Chard, Mike D’ Arcy, Segun C. Jung, Alexis Rodriguez, Dinanath Sulakhe, Eric W. Deutsch, Cory Funk, Ben Heavner, Matthew Richards, Paul Shannon, Gustavo Glusman, Nathan Price, Carl Kesselman, Ian Foster
bioRxiv 268755; doi: https://doi.org/10.1101/268755

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Bioinformatics
Subject Areas
All Articles
  • Animal Behavior and Cognition (4222)
  • Biochemistry (9095)
  • Bioengineering (6733)
  • Bioinformatics (23916)
  • Biophysics (12066)
  • Cancer Biology (9484)
  • Cell Biology (13720)
  • Clinical Trials (138)
  • Developmental Biology (7614)
  • Ecology (11644)
  • Epidemiology (2066)
  • Evolutionary Biology (15459)
  • Genetics (10610)
  • Genomics (14281)
  • Immunology (9447)
  • Microbiology (22749)
  • Molecular Biology (9056)
  • Neuroscience (48811)
  • Paleontology (354)
  • Pathology (1478)
  • Pharmacology and Toxicology (2558)
  • Physiology (3817)
  • Plant Biology (8299)
  • Scientific Communication and Education (1466)
  • Synthetic Biology (2285)
  • Systems Biology (6163)
  • Zoology (1295)