Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

A pipeline for assessing the quality of images and metadata from crowd-sourced databases

J. Billotte
doi: https://doi.org/10.1101/2022.04.29.490112
J. Billotte
1Colorado State University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: jackie.billotte@colostate.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Crowd-sourced biodiversity databases provide easy access to data and images for ecological education and research. One concern with using publicly sourced databases; however, is the quality of their images, taxonomic descriptions, and geographical metadata. To address this concern and allow researchers and educators to make informed decisions about using crowd-sourced data, I developed a suite of pipelines to evaluate taxonomic consistency, how well geo-tagging fits known distributions, and image quality of crowd-sourced biodiversity data of the order Araneae (spiders) from iNaturalist. This pipeline allows users to analyze multiple images from iNaturalist and their associated metadata; to determine the level of taxonomic identification (family, genera, species) for each occurrence; whether the taxonomy label for an image matches accepted nesting of families, genera, and species; and whether geo-tags match the distribution of the taxon described using occurrence data from the Global Biodiversity Infrastructure Facility (GBIF) as a reference. Additionally, I assessed image quality with the MatLab algorithm, BRISQUE. I used entries from the order Araneae (spiders) as a case study. At the time of my analyses (July 2021), I found that iNaturalist contained at least one observation for 124 of the 129 families of Araneae, and 115 families had three or more unique observations, with relatively similar quality of metadata and image quality across families. Taxonomic consistency was similar for observations identified at the genus and species level, but lower in observations with only family level identification. Observations with species level identifications had higher precision for geo-tags compared to those identified to the family or genus level and the highest image quality according to the BRISQUE scores. Overall, the results suggest that iNaturalist can provide large metadata and images sets for research. Given the inevitability of some low-quality observations, this pipeline provides a valuable resource for researchers and educators to evaluate the quality of iNaturalist and other crowd-sourced data.

Competing Interest Statement

The authors have declared no competing interest.

Footnotes

  • https://github.com/jackiebillotte/Observation_Database_Assesment.git

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.
Back to top
PreviousNext
Posted May 01, 2022.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
A pipeline for assessing the quality of images and metadata from crowd-sourced databases
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
A pipeline for assessing the quality of images and metadata from crowd-sourced databases
J. Billotte
bioRxiv 2022.04.29.490112; doi: https://doi.org/10.1101/2022.04.29.490112
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
A pipeline for assessing the quality of images and metadata from crowd-sourced databases
J. Billotte
bioRxiv 2022.04.29.490112; doi: https://doi.org/10.1101/2022.04.29.490112

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Zoology
Subject Areas
All Articles
  • Animal Behavior and Cognition (3514)
  • Biochemistry (7365)
  • Bioengineering (5342)
  • Bioinformatics (20318)
  • Biophysics (10041)
  • Cancer Biology (7773)
  • Cell Biology (11348)
  • Clinical Trials (138)
  • Developmental Biology (6450)
  • Ecology (9979)
  • Epidemiology (2065)
  • Evolutionary Biology (13354)
  • Genetics (9370)
  • Genomics (12607)
  • Immunology (7724)
  • Microbiology (19087)
  • Molecular Biology (7459)
  • Neuroscience (41134)
  • Paleontology (300)
  • Pathology (1235)
  • Pharmacology and Toxicology (2142)
  • Physiology (3177)
  • Plant Biology (6878)
  • Scientific Communication and Education (1276)
  • Synthetic Biology (1900)
  • Systems Biology (5328)
  • Zoology (1091)