Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

TRex, a fast multi-animal tracking system with markerless identification, and 2D estimation of posture and visual fields

View ORCID ProfileTristan Walter, View ORCID ProfileIain D Couzin
doi: https://doi.org/10.1101/2020.10.14.338996
Tristan Walter
1Max Planck Institute of Animal Behavior, Germany
2Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Germany
3Department of Biology, University of Konstanz, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Tristan Walter
  • For correspondence: twalter@ab.mpg.de icouzin@ab.mpg.de
Iain D Couzin
1Max Planck Institute of Animal Behavior, Germany
2Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Germany
3Department of Biology, University of Konstanz, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Iain D Couzin
  • For correspondence: twalter@ab.mpg.de icouzin@ab.mpg.de
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Automated visual tracking of animals is rapidly becoming an indispensable tool for the study of behavior. It offers a quantitative methodology by which organisms’ sensing and decision-making can be studied in a wide range of ecological contexts. Despite this, existing solutions tend to be challenging to deploy in practice, especially when considering long and/or high-resolution video-streams. Here, we present TRex, a fast and easy-to-use solution for tracking a large number of individuals simultaneously using background-subtraction with real-time (60Hz) tracking performance for up to approximately 256 individuals and estimates 2D visual-fields, outlines, and head/rear of bilateral animals, both in open and closed-loop contexts. Additionally, TRex offers highly-accurate, deep-learning-based visual identification of up to approximately 100 unmarked individuals, where it is between 2.5-46.7 times faster, and requires 2-10 times less memory, than comparable software (with relative performance increasing for more organisms/longer videos) and provides interactive data-exploration within an intuitive, platform-independent graphical user-interface.

Competing Interest Statement

The authors have declared no competing interest.

Footnotes

  • Revised document structure, reordered sections Results; Discussion; Materials&Methods Revised title and citations, as well as some URLs and figure images.

  • https://trex.run

  • a opencv.org

  • b tensorflow.org

  • c deeplearning.net

  • d The baslerweb.com Pylon SDK is required to be installed to support Basler USB cameras.

  • a See keras.io documentation for default arguments

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted February 23, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
TRex, a fast multi-animal tracking system with markerless identification, and 2D estimation of posture and visual fields
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
TRex, a fast multi-animal tracking system with markerless identification, and 2D estimation of posture and visual fields
Tristan Walter, Iain D Couzin
bioRxiv 2020.10.14.338996; doi: https://doi.org/10.1101/2020.10.14.338996
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
TRex, a fast multi-animal tracking system with markerless identification, and 2D estimation of posture and visual fields
Tristan Walter, Iain D Couzin
bioRxiv 2020.10.14.338996; doi: https://doi.org/10.1101/2020.10.14.338996

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Animal Behavior and Cognition
Subject Areas
All Articles
  • Animal Behavior and Cognition (2516)
  • Biochemistry (4961)
  • Bioengineering (3462)
  • Bioinformatics (15165)
  • Biophysics (6878)
  • Cancer Biology (5374)
  • Cell Biology (7699)
  • Clinical Trials (138)
  • Developmental Biology (4514)
  • Ecology (7127)
  • Epidemiology (2059)
  • Evolutionary Biology (10204)
  • Genetics (7495)
  • Genomics (9762)
  • Immunology (4815)
  • Microbiology (13167)
  • Molecular Biology (5124)
  • Neuroscience (29342)
  • Paleontology (203)
  • Pathology (834)
  • Pharmacology and Toxicology (1460)
  • Physiology (2126)
  • Plant Biology (4728)
  • Scientific Communication and Education (1008)
  • Synthetic Biology (1337)
  • Systems Biology (4001)
  • Zoology (768)