Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Deep Bayesian networks for uncertainty estimation and adversarial resistance of white matter hyperintensity segmentation

View ORCID ProfileParisa Mojiri Forooshani, Mahdi Biparva, Emmanuel E. Ntiri, View ORCID ProfileJoel Ramirez, Lyndon Boone, Melissa F. Holmes, Sabrina Adamo, Fuqiang Gao, Miracle Ozzoude, Christopher J.M. Scott, View ORCID ProfileDar Dowlatshahi, View ORCID ProfileJane M. Lawrence-Dewar, Donna Kwan, Anthony E. Lang, Karine Marcotte, Carol Leonard, Elizabeth Rochon, Chris Heyn, Robert Bartha, Stephen Strother, Jean-Claude Tardif, Sean Symons, Mario Masellis, Richard H. Swartz, Alan Moody, Sandra E. Black, View ORCID ProfileMaged Goubran
doi: https://doi.org/10.1101/2021.08.18.456666
Parisa Mojiri Forooshani
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Parisa Mojiri Forooshani
Mahdi Biparva
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emmanuel E. Ntiri
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joel Ramirez
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Joel Ramirez
Lyndon Boone
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
17Department of Medical Biophysics, University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Melissa F. Holmes
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sabrina Adamo
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fuqiang Gao
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Miracle Ozzoude
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christopher J.M. Scott
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dar Dowlatshahi
3Department of Medicine, University of Ottawa Brain and Mind Institute, the Ottawa Hospital Research Institute, Ottawa, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Dar Dowlatshahi
Jane M. Lawrence-Dewar
4Thunder Bay Regional Health Research Institute, Thunder Bay, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jane M. Lawrence-Dewar
Donna Kwan
5Department of Psychology, Faculty of Health, York University, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anthony E. Lang
6The Edmond J. Safra Program in Parkinson’s Disease, Toronto Western Hospital, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Karine Marcotte
7School of Speech Pathology and Audiology, University of Montreal, Montreal, Canada
8Research Center of Centre intégré universitaire de santé et de services sociaux du Nord-de-l’île-de-Montréal, Montréal, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carol Leonard
9Audiology and Speech-Language Pathology program, School of Rehabilitation Sciences, University of Ottawa, Ottawa, Canada
10Department of Speech-Language Pathology and the Rehabilitation Sciences Institute, University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elizabeth Rochon
10Department of Speech-Language Pathology and the Rehabilitation Sciences Institute, University of Toronto, Toronto, Canada
11KITE Research Institute, Toronto Rehab, University Health Network, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chris Heyn
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
12Department of Medical Imaging, University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert Bartha
13Department of Medical Biophysics, Schulich School of Medicine and Dentistry, Robarts Research Institute, Western University, London, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stephen Strother
14Department of Medical Biophysics, Rotman Research Institute, Baycrest, University of Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jean-Claude Tardif
15Montreal Heart Institute, Universite de Montreal, Montreal, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sean Symons
12Department of Medical Imaging, University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mario Masellis
16Department of Medicine (Neurology division), Sunnybrook HSC and University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard H. Swartz
16Department of Medicine (Neurology division), Sunnybrook HSC and University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alan Moody
12Department of Medical Imaging, University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sandra E. Black
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
16Department of Medicine (Neurology division), Sunnybrook HSC and University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Maged Goubran
1Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, Toronto, Canada
2Heart and Stroke Foundation, Canadian Partnership for Stroke Recovery, Toronto, Canada
17Department of Medical Biophysics, University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Maged Goubran
  • For correspondence: maged.goubran@utoronto.ca
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Preview PDF
Loading

Abstract

White matter hyperintensities (WMH) are frequently observed on structural neuroimaging of elderly populations and are associated with cognitive decline and increased risk of dementia. Many existing WMH segmentation algorithms produce suboptimal results in populations with vascular lesions or brain atrophy, or require parameter tuning and are computationally expensive. Additionally, most algorithms do not generate a confidence estimate of segmentation quality, limiting their interpretation. MRI-based segmentation methods are often sensitive to acquisition protocols, scanners, noise-level, and image contrast, failing to generalize to other populations and out-of-distribution datasets. Given these concerns, we propose a novel Bayesian 3D Convolutional Neural Network (CNN) with a U-Net architecture that automatically segments WMH, provides uncertainty estimates of the segmentation output for quality control and is robust to changes in acquisition protocols. We also provide a second model to differentiate deep and periventricular WMH. 432 subjects were recruited to train the CNNs from four multi-site imaging studies. A separate test set of 158 subjects was used for evaluation, including an unseen multi-site study. We compared our model to two established state-of-the-art techniques (BIANCA and DeepMedic), highlighting its accuracy and efficiency. Our Bayesian 3D U-Net achieved the highest Dice similarity coefficient of 0.89 ± 0.08 and the lowest modified Hausdorff distance of 2.98 ± 4.40 mm. We further validated our models highlighting their robustness on ‘clinical adversarial cases’ simulating data with low signal-to-noise ratio, low resolution, and different contrast (stemming from MRI sequences with different parameters). Our pipeline and models are available at: https://hypermapp3r.readthedocs.io

Competing Interest Statement

The authors have declared no competing interest.

Footnotes

  • ↵* co-senior authors

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted August 23, 2021.
Download PDF

Supplementary Material

Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Deep Bayesian networks for uncertainty estimation and adversarial resistance of white matter hyperintensity segmentation
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Deep Bayesian networks for uncertainty estimation and adversarial resistance of white matter hyperintensity segmentation
Parisa Mojiri Forooshani, Mahdi Biparva, Emmanuel E. Ntiri, Joel Ramirez, Lyndon Boone, Melissa F. Holmes, Sabrina Adamo, Fuqiang Gao, Miracle Ozzoude, Christopher J.M. Scott, Dar Dowlatshahi, Jane M. Lawrence-Dewar, Donna Kwan, Anthony E. Lang, Karine Marcotte, Carol Leonard, Elizabeth Rochon, Chris Heyn, Robert Bartha, Stephen Strother, Jean-Claude Tardif, Sean Symons, Mario Masellis, Richard H. Swartz, Alan Moody, Sandra E. Black, Maged Goubran
bioRxiv 2021.08.18.456666; doi: https://doi.org/10.1101/2021.08.18.456666
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Deep Bayesian networks for uncertainty estimation and adversarial resistance of white matter hyperintensity segmentation
Parisa Mojiri Forooshani, Mahdi Biparva, Emmanuel E. Ntiri, Joel Ramirez, Lyndon Boone, Melissa F. Holmes, Sabrina Adamo, Fuqiang Gao, Miracle Ozzoude, Christopher J.M. Scott, Dar Dowlatshahi, Jane M. Lawrence-Dewar, Donna Kwan, Anthony E. Lang, Karine Marcotte, Carol Leonard, Elizabeth Rochon, Chris Heyn, Robert Bartha, Stephen Strother, Jean-Claude Tardif, Sean Symons, Mario Masellis, Richard H. Swartz, Alan Moody, Sandra E. Black, Maged Goubran
bioRxiv 2021.08.18.456666; doi: https://doi.org/10.1101/2021.08.18.456666

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (4229)
  • Biochemistry (9118)
  • Bioengineering (6753)
  • Bioinformatics (23948)
  • Biophysics (12103)
  • Cancer Biology (9498)
  • Cell Biology (13745)
  • Clinical Trials (138)
  • Developmental Biology (7618)
  • Ecology (11664)
  • Epidemiology (2066)
  • Evolutionary Biology (15479)
  • Genetics (10621)
  • Genomics (14298)
  • Immunology (9468)
  • Microbiology (22808)
  • Molecular Biology (9083)
  • Neuroscience (48896)
  • Paleontology (355)
  • Pathology (1479)
  • Pharmacology and Toxicology (2566)
  • Physiology (3826)
  • Plant Biology (8309)
  • Scientific Communication and Education (1467)
  • Synthetic Biology (2294)
  • Systems Biology (6172)
  • Zoology (1297)