RT Journal Article
SR Electronic
T1 Deep Learning Based Registration of Serial Whole-slide Histopathology Images in Different Stains
JF bioRxiv
FD Cold Spring Harbor Laboratory
SP 2022.05.31.494254
DO 10.1101/2022.05.31.494254
A1 Mousumi Roy
A1 Fusheng Wang
A1 George Teodoro
A1 Ritu Aneja
A1 other paper in another context
A1 Jun Kong
YR 2022
UL http://biorxiv.org/content/early/2022/06/01/2022.05.31.494254.abstract
AB Whole-slide image (WSI) analysis has been largely performed in a 2D tissue space to support routine pathology diagnosis and imaging based biomedical research. For a more definitive representation and characterization of the tissue spatial space, it is critical to extend such tissue based investigations to a 3D space by spatially aligning 2D serial sections, which are often stained differently, such as Hematoxylin and Eosin (H&E) and Immunohistochemistry (IHC) stains. However, registration of whole slide images is challenged by the overwhelmingly scale of images, the complexity of local histology structure changes across slides, and significant variations of tissue appearance between staining methods. We propose a novel translation based registration network CycGANReg-Net using deep learning for serial WSI images in different stains, which requires no prior deformation field information for deep model training. We first generate synthetic IHC slides from H&E slides through a robust image synthesis algorithm. The synthetic IHC images and the real IHC images are then registered through a Fully Convolutional Network with multi-scale based deformable vector fields and a joint loss optimization for enhancing image alignment. We perform the registration at original image resolution with a patch-wide approach, thus tissue details at the highest resolution are retained in the results. CycGANRegNet out-performs both the state-of-the-art conventional and deep learning-based registration methods based on the evaluation using a serial WSI image dataset in H&E stain and IHC stain with two biomarkers from 76 breast cancer patients. The experimental and comparison results demonstrate that CycGANRegNet can produce promising registration results with serial WSIs in different stains, suggesting its potential for integrative 3D tissue-based biomedical investigations.Competing Interest StatementThe authors have declared no competing interest.