TY - JOUR T1 - Individual tree-crown detection in RGB imagery using self-supervised deep learning neural networks JF - bioRxiv DO - 10.1101/532952 SP - 532952 AU - Ben. G. Weinstein AU - Sergio Marconi AU - Stephanie Bohlman AU - Alina Zare AU - Ethan White Y1 - 2019/01/01 UR - http://biorxiv.org/content/early/2019/01/28/532952.abstract N2 - Remote sensing can transform the speed, scale, and cost of biodiversity and forestry surveys. Data acquisition currently outpaces the ability to identify individual organisms in high resolution imagery. We outline an approach for identifying tree-crowns in true color, or red/green blue (RGB) imagery using a deep learning detection network. Individual crown delineation is a persistent challenge in studies of forested ecosystems and has primarily been addressed using three-dimensional LIDAR. We show that deep learning models can leverage existing lidar-based unsupervised delineation approaches to initially train an RGB crown detection model, which is then refined using a small number of hand-annotated RGB images. We validate our proposed approach using an open-canopy site in the National Ecological Observation Network (NEON). Our results show that combining LIDAR and RGB methods in a self-supervised model improves predictions of trees in natural landscapes. The addition of a small number of hand-annotated trees improved performance over the initial self-supervised model. While undercounting of individual trees in complex canopies remains an area of development, deep learning can increase the performance of remotely sensed tree surveys. ER -