A New Method for Counting Reproductive Structures in Digitized Herbarium Specimens Using Mask R-CNN - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Frontiers in Plant Science Année : 2020

A New Method for Counting Reproductive Structures in Digitized Herbarium Specimens Using Mask R-CNN

Résumé

Phenology—the timing of life-history events—is a key trait for understanding responses of organisms to climate. The digitization and online mobilization of herbarium specimens is rapidly advancing our understanding of plant phenological response to climate and climatic change. The current practice of manually harvesting data from individual specimens, however, greatly restricts our ability to scale-up data collection. Recent investigations have demonstrated that machine-learning approaches can facilitate this effort. However, present attempts have focused largely on simplistic binary coding of reproductive phenology (e.g., presence/absence of flowers). Here, we use crowd-sourced phenological data of buds, flowers, and fruits from >3,000 specimens of six common wildflower species of the eastern United States (Anemone canadensis L., A. hepatica L., A. quinquefolia L., Trillium erectum L., T. grandiflorum (Michx.) Salisb., and T. undulatum Wild.) to train models using Mask R-CNN to segment and count phenological features. A single global model was able to automate the binary coding of each of the three reproductive stages with >87% accuracy. We also successfully estimated the relative abundance of each reproductive structure on a specimen with ≥90% accuracy. Precise counting of features was also successful, but accuracy varied with phenological stage and taxon. Specifically, counting flowers was significantly less accurate than buds or fruits likely due to their morphological variability on pressed specimens. Moreover, our Mask R-CNN model provided more reliable data than non-expert crowd-sourcers but not botanical experts, highlighting the importance of high-quality human training data. Finally, we also demonstrated the transferability of our model to automated phenophase detection and counting of the three Trillium species, which have large and conspicuously-shaped reproductive organs. These results highlight the promise of our two-phase crowd-sourcing and machine-learning pipeline to segment and count reproductive features of herbarium specimens, thus providing high-quality data with which to investigate plant responses to ongoing climatic change.
Fichier principal
Vignette du fichier
fpls-11-01129-1-1.pdf (2.01 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02909794 , version 1 (31-07-2020)

Identifiants

Citer

Charles C. Davis, Julien Champ, Daniel Park, Ian Breckheimer, Goia Lyra, et al.. A New Method for Counting Reproductive Structures in Digitized Herbarium Specimens Using Mask R-CNN. Frontiers in Plant Science, 2020, 11, ⟨10.3389/fpls.2020.01129⟩. ⟨hal-02909794⟩
162 Consultations
144 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More