Three-Dimensional Reconstruction, Phenotypic Traits Extraction, and Yield Estimation of Shiitake Mushrooms Based on Structure from Motion and Multi-View Stereo

Phenotypic traits of fungi and their automated extraction are crucial for evaluating genetic diversity, breeding new varieties, and estimating yield. However, research on the high-throughput, rapid, and non-destructive extraction of fungal phenotypic traits using 3D point clouds remains limited. In...

Full description

Saved in:
Bibliographic Details
Main Authors: Xingmei Xu, Jiayuan Li, Jing Zhou, Puyu Feng, Helong Yu, Yuntao Ma
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Agriculture
Subjects:
Online Access:https://www.mdpi.com/2077-0472/15/3/298
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Phenotypic traits of fungi and their automated extraction are crucial for evaluating genetic diversity, breeding new varieties, and estimating yield. However, research on the high-throughput, rapid, and non-destructive extraction of fungal phenotypic traits using 3D point clouds remains limited. In this study, a smart phone is used to capture multi-view images of shiitake mushrooms (<i>Lentinula edodes</i>) from three different heights and angles, employing the YOLOv8x model to segment the primary image regions. The segmented images were reconstructed in 3D using Structure from Motion (SfM) and Multi-View Stereo (MVS). To automatically segment individual mushroom instances, we developed a CP-PointNet++ network integrated with clustering methods, achieving an overall accuracy (OA) of 97.45% in segmentation. The computed phenotype correlated strongly with manual measurements, yielding <i>R</i><sup>2</sup> > 0.8 and <i>nRMSE</i> < 0.09 for the pileus transverse and longitudinal diameters, <i>R</i><sup>2</sup> = 0.53 and <i>RMSE</i> = 3.26 mm for the pileus height, <i>R</i><sup>2</sup> = 0.79 and <i>nRMSE</i> = 0.12 for stipe diameter, and <i>R</i><sup>2</sup> = 0.65 and RMSE = 4.98 mm for the stipe height. Using these parameters, yield estimation was performed using PLSR, SVR, RF, and GRNN machine learning models, with GRNN demonstrating superior performance (<i>R</i><sup>2</sup> = 0.91). This approach was also adaptable for extracting phenotypic traits of other fungi, providing valuable support for fungal breeding initiatives.
ISSN:2077-0472