Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.

Japanese table grapes are quite expensive because their production is highly labor-intensive. In particular, grape berry pruning is a labor-intensive task performed to produce grapes with desirable characteristics. Because it is considered difficult to master, it is desirable to assist new entrants...

Full description

Saved in:
Bibliographic Details
Main Authors: Yasuto Tamura, Yuzuko Utsumi, Yuka Miwa, Masakazu Iwamura, Koichi Kise
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2025-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0317359
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1825206814065557504
author Yasuto Tamura
Yuzuko Utsumi
Yuka Miwa
Masakazu Iwamura
Koichi Kise
author_facet Yasuto Tamura
Yuzuko Utsumi
Yuka Miwa
Masakazu Iwamura
Koichi Kise
author_sort Yasuto Tamura
collection DOAJ
description Japanese table grapes are quite expensive because their production is highly labor-intensive. In particular, grape berry pruning is a labor-intensive task performed to produce grapes with desirable characteristics. Because it is considered difficult to master, it is desirable to assist new entrants by using information technology to show the recommended berries to cut. In this research, we aim to build a system that identifies which grape berries should be removed during the pruning process. To realize this, the 3D positions of individual grape berries need to be estimated. Our environmental restriction is that bunches hang from trellises at a height of about 1.6 meters in the grape orchards outside. It is hard to use depth sensors in such circumstances, and using an omnidirectional camera with a wide field of view is desired for the convenience of shooting videos. Obtaining 3D information of grape berries from videos is challenging because they have textureless surfaces, highly symmetric shapes, and crowded arrangements. For these reasons, it is hard to use conventional 3D reconstruction methods, which rely on matching local unique features. To satisfy the practical constraints of this task, we extend a deep learning-based unsupervised monocular depth estimation method to an omnidirectional camera and propose using it. Our experiments demonstrate the effectiveness of the proposed method for estimating the 3D positions of grape berries in the wild.
format Article
id doaj-art-a734e68bd32344ec80532ad6335b6b04
institution Kabale University
issn 1932-6203
language English
publishDate 2025-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj-art-a734e68bd32344ec80532ad6335b6b042025-02-07T05:30:57ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01202e031735910.1371/journal.pone.0317359Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.Yasuto TamuraYuzuko UtsumiYuka MiwaMasakazu IwamuraKoichi KiseJapanese table grapes are quite expensive because their production is highly labor-intensive. In particular, grape berry pruning is a labor-intensive task performed to produce grapes with desirable characteristics. Because it is considered difficult to master, it is desirable to assist new entrants by using information technology to show the recommended berries to cut. In this research, we aim to build a system that identifies which grape berries should be removed during the pruning process. To realize this, the 3D positions of individual grape berries need to be estimated. Our environmental restriction is that bunches hang from trellises at a height of about 1.6 meters in the grape orchards outside. It is hard to use depth sensors in such circumstances, and using an omnidirectional camera with a wide field of view is desired for the convenience of shooting videos. Obtaining 3D information of grape berries from videos is challenging because they have textureless surfaces, highly symmetric shapes, and crowded arrangements. For these reasons, it is hard to use conventional 3D reconstruction methods, which rely on matching local unique features. To satisfy the practical constraints of this task, we extend a deep learning-based unsupervised monocular depth estimation method to an omnidirectional camera and propose using it. Our experiments demonstrate the effectiveness of the proposed method for estimating the 3D positions of grape berries in the wild.https://doi.org/10.1371/journal.pone.0317359
spellingShingle Yasuto Tamura
Yuzuko Utsumi
Yuka Miwa
Masakazu Iwamura
Koichi Kise
Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.
PLoS ONE
title Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.
title_full Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.
title_fullStr Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.
title_full_unstemmed Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.
title_short Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.
title_sort unsupervised monocular depth estimation with omnidirectional camera for 3d reconstruction of grape berries in the wild
url https://doi.org/10.1371/journal.pone.0317359
work_keys_str_mv AT yasutotamura unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild
AT yuzukoutsumi unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild
AT yukamiwa unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild
AT masakazuiwamura unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild
AT koichikise unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild