Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.
Japanese table grapes are quite expensive because their production is highly labor-intensive. In particular, grape berry pruning is a labor-intensive task performed to produce grapes with desirable characteristics. Because it is considered difficult to master, it is desirable to assist new entrants...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2025-01-01
|
Series: | PLoS ONE |
Online Access: | https://doi.org/10.1371/journal.pone.0317359 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1825206814065557504 |
---|---|
author | Yasuto Tamura Yuzuko Utsumi Yuka Miwa Masakazu Iwamura Koichi Kise |
author_facet | Yasuto Tamura Yuzuko Utsumi Yuka Miwa Masakazu Iwamura Koichi Kise |
author_sort | Yasuto Tamura |
collection | DOAJ |
description | Japanese table grapes are quite expensive because their production is highly labor-intensive. In particular, grape berry pruning is a labor-intensive task performed to produce grapes with desirable characteristics. Because it is considered difficult to master, it is desirable to assist new entrants by using information technology to show the recommended berries to cut. In this research, we aim to build a system that identifies which grape berries should be removed during the pruning process. To realize this, the 3D positions of individual grape berries need to be estimated. Our environmental restriction is that bunches hang from trellises at a height of about 1.6 meters in the grape orchards outside. It is hard to use depth sensors in such circumstances, and using an omnidirectional camera with a wide field of view is desired for the convenience of shooting videos. Obtaining 3D information of grape berries from videos is challenging because they have textureless surfaces, highly symmetric shapes, and crowded arrangements. For these reasons, it is hard to use conventional 3D reconstruction methods, which rely on matching local unique features. To satisfy the practical constraints of this task, we extend a deep learning-based unsupervised monocular depth estimation method to an omnidirectional camera and propose using it. Our experiments demonstrate the effectiveness of the proposed method for estimating the 3D positions of grape berries in the wild. |
format | Article |
id | doaj-art-a734e68bd32344ec80532ad6335b6b04 |
institution | Kabale University |
issn | 1932-6203 |
language | English |
publishDate | 2025-01-01 |
publisher | Public Library of Science (PLoS) |
record_format | Article |
series | PLoS ONE |
spelling | doaj-art-a734e68bd32344ec80532ad6335b6b042025-02-07T05:30:57ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01202e031735910.1371/journal.pone.0317359Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild.Yasuto TamuraYuzuko UtsumiYuka MiwaMasakazu IwamuraKoichi KiseJapanese table grapes are quite expensive because their production is highly labor-intensive. In particular, grape berry pruning is a labor-intensive task performed to produce grapes with desirable characteristics. Because it is considered difficult to master, it is desirable to assist new entrants by using information technology to show the recommended berries to cut. In this research, we aim to build a system that identifies which grape berries should be removed during the pruning process. To realize this, the 3D positions of individual grape berries need to be estimated. Our environmental restriction is that bunches hang from trellises at a height of about 1.6 meters in the grape orchards outside. It is hard to use depth sensors in such circumstances, and using an omnidirectional camera with a wide field of view is desired for the convenience of shooting videos. Obtaining 3D information of grape berries from videos is challenging because they have textureless surfaces, highly symmetric shapes, and crowded arrangements. For these reasons, it is hard to use conventional 3D reconstruction methods, which rely on matching local unique features. To satisfy the practical constraints of this task, we extend a deep learning-based unsupervised monocular depth estimation method to an omnidirectional camera and propose using it. Our experiments demonstrate the effectiveness of the proposed method for estimating the 3D positions of grape berries in the wild.https://doi.org/10.1371/journal.pone.0317359 |
spellingShingle | Yasuto Tamura Yuzuko Utsumi Yuka Miwa Masakazu Iwamura Koichi Kise Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild. PLoS ONE |
title | Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild. |
title_full | Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild. |
title_fullStr | Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild. |
title_full_unstemmed | Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild. |
title_short | Unsupervised monocular depth estimation with omnidirectional camera for 3D reconstruction of grape berries in the wild. |
title_sort | unsupervised monocular depth estimation with omnidirectional camera for 3d reconstruction of grape berries in the wild |
url | https://doi.org/10.1371/journal.pone.0317359 |
work_keys_str_mv | AT yasutotamura unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild AT yuzukoutsumi unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild AT yukamiwa unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild AT masakazuiwamura unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild AT koichikise unsupervisedmonoculardepthestimationwithomnidirectionalcamerafor3dreconstructionofgrapeberriesinthewild |