Fuel detection in forest environments training deep learners with smartphone imagery

Unmixing mixtures in images is one of the challenges for extracting information from data. Forest environments are particularly complex due to the relatively irregular structure of trees, shrubs and low vegetation. The amount and condition of vegetation, i.e. thin vs thick branches, trunk vs leaves,...

Full description

Saved in:
Bibliographic Details
Main Authors: F. Pirotti, A. Carmelo, E. Kutchartt
Format: Article
Language:English
Published: Copernicus Publications 2025-07-01
Series:ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://isprs-annals.copernicus.org/articles/X-G-2025/649/2025/isprs-annals-X-G-2025-649-2025.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849704492858081280
author F. Pirotti
F. Pirotti
A. Carmelo
E. Kutchartt
E. Kutchartt
E. Kutchartt
author_facet F. Pirotti
F. Pirotti
A. Carmelo
E. Kutchartt
E. Kutchartt
E. Kutchartt
author_sort F. Pirotti
collection DOAJ
description Unmixing mixtures in images is one of the challenges for extracting information from data. Forest environments are particularly complex due to the relatively irregular structure of trees, shrubs and low vegetation. The amount and condition of vegetation, i.e. thin vs thick branches, trunk vs leaves, understorey and litter provide information to infer the amount of burnable fuel and consequently a key factor for predict fire behaviour. In this work we test a deep learning framework for training and testing the performance of detecting logs and litter of broadleaves and conifers in imagery of forest environments recorded through smartphones. Roboflow and YOLOv8 were employed, using a dataset of forest images manually segmented in four classes: “broadleaf-litter”, “broadleaf-logs”, “conifer-litter” and “conifer-logs”. The results indicate that the "Extra-large Instance Segmentation" model achieved the best performance with F1-score value of 0.79 at a confidence of 0.763 on familiar images in the validation phase with 214 epochs, whereas the "Large Instance Segmentation" model was more effective on new images in the test phase, as expected with a lower F1-score of 0.24 and a confidence value of 0.492. It was observed that this was due mostly to omission errors due to low light conditions in the forestry environment. We conclude that segmenting key elements and including varied images in terms of seasonality and lighting conditions could potentially improve performance. This work lays a useful foundation for refining the use of AI in forest fuel monitoring.
format Article
id doaj-art-7b8fa592dfb5464592982ab9e5efb013
institution DOAJ
issn 2194-9042
2194-9050
language English
publishDate 2025-07-01
publisher Copernicus Publications
record_format Article
series ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj-art-7b8fa592dfb5464592982ab9e5efb0132025-08-20T03:16:45ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502025-07-01X-G-202564965610.5194/isprs-annals-X-G-2025-649-2025Fuel detection in forest environments training deep learners with smartphone imageryF. Pirotti0F. Pirotti1A. Carmelo2E. Kutchartt3E. Kutchartt4E. Kutchartt5Department of Land, Environment, Agriculture and Forestry (TESAF), University of Padova. Via dell’Università 16, 35020 Legnaro, ItalyInterdepartmental Research Centre in Geomatics (CIRGEO), University of Padova. Corte Benedettina, Via Roma 34, 35020 Legnaro, ItalyDepartment of Land, Environment, Agriculture and Forestry (TESAF), University of Padova. Via dell’Università 16, 35020 Legnaro, ItalyDepartment of Land, Environment, Agriculture and Forestry (TESAF), University of Padova. Via dell’Università 16, 35020 Legnaro, ItalyForest Science and Technology Centre of Catalonia (CTFC). Carretera de Sant Llorenç de Morunys Km 2, 25280 Solsona, SpainJoint Research Unit CTFC – AGROTECNIO. Carretera de Sant Llorenç de Morunys Km 2, 25280 Solsona, SpainUnmixing mixtures in images is one of the challenges for extracting information from data. Forest environments are particularly complex due to the relatively irregular structure of trees, shrubs and low vegetation. The amount and condition of vegetation, i.e. thin vs thick branches, trunk vs leaves, understorey and litter provide information to infer the amount of burnable fuel and consequently a key factor for predict fire behaviour. In this work we test a deep learning framework for training and testing the performance of detecting logs and litter of broadleaves and conifers in imagery of forest environments recorded through smartphones. Roboflow and YOLOv8 were employed, using a dataset of forest images manually segmented in four classes: “broadleaf-litter”, “broadleaf-logs”, “conifer-litter” and “conifer-logs”. The results indicate that the "Extra-large Instance Segmentation" model achieved the best performance with F1-score value of 0.79 at a confidence of 0.763 on familiar images in the validation phase with 214 epochs, whereas the "Large Instance Segmentation" model was more effective on new images in the test phase, as expected with a lower F1-score of 0.24 and a confidence value of 0.492. It was observed that this was due mostly to omission errors due to low light conditions in the forestry environment. We conclude that segmenting key elements and including varied images in terms of seasonality and lighting conditions could potentially improve performance. This work lays a useful foundation for refining the use of AI in forest fuel monitoring.https://isprs-annals.copernicus.org/articles/X-G-2025/649/2025/isprs-annals-X-G-2025-649-2025.pdf
spellingShingle F. Pirotti
F. Pirotti
A. Carmelo
E. Kutchartt
E. Kutchartt
E. Kutchartt
Fuel detection in forest environments training deep learners with smartphone imagery
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title Fuel detection in forest environments training deep learners with smartphone imagery
title_full Fuel detection in forest environments training deep learners with smartphone imagery
title_fullStr Fuel detection in forest environments training deep learners with smartphone imagery
title_full_unstemmed Fuel detection in forest environments training deep learners with smartphone imagery
title_short Fuel detection in forest environments training deep learners with smartphone imagery
title_sort fuel detection in forest environments training deep learners with smartphone imagery
url https://isprs-annals.copernicus.org/articles/X-G-2025/649/2025/isprs-annals-X-G-2025-649-2025.pdf
work_keys_str_mv AT fpirotti fueldetectioninforestenvironmentstrainingdeeplearnerswithsmartphoneimagery
AT fpirotti fueldetectioninforestenvironmentstrainingdeeplearnerswithsmartphoneimagery
AT acarmelo fueldetectioninforestenvironmentstrainingdeeplearnerswithsmartphoneimagery
AT ekutchartt fueldetectioninforestenvironmentstrainingdeeplearnerswithsmartphoneimagery
AT ekutchartt fueldetectioninforestenvironmentstrainingdeeplearnerswithsmartphoneimagery
AT ekutchartt fueldetectioninforestenvironmentstrainingdeeplearnerswithsmartphoneimagery