A transferable approach for quantifying benthic fish sizes and densities in annotated underwater images

Abstract Benthic fishes are a common target of scientific monitoring but are difficult to quantify because of their close association to bottom habitats that are hard to access. Advances in image‐acquisition technologies, machine vision and deep learning have made capturing and quantifying fishes wi...

Full description

Saved in:
Bibliographic Details
Main Authors: Peter C. Esselman, Shadi Moradi, Joseph Geisz, Christopher Roussi
Format: Article
Language:English
Published: Wiley 2025-01-01
Series:Methods in Ecology and Evolution
Subjects:
Online Access:https://doi.org/10.1111/2041-210X.14453
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841555319031857152
author Peter C. Esselman
Shadi Moradi
Joseph Geisz
Christopher Roussi
author_facet Peter C. Esselman
Shadi Moradi
Joseph Geisz
Christopher Roussi
author_sort Peter C. Esselman
collection DOAJ
description Abstract Benthic fishes are a common target of scientific monitoring but are difficult to quantify because of their close association to bottom habitats that are hard to access. Advances in image‐acquisition technologies, machine vision and deep learning have made capturing and quantifying fishes with cameras increasingly feasible. We present a method and open‐source software called ‘FishScale’ to estimate benthic fish lengths, numeric abundance and biomass density in underwater environments assessed with down‐looking monocular images. ‘FishScale’ estimates fish abundances and size frequencies from near‐nadir monocular images where fish have already been semantically segmented. The software accounts for lens distortion, underwater magnification effects and fish body curvature to automatically estimate fish lengths and the areas of images where they were captured. Numeric and biomass density are estimated through a deterministic machine vision algorithm that requires a user‐provided length‐weight relationship for species of interest and calibration images. Results from validation studies show that lengths and weights can be estimated with high accuracy and precision for round goby (Neogobius melanostomus) captured in distorted action camera images, and from large‐bodied lake trout (Salvelinus namaycush) imaged with a machine vision camera. The real‐world utility of the approach is demonstrated in a case study estimating round goby abundances and size frequencies along a 10.7‐km transect surveyed with an autonomous underwater vehicle in Lake Michigan, USA. Our validation studies demonstrate that the approach estimates benthic and benthopelagic fish lengths and weights with little bias and good accuracy and precision for species with much different body shapes and sizes. The method is applicable to data collected using a variety of nadir imaging approaches with widespread applications to fisheries monitoring and quantification of any species or object for which nadir images and working distances between the camera and feature of interest are available.
format Article
id doaj-art-68dc78a8db8d4e79ac030a7750ea2223
institution Kabale University
issn 2041-210X
language English
publishDate 2025-01-01
publisher Wiley
record_format Article
series Methods in Ecology and Evolution
spelling doaj-art-68dc78a8db8d4e79ac030a7750ea22232025-01-08T05:44:10ZengWileyMethods in Ecology and Evolution2041-210X2025-01-0116114515910.1111/2041-210X.14453A transferable approach for quantifying benthic fish sizes and densities in annotated underwater imagesPeter C. Esselman0Shadi Moradi1Joseph Geisz2Christopher Roussi3U.S. Geological Survey Great Lakes Science Center Ann Arbor Michigan USAGreat Lakes Research Center, Michigan Technological University Houghton Michigan USAGreat Lakes Research Center, Michigan Technological University Houghton Michigan USAMichigan Tech Research Institute Ann Arbor Michigan USAAbstract Benthic fishes are a common target of scientific monitoring but are difficult to quantify because of their close association to bottom habitats that are hard to access. Advances in image‐acquisition technologies, machine vision and deep learning have made capturing and quantifying fishes with cameras increasingly feasible. We present a method and open‐source software called ‘FishScale’ to estimate benthic fish lengths, numeric abundance and biomass density in underwater environments assessed with down‐looking monocular images. ‘FishScale’ estimates fish abundances and size frequencies from near‐nadir monocular images where fish have already been semantically segmented. The software accounts for lens distortion, underwater magnification effects and fish body curvature to automatically estimate fish lengths and the areas of images where they were captured. Numeric and biomass density are estimated through a deterministic machine vision algorithm that requires a user‐provided length‐weight relationship for species of interest and calibration images. Results from validation studies show that lengths and weights can be estimated with high accuracy and precision for round goby (Neogobius melanostomus) captured in distorted action camera images, and from large‐bodied lake trout (Salvelinus namaycush) imaged with a machine vision camera. The real‐world utility of the approach is demonstrated in a case study estimating round goby abundances and size frequencies along a 10.7‐km transect surveyed with an autonomous underwater vehicle in Lake Michigan, USA. Our validation studies demonstrate that the approach estimates benthic and benthopelagic fish lengths and weights with little bias and good accuracy and precision for species with much different body shapes and sizes. The method is applicable to data collected using a variety of nadir imaging approaches with widespread applications to fisheries monitoring and quantification of any species or object for which nadir images and working distances between the camera and feature of interest are available.https://doi.org/10.1111/2041-210X.14453benthic fishfisheries assessmentmachine visionmonitoringsize estimation
spellingShingle Peter C. Esselman
Shadi Moradi
Joseph Geisz
Christopher Roussi
A transferable approach for quantifying benthic fish sizes and densities in annotated underwater images
Methods in Ecology and Evolution
benthic fish
fisheries assessment
machine vision
monitoring
size estimation
title A transferable approach for quantifying benthic fish sizes and densities in annotated underwater images
title_full A transferable approach for quantifying benthic fish sizes and densities in annotated underwater images
title_fullStr A transferable approach for quantifying benthic fish sizes and densities in annotated underwater images
title_full_unstemmed A transferable approach for quantifying benthic fish sizes and densities in annotated underwater images
title_short A transferable approach for quantifying benthic fish sizes and densities in annotated underwater images
title_sort transferable approach for quantifying benthic fish sizes and densities in annotated underwater images
topic benthic fish
fisheries assessment
machine vision
monitoring
size estimation
url https://doi.org/10.1111/2041-210X.14453
work_keys_str_mv AT petercesselman atransferableapproachforquantifyingbenthicfishsizesanddensitiesinannotatedunderwaterimages
AT shadimoradi atransferableapproachforquantifyingbenthicfishsizesanddensitiesinannotatedunderwaterimages
AT josephgeisz atransferableapproachforquantifyingbenthicfishsizesanddensitiesinannotatedunderwaterimages
AT christopherroussi atransferableapproachforquantifyingbenthicfishsizesanddensitiesinannotatedunderwaterimages
AT petercesselman transferableapproachforquantifyingbenthicfishsizesanddensitiesinannotatedunderwaterimages
AT shadimoradi transferableapproachforquantifyingbenthicfishsizesanddensitiesinannotatedunderwaterimages
AT josephgeisz transferableapproachforquantifyingbenthicfishsizesanddensitiesinannotatedunderwaterimages
AT christopherroussi transferableapproachforquantifyingbenthicfishsizesanddensitiesinannotatedunderwaterimages