soundscape_IR: A source separation toolbox for exploring acoustic diversity in soundscapes

Abstract Soundscapes contain rich acoustic information associated with animal behaviours, environmental characteristics and human activities, providing opportunities for predicting biodiversity changes and associated drivers. However, assessing the diversity of animal vocalizations remains challengi...

Full description

Saved in:
Bibliographic Details
Main Authors: Yi‐Jen Sun, Shih‐Ching Yen, Tzu‐Hao Lin
Format: Article
Language:English
Published: Wiley 2022-11-01
Series:Methods in Ecology and Evolution
Subjects:
Online Access:https://doi.org/10.1111/2041-210X.13960
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849240367022473216
author Yi‐Jen Sun
Shih‐Ching Yen
Tzu‐Hao Lin
author_facet Yi‐Jen Sun
Shih‐Ching Yen
Tzu‐Hao Lin
author_sort Yi‐Jen Sun
collection DOAJ
description Abstract Soundscapes contain rich acoustic information associated with animal behaviours, environmental characteristics and human activities, providing opportunities for predicting biodiversity changes and associated drivers. However, assessing the diversity of animal vocalizations remains challenging due to the interference of environmental and anthropogenic noise. A tool for separating sound sources and delineating changes in acoustic signals is crucial for an effective assessment of acoustic diversity. We present soundscape_IR, an open‐source Python toolbox dedicated to soundscape information retrieval in which nonnegative matrix factorization is applied. This toolbox provides algorithms for supervised and unsupervised source separation (SS). It also enables the use of a snapshot recording for model training and subsequently applying adaptive and semi‐supervised SS when target species produce sounds with varying features and when unseen sound sources are encountered. Our results demonstrated that SS could enhance the vocalizations of target species, characterize the complexity of vocal repertoires and investigate the spatio‐temporal divergence of soundscapes. In tropical forest soundscapes, the application of SS effectively detected the rutting vocalizations of sika deer and revealed a graded structure in their acoustic characteristics. In subtropical estuarine soundscapes, SS automated the process of identifying distinct biotic and abiotic sounds, and the result uncovered divergent sound compositions between inshore and offshore waters. Implementation of SS in soundscape analysis offers a promising method for streamlining the assessment of acoustic diversity in diverse environments. Future application of SS will open new directions to acoustically quantify ecological interactions across individual, species and ecosystem levels.
format Article
id doaj-art-33476ae6897f49d7bf263be679f97619
institution Kabale University
issn 2041-210X
language English
publishDate 2022-11-01
publisher Wiley
record_format Article
series Methods in Ecology and Evolution
spelling doaj-art-33476ae6897f49d7bf263be679f976192025-08-20T04:00:39ZengWileyMethods in Ecology and Evolution2041-210X2022-11-0113112347235510.1111/2041-210X.13960soundscape_IR: A source separation toolbox for exploring acoustic diversity in soundscapesYi‐Jen Sun0Shih‐Ching Yen1Tzu‐Hao Lin2Biodiversity Research Center Academia Sinica Taipei Taiwan (R.O.C)Center for General Education National Tsing Hua University Hsinchu Taiwan (R.O.C)Biodiversity Research Center Academia Sinica Taipei Taiwan (R.O.C)Abstract Soundscapes contain rich acoustic information associated with animal behaviours, environmental characteristics and human activities, providing opportunities for predicting biodiversity changes and associated drivers. However, assessing the diversity of animal vocalizations remains challenging due to the interference of environmental and anthropogenic noise. A tool for separating sound sources and delineating changes in acoustic signals is crucial for an effective assessment of acoustic diversity. We present soundscape_IR, an open‐source Python toolbox dedicated to soundscape information retrieval in which nonnegative matrix factorization is applied. This toolbox provides algorithms for supervised and unsupervised source separation (SS). It also enables the use of a snapshot recording for model training and subsequently applying adaptive and semi‐supervised SS when target species produce sounds with varying features and when unseen sound sources are encountered. Our results demonstrated that SS could enhance the vocalizations of target species, characterize the complexity of vocal repertoires and investigate the spatio‐temporal divergence of soundscapes. In tropical forest soundscapes, the application of SS effectively detected the rutting vocalizations of sika deer and revealed a graded structure in their acoustic characteristics. In subtropical estuarine soundscapes, SS automated the process of identifying distinct biotic and abiotic sounds, and the result uncovered divergent sound compositions between inshore and offshore waters. Implementation of SS in soundscape analysis offers a promising method for streamlining the assessment of acoustic diversity in diverse environments. Future application of SS will open new directions to acoustically quantify ecological interactions across individual, species and ecosystem levels.https://doi.org/10.1111/2041-210X.13960acoustic diversitydenoisinginformation retrievalnonnegative matrix factorizationsoundscape dynamicsvocal repertoire
spellingShingle Yi‐Jen Sun
Shih‐Ching Yen
Tzu‐Hao Lin
soundscape_IR: A source separation toolbox for exploring acoustic diversity in soundscapes
Methods in Ecology and Evolution
acoustic diversity
denoising
information retrieval
nonnegative matrix factorization
soundscape dynamics
vocal repertoire
title soundscape_IR: A source separation toolbox for exploring acoustic diversity in soundscapes
title_full soundscape_IR: A source separation toolbox for exploring acoustic diversity in soundscapes
title_fullStr soundscape_IR: A source separation toolbox for exploring acoustic diversity in soundscapes
title_full_unstemmed soundscape_IR: A source separation toolbox for exploring acoustic diversity in soundscapes
title_short soundscape_IR: A source separation toolbox for exploring acoustic diversity in soundscapes
title_sort soundscape ir a source separation toolbox for exploring acoustic diversity in soundscapes
topic acoustic diversity
denoising
information retrieval
nonnegative matrix factorization
soundscape dynamics
vocal repertoire
url https://doi.org/10.1111/2041-210X.13960
work_keys_str_mv AT yijensun soundscapeirasourceseparationtoolboxforexploringacousticdiversityinsoundscapes
AT shihchingyen soundscapeirasourceseparationtoolboxforexploringacousticdiversityinsoundscapes
AT tzuhaolin soundscapeirasourceseparationtoolboxforexploringacousticdiversityinsoundscapes