Human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveys
Abstract Drones are an effective tool for animal surveys, capable of generating an abundance of high‐quality ecological data. However, the large volume of ecological data generated introduces an additional problem of the requisite human resources to process and analyse such data. Deep learning model...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2025-06-01
|
| Series: | Methods in Ecology and Evolution |
| Subjects: | |
| Online Access: | https://doi.org/10.1111/2041-210X.70006 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849428513194508288 |
|---|---|
| author | Kal Backman Jared Wood Maquel Brandimarti Chad T. Beranek Adam Roff |
| author_facet | Kal Backman Jared Wood Maquel Brandimarti Chad T. Beranek Adam Roff |
| author_sort | Kal Backman |
| collection | DOAJ |
| description | Abstract Drones are an effective tool for animal surveys, capable of generating an abundance of high‐quality ecological data. However, the large volume of ecological data generated introduces an additional problem of the requisite human resources to process and analyse such data. Deep learning models offer a solution to this challenge, capable of autonomously processing drone footage to detect animals with higher fidelity and lower latency when compared with humans. This work aimed to develop an animal detection architecture that classifies animals in accordance to their location (terrestrial vs. arboreal). The model incorporates human pilot inspired techniques for greater performance and consistency across time. Thermal drone footage across the state of New South Wales, Australia from surveys over a 2+ year period was used to construct a diverse training and validation dataset. A high‐resolution 3D simulation was developed to workload by autonomously generating labelled data to supplement manually labelled field data. The model was evaluated on 130 hours of thermal imagery (14 million images) containing 57 unique animal species where 1637 out of 1719 (95.23%) of human pilot recorded animals were detected. The model achieved an F1 score of 0.9410, a 4.36 percentage point increase in performance over a benchmark YOLOv8 model. Simulated data improved model performance by 1.7x for low data scenarios, lowering data labelling costs due to higher quality image pre‐labels. The proposed animal detection model demonstrates strong reporting accuracy in the detection and tracking of animals. The approach enables widespread adoption of drone‐capturing technology by providing in‐field real‐time assistance, allowing novice pilots to detect animals at the level of experienced pilots, whilst also reducing the burden of report generation and data labelling costs. |
| format | Article |
| id | doaj-art-aa8d38ff02e649ea87c734c1382cf76d |
| institution | Kabale University |
| issn | 2041-210X |
| language | English |
| publishDate | 2025-06-01 |
| publisher | Wiley |
| record_format | Article |
| series | Methods in Ecology and Evolution |
| spelling | doaj-art-aa8d38ff02e649ea87c734c1382cf76d2025-08-20T03:28:41ZengWileyMethods in Ecology and Evolution2041-210X2025-06-011661239125410.1111/2041-210X.70006Human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveysKal Backman0Jared Wood1Maquel Brandimarti2Chad T. Beranek3Adam Roff4New South Wales Department of Climate Change Energy, the Environment and Water Parramatta New South Wales AustraliaNew South Wales Department of Climate Change Energy, the Environment and Water Parramatta New South Wales AustraliaNew South Wales Department of Climate Change Energy, The Environment and Water Newcastle New South Wales AustraliaConservation Science Research Group University of Newcastle Callaghan New South Wales AustraliaNew South Wales Department of Climate Change Energy, The Environment and Water Newcastle New South Wales AustraliaAbstract Drones are an effective tool for animal surveys, capable of generating an abundance of high‐quality ecological data. However, the large volume of ecological data generated introduces an additional problem of the requisite human resources to process and analyse such data. Deep learning models offer a solution to this challenge, capable of autonomously processing drone footage to detect animals with higher fidelity and lower latency when compared with humans. This work aimed to develop an animal detection architecture that classifies animals in accordance to their location (terrestrial vs. arboreal). The model incorporates human pilot inspired techniques for greater performance and consistency across time. Thermal drone footage across the state of New South Wales, Australia from surveys over a 2+ year period was used to construct a diverse training and validation dataset. A high‐resolution 3D simulation was developed to workload by autonomously generating labelled data to supplement manually labelled field data. The model was evaluated on 130 hours of thermal imagery (14 million images) containing 57 unique animal species where 1637 out of 1719 (95.23%) of human pilot recorded animals were detected. The model achieved an F1 score of 0.9410, a 4.36 percentage point increase in performance over a benchmark YOLOv8 model. Simulated data improved model performance by 1.7x for low data scenarios, lowering data labelling costs due to higher quality image pre‐labels. The proposed animal detection model demonstrates strong reporting accuracy in the detection and tracking of animals. The approach enables widespread adoption of drone‐capturing technology by providing in‐field real‐time assistance, allowing novice pilots to detect animals at the level of experienced pilots, whilst also reducing the burden of report generation and data labelling costs.https://doi.org/10.1111/2041-210X.70006animal detectiondrone surveyhuman‐inspired AIsimulated data generationthermal image detection |
| spellingShingle | Kal Backman Jared Wood Maquel Brandimarti Chad T. Beranek Adam Roff Human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveys Methods in Ecology and Evolution animal detection drone survey human‐inspired AI simulated data generation thermal image detection |
| title | Human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveys |
| title_full | Human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveys |
| title_fullStr | Human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveys |
| title_full_unstemmed | Human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveys |
| title_short | Human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveys |
| title_sort | human inspired deep learning to locate and classify terrestrial and arboreal animals in thermal drone surveys |
| topic | animal detection drone survey human‐inspired AI simulated data generation thermal image detection |
| url | https://doi.org/10.1111/2041-210X.70006 |
| work_keys_str_mv | AT kalbackman humaninspireddeeplearningtolocateandclassifyterrestrialandarborealanimalsinthermaldronesurveys AT jaredwood humaninspireddeeplearningtolocateandclassifyterrestrialandarborealanimalsinthermaldronesurveys AT maquelbrandimarti humaninspireddeeplearningtolocateandclassifyterrestrialandarborealanimalsinthermaldronesurveys AT chadtberanek humaninspireddeeplearningtolocateandclassifyterrestrialandarborealanimalsinthermaldronesurveys AT adamroff humaninspireddeeplearningtolocateandclassifyterrestrialandarborealanimalsinthermaldronesurveys |