Deep Feature-Based Hyperspectral Object Tracking: An Experimental Survey and Outlook

With the rapid advancement of hyperspectral imaging technology, hyperspectral object tracking (HOT) has become a research hotspot in the field of remote sensing. Advanced HOT methods have been continuously proposed and validated on scarce datasets in recent years, which can be roughly divided into h...

Full description

Saved in:
Bibliographic Details
Main Authors: Yuchao Wang, Xu Li, Xinyan Yang, Fuyuan Ge, Baoguo Wei, Lixin Li, Shigang Yue
Format: Article
Language:English
Published: MDPI AG 2025-02-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/17/4/645
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849718694267060224
author Yuchao Wang
Xu Li
Xinyan Yang
Fuyuan Ge
Baoguo Wei
Lixin Li
Shigang Yue
author_facet Yuchao Wang
Xu Li
Xinyan Yang
Fuyuan Ge
Baoguo Wei
Lixin Li
Shigang Yue
author_sort Yuchao Wang
collection DOAJ
description With the rapid advancement of hyperspectral imaging technology, hyperspectral object tracking (HOT) has become a research hotspot in the field of remote sensing. Advanced HOT methods have been continuously proposed and validated on scarce datasets in recent years, which can be roughly divided into handcrafted feature-based methods and deep feature-based methods. Compared with methods via handcrafted features, deep feature-based methods can extract highly discriminative semantic features from hyperspectral images (HSIs) and achieve excellent tracking performance, making them more favored by the hyperspectral tracking community. However, deep feature-based HOT still faces challenges such as data-hungry, band gap, low tracking efficiency, etc. Therefore, it is necessary to conduct a thorough review of current trackers and unresolved problems in the HOT field. In this survey, we systematically classify and conduct a comprehensive analysis of 13 state-of-the-art deep feature-based hyperspectral trackers. First, we classify and analyze the trackers based on the framework and tracking process. Second, the trackers are compared and analyzed in terms of tracking accuracy and speed on two datasets for cross-validation. Finally, we design a specialized experiment for small object tracking (SOT) to further validate the tracking performance. Through in-depth investigation, the advantages and weaknesses of current HOT technology based on deep features are clearly demonstrated, which also points out the directions for future development.
format Article
id doaj-art-1fcc3e9409fa4494994b15a2b0c5b256
institution DOAJ
issn 2072-4292
language English
publishDate 2025-02-01
publisher MDPI AG
record_format Article
series Remote Sensing
spelling doaj-art-1fcc3e9409fa4494994b15a2b0c5b2562025-08-20T03:12:19ZengMDPI AGRemote Sensing2072-42922025-02-0117464510.3390/rs17040645Deep Feature-Based Hyperspectral Object Tracking: An Experimental Survey and OutlookYuchao Wang0Xu Li1Xinyan Yang2Fuyuan Ge3Baoguo Wei4Lixin Li5Shigang Yue6School of Electronics and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaSchool of Computing and Mathematics Sciences, University of Leicester, Leicester LE1 7RU, UKWith the rapid advancement of hyperspectral imaging technology, hyperspectral object tracking (HOT) has become a research hotspot in the field of remote sensing. Advanced HOT methods have been continuously proposed and validated on scarce datasets in recent years, which can be roughly divided into handcrafted feature-based methods and deep feature-based methods. Compared with methods via handcrafted features, deep feature-based methods can extract highly discriminative semantic features from hyperspectral images (HSIs) and achieve excellent tracking performance, making them more favored by the hyperspectral tracking community. However, deep feature-based HOT still faces challenges such as data-hungry, band gap, low tracking efficiency, etc. Therefore, it is necessary to conduct a thorough review of current trackers and unresolved problems in the HOT field. In this survey, we systematically classify and conduct a comprehensive analysis of 13 state-of-the-art deep feature-based hyperspectral trackers. First, we classify and analyze the trackers based on the framework and tracking process. Second, the trackers are compared and analyzed in terms of tracking accuracy and speed on two datasets for cross-validation. Finally, we design a specialized experiment for small object tracking (SOT) to further validate the tracking performance. Through in-depth investigation, the advantages and weaknesses of current HOT technology based on deep features are clearly demonstrated, which also points out the directions for future development.https://www.mdpi.com/2072-4292/17/4/645object trackinghyperspectral videodeep featuredatasetsmall object
spellingShingle Yuchao Wang
Xu Li
Xinyan Yang
Fuyuan Ge
Baoguo Wei
Lixin Li
Shigang Yue
Deep Feature-Based Hyperspectral Object Tracking: An Experimental Survey and Outlook
Remote Sensing
object tracking
hyperspectral video
deep feature
dataset
small object
title Deep Feature-Based Hyperspectral Object Tracking: An Experimental Survey and Outlook
title_full Deep Feature-Based Hyperspectral Object Tracking: An Experimental Survey and Outlook
title_fullStr Deep Feature-Based Hyperspectral Object Tracking: An Experimental Survey and Outlook
title_full_unstemmed Deep Feature-Based Hyperspectral Object Tracking: An Experimental Survey and Outlook
title_short Deep Feature-Based Hyperspectral Object Tracking: An Experimental Survey and Outlook
title_sort deep feature based hyperspectral object tracking an experimental survey and outlook
topic object tracking
hyperspectral video
deep feature
dataset
small object
url https://www.mdpi.com/2072-4292/17/4/645
work_keys_str_mv AT yuchaowang deepfeaturebasedhyperspectralobjecttrackinganexperimentalsurveyandoutlook
AT xuli deepfeaturebasedhyperspectralobjecttrackinganexperimentalsurveyandoutlook
AT xinyanyang deepfeaturebasedhyperspectralobjecttrackinganexperimentalsurveyandoutlook
AT fuyuange deepfeaturebasedhyperspectralobjecttrackinganexperimentalsurveyandoutlook
AT baoguowei deepfeaturebasedhyperspectralobjecttrackinganexperimentalsurveyandoutlook
AT lixinli deepfeaturebasedhyperspectralobjecttrackinganexperimentalsurveyandoutlook
AT shigangyue deepfeaturebasedhyperspectralobjecttrackinganexperimentalsurveyandoutlook