Hyperspectral Image Few-Shot Classification Based on Spatial–Spectral Information Complementation and Multilatent Domain Generalization
Hyperspectral image (HSI) few-shot classification aims to classify HSI samples of novel categories with limited training HSI samples of base categories. However, current methods suffer from two issues: first, ignoring the complementary relationship between spatial and spectral information; and secon...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10980625/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849695684904615936 |
|---|---|
| author | Qianhao Yu Yong Wang |
| author_facet | Qianhao Yu Yong Wang |
| author_sort | Qianhao Yu |
| collection | DOAJ |
| description | Hyperspectral image (HSI) few-shot classification aims to classify HSI samples of novel categories with limited training HSI samples of base categories. However, current methods suffer from two issues: first, ignoring the complementary relationship between spatial and spectral information; and second, performance degradation on base categories due to excessive focus on novel categories. This article proposes a spatial–spectral information complementation and multilatent domain generalization-based framework (SIM). Specifically, given samples of base (novel) categories, a spatial–spectral feature extraction network is designed to extract their spatial–spectral features, which includes two steps. First, multiple spatial–spectral information complementation modules (SSICs) are stacked to extract the complementary features with different scales. Note that each SSIC extracts features with spatial and spectral information, and adopts a spatial–spectral information transmission unit to cross-transmit spatial and spectral information between these two types of features, thus achieving information complementation. Second, a multiscale feature fusion module is utilized to calculate the classification influence scores of the multiscale complementary features to perform layer-by-layer feature fusion, thus obtaining spatial–spectral features. Afterward, the spatial–spectral features are fed into a classification head to obtain the classification results. During training, a multilatent domain generalization network (MLDGN) is designed, which iteratively assigns pseudodomain labels to all samples, and calculates the sample discrimination loss. SIM combines the sample discrimination loss with the classification losses for training. Thus, SIM can extract spatial–spectral features with domain invariance, alleviating the performance degradation on base categories. Extensive results on four HSI datasets demonstrate that SIM outperforms state-of-the-art methods. |
| format | Article |
| id | doaj-art-754932fe51b64daa88ce2087d7cc998a |
| institution | DOAJ |
| issn | 1939-1404 2151-1535 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj-art-754932fe51b64daa88ce2087d7cc998a2025-08-20T03:19:42ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing1939-14042151-15352025-01-0118132121322410.1109/JSTARS.2025.356589410980625Hyperspectral Image Few-Shot Classification Based on Spatial–Spectral Information Complementation and Multilatent Domain GeneralizationQianhao Yu0https://orcid.org/0009-0005-1896-6457Yong Wang1https://orcid.org/0000-0001-7670-3958School of Automation, Central South University, Changsha, ChinaSchool of Automation, Central South University, Changsha, ChinaHyperspectral image (HSI) few-shot classification aims to classify HSI samples of novel categories with limited training HSI samples of base categories. However, current methods suffer from two issues: first, ignoring the complementary relationship between spatial and spectral information; and second, performance degradation on base categories due to excessive focus on novel categories. This article proposes a spatial–spectral information complementation and multilatent domain generalization-based framework (SIM). Specifically, given samples of base (novel) categories, a spatial–spectral feature extraction network is designed to extract their spatial–spectral features, which includes two steps. First, multiple spatial–spectral information complementation modules (SSICs) are stacked to extract the complementary features with different scales. Note that each SSIC extracts features with spatial and spectral information, and adopts a spatial–spectral information transmission unit to cross-transmit spatial and spectral information between these two types of features, thus achieving information complementation. Second, a multiscale feature fusion module is utilized to calculate the classification influence scores of the multiscale complementary features to perform layer-by-layer feature fusion, thus obtaining spatial–spectral features. Afterward, the spatial–spectral features are fed into a classification head to obtain the classification results. During training, a multilatent domain generalization network (MLDGN) is designed, which iteratively assigns pseudodomain labels to all samples, and calculates the sample discrimination loss. SIM combines the sample discrimination loss with the classification losses for training. Thus, SIM can extract spatial–spectral features with domain invariance, alleviating the performance degradation on base categories. Extensive results on four HSI datasets demonstrate that SIM outperforms state-of-the-art methods.https://ieeexplore.ieee.org/document/10980625/Hyperspectral image (HSI) few-shot classificationmultilatent domain generalizationmultiscale feature fusionspatial–spectral information complementation |
| spellingShingle | Qianhao Yu Yong Wang Hyperspectral Image Few-Shot Classification Based on Spatial–Spectral Information Complementation and Multilatent Domain Generalization IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Hyperspectral image (HSI) few-shot classification multilatent domain generalization multiscale feature fusion spatial–spectral information complementation |
| title | Hyperspectral Image Few-Shot Classification Based on Spatial–Spectral Information Complementation and Multilatent Domain Generalization |
| title_full | Hyperspectral Image Few-Shot Classification Based on Spatial–Spectral Information Complementation and Multilatent Domain Generalization |
| title_fullStr | Hyperspectral Image Few-Shot Classification Based on Spatial–Spectral Information Complementation and Multilatent Domain Generalization |
| title_full_unstemmed | Hyperspectral Image Few-Shot Classification Based on Spatial–Spectral Information Complementation and Multilatent Domain Generalization |
| title_short | Hyperspectral Image Few-Shot Classification Based on Spatial–Spectral Information Complementation and Multilatent Domain Generalization |
| title_sort | hyperspectral image few shot classification based on spatial x2013 spectral information complementation and multilatent domain generalization |
| topic | Hyperspectral image (HSI) few-shot classification multilatent domain generalization multiscale feature fusion spatial–spectral information complementation |
| url | https://ieeexplore.ieee.org/document/10980625/ |
| work_keys_str_mv | AT qianhaoyu hyperspectralimagefewshotclassificationbasedonspatialx2013spectralinformationcomplementationandmultilatentdomaingeneralization AT yongwang hyperspectralimagefewshotclassificationbasedonspatialx2013spectralinformationcomplementationandmultilatentdomaingeneralization |