A Deep Curriculum Learning Semi-Supervised Framework for Remote Sensing Scene Classification

In recent years, deep learning has witnessed astonishing success in the field of remote sensing in images. Generally, deep learning requires a large amount of labeled training data. Nevertheless, in remote sensing, sufficient labeled data are scarce because labeled data are often difficult, expensiv...

Full description

Saved in:
Bibliographic Details
Main Authors: Qing Zhang, Jialu Chen, Baohua Yuan
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/15/1/360
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841549336462229504
author Qing Zhang
Jialu Chen
Baohua Yuan
author_facet Qing Zhang
Jialu Chen
Baohua Yuan
author_sort Qing Zhang
collection DOAJ
description In recent years, deep learning has witnessed astonishing success in the field of remote sensing in images. Generally, deep learning requires a large amount of labeled training data. Nevertheless, in remote sensing, sufficient labeled data are scarce because labeled data are often difficult, expensive, or time-consuming to obtain. To address these problems, we propose a deep curriculum learning semi-supervised framework (DCLSSF) for remote sensing image scene classification. This framework employs a multimodal deep curriculum learning method which can realize the classification of images on a range of easy–difficult. Specifically, by utilizing multiple pretrained networks to extract multiple deep features of images as their multimodal feature representations, it can comprehensively mine the information from labeled and unlabeled images from diverse perspectives. Subsequently, a feature fusion method is used on deep features of different modalities to obtain deep fusion features with a strong discrimination ability and low dimensionality. Finally, the multimodal deep features are fed into multimodal curriculum learning methods for classification. Multimodal curriculum learning can integrate the easy curricula recommended by each modal according to the order of the samples of each modal and then learn step by step. Experiments on three publicly available datasets (UC Merced, AID, and NWPU-RESISC45) show that the semi-supervised classification framework achieves high accuracy rates (99.14%, 97.95%, and 93.01%), even surpassing those of the most supervised classification methods. The DCLSSF method can not only fully exploit the rich features extracted by the multimodal deep learning network but can also perform the semi-supervised classification of unlabeled samples in a range of easy–difficult.
format Article
id doaj-art-35ddb1e4aefd4085b893eb1f4bac4135
institution Kabale University
issn 2076-3417
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj-art-35ddb1e4aefd4085b893eb1f4bac41352025-01-10T13:15:17ZengMDPI AGApplied Sciences2076-34172025-01-0115136010.3390/app15010360A Deep Curriculum Learning Semi-Supervised Framework for Remote Sensing Scene ClassificationQing Zhang0Jialu Chen1Baohua Yuan2School of Computer Science and Engineering, Taizhou Institute of Science and Technology, Nanjing University of Science and Technology, Taizhou 225300, ChinaAliyun School of Big Data, Changzhou University, Changzhou 213164, ChinaJiangsu Engineering Research Center of Digital Twinning Technology for Key Equipment in Petrochemical Process, Changzhou University, Changzhou 213164, ChinaIn recent years, deep learning has witnessed astonishing success in the field of remote sensing in images. Generally, deep learning requires a large amount of labeled training data. Nevertheless, in remote sensing, sufficient labeled data are scarce because labeled data are often difficult, expensive, or time-consuming to obtain. To address these problems, we propose a deep curriculum learning semi-supervised framework (DCLSSF) for remote sensing image scene classification. This framework employs a multimodal deep curriculum learning method which can realize the classification of images on a range of easy–difficult. Specifically, by utilizing multiple pretrained networks to extract multiple deep features of images as their multimodal feature representations, it can comprehensively mine the information from labeled and unlabeled images from diverse perspectives. Subsequently, a feature fusion method is used on deep features of different modalities to obtain deep fusion features with a strong discrimination ability and low dimensionality. Finally, the multimodal deep features are fed into multimodal curriculum learning methods for classification. Multimodal curriculum learning can integrate the easy curricula recommended by each modal according to the order of the samples of each modal and then learn step by step. Experiments on three publicly available datasets (UC Merced, AID, and NWPU-RESISC45) show that the semi-supervised classification framework achieves high accuracy rates (99.14%, 97.95%, and 93.01%), even surpassing those of the most supervised classification methods. The DCLSSF method can not only fully exploit the rich features extracted by the multimodal deep learning network but can also perform the semi-supervised classification of unlabeled samples in a range of easy–difficult.https://www.mdpi.com/2076-3417/15/1/360convolutional neural network (CNN)feature fusioncurriculum learningsemi-supervised learningimage classification
spellingShingle Qing Zhang
Jialu Chen
Baohua Yuan
A Deep Curriculum Learning Semi-Supervised Framework for Remote Sensing Scene Classification
Applied Sciences
convolutional neural network (CNN)
feature fusion
curriculum learning
semi-supervised learning
image classification
title A Deep Curriculum Learning Semi-Supervised Framework for Remote Sensing Scene Classification
title_full A Deep Curriculum Learning Semi-Supervised Framework for Remote Sensing Scene Classification
title_fullStr A Deep Curriculum Learning Semi-Supervised Framework for Remote Sensing Scene Classification
title_full_unstemmed A Deep Curriculum Learning Semi-Supervised Framework for Remote Sensing Scene Classification
title_short A Deep Curriculum Learning Semi-Supervised Framework for Remote Sensing Scene Classification
title_sort deep curriculum learning semi supervised framework for remote sensing scene classification
topic convolutional neural network (CNN)
feature fusion
curriculum learning
semi-supervised learning
image classification
url https://www.mdpi.com/2076-3417/15/1/360
work_keys_str_mv AT qingzhang adeepcurriculumlearningsemisupervisedframeworkforremotesensingsceneclassification
AT jialuchen adeepcurriculumlearningsemisupervisedframeworkforremotesensingsceneclassification
AT baohuayuan adeepcurriculumlearningsemisupervisedframeworkforremotesensingsceneclassification
AT qingzhang deepcurriculumlearningsemisupervisedframeworkforremotesensingsceneclassification
AT jialuchen deepcurriculumlearningsemisupervisedframeworkforremotesensingsceneclassification
AT baohuayuan deepcurriculumlearningsemisupervisedframeworkforremotesensingsceneclassification