Based on the Improved EDCSTFN Model, Modis, Landsat 8, and Sentinel-2 Data Were Fused to Obtain 10 m Dense Time Series Images
High temporal and spatial resolution Earth observation data are crucial in remote sensing, but it is difficult to acquire images that guarantee high temporal and spatial resolution simultaneously due to satellite, technology and budget constraints. In this paper, time series image data with 10 m res...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10979304/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850190020698177536 |
|---|---|
| author | Jie Chang Wen Du Bo Zhang Sien Guo Ying Yin Zhuo Wang Tongyu Xu Ziyi Feng |
| author_facet | Jie Chang Wen Du Bo Zhang Sien Guo Ying Yin Zhuo Wang Tongyu Xu Ziyi Feng |
| author_sort | Jie Chang |
| collection | DOAJ |
| description | High temporal and spatial resolution Earth observation data are crucial in remote sensing, but it is difficult to acquire images that guarantee high temporal and spatial resolution simultaneously due to satellite, technology and budget constraints. In this paper, time series image data with 10 m resolution are generated by spatio-temporal fusion of Modis, Landsat and Sentinel data, which reduces the temporal resolution to 1-2 days, while the existing EDCSTFN model is improved in order to overcome the problem of difficulty in global information extraction due to convolution limitation. The encoder and residual encoder use multi-scale convolution to capture more information from raw Landsat data and enhance feature extraction. In addition, a channel attention module (SE) is introduced to model the nonlinear relationship across channels, which improves the nonlinear capability of the model and reduces the sensitivity to the quality of input data. This approach not only improves the fusion accuracy, but also increases the computational efficiency, leading to the proposal of a new architecture, MIEDCSTFN. 10m-resolution data for the corresponding dates are generated using the output Landsat data from the improved EDCSTFN model as input to the DSTFN model. Comparative validation with several models shows that the improved model has higher accuracy and robustness, and the obtained 10m data are very close to the real data. Compared with the original model, SSIM improves 12.54%, RMSE improves 46.38%, SAM improves 15.46%, ERGAS improves 15.74%, and the experimental results show that the improved model has excellent performance and significant advantages in improving image fusion effect. |
| format | Article |
| id | doaj-art-e110b65fa9e946e8b105152fc90c4ae1 |
| institution | OA Journals |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-e110b65fa9e946e8b105152fc90c4ae12025-08-20T02:15:25ZengIEEEIEEE Access2169-35362025-01-0113791897920210.1109/ACCESS.2025.356496810979304Based on the Improved EDCSTFN Model, Modis, Landsat 8, and Sentinel-2 Data Were Fused to Obtain 10 m Dense Time Series ImagesJie Chang0https://orcid.org/0009-0005-2239-7795Wen Du1Bo Zhang2Sien Guo3Ying Yin4Zhuo Wang5https://orcid.org/0009-0000-1552-2897Tongyu Xu6Ziyi Feng7https://orcid.org/0009-0005-8963-8864College of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, ChinaHigh temporal and spatial resolution Earth observation data are crucial in remote sensing, but it is difficult to acquire images that guarantee high temporal and spatial resolution simultaneously due to satellite, technology and budget constraints. In this paper, time series image data with 10 m resolution are generated by spatio-temporal fusion of Modis, Landsat and Sentinel data, which reduces the temporal resolution to 1-2 days, while the existing EDCSTFN model is improved in order to overcome the problem of difficulty in global information extraction due to convolution limitation. The encoder and residual encoder use multi-scale convolution to capture more information from raw Landsat data and enhance feature extraction. In addition, a channel attention module (SE) is introduced to model the nonlinear relationship across channels, which improves the nonlinear capability of the model and reduces the sensitivity to the quality of input data. This approach not only improves the fusion accuracy, but also increases the computational efficiency, leading to the proposal of a new architecture, MIEDCSTFN. 10m-resolution data for the corresponding dates are generated using the output Landsat data from the improved EDCSTFN model as input to the DSTFN model. Comparative validation with several models shows that the improved model has higher accuracy and robustness, and the obtained 10m data are very close to the real data. Compared with the original model, SSIM improves 12.54%, RMSE improves 46.38%, SAM improves 15.46%, ERGAS improves 15.74%, and the experimental results show that the improved model has excellent performance and significant advantages in improving image fusion effect.https://ieeexplore.ieee.org/document/10979304/10 m time-series imagery dataEDCSTFN modelspatio-temporal fusion |
| spellingShingle | Jie Chang Wen Du Bo Zhang Sien Guo Ying Yin Zhuo Wang Tongyu Xu Ziyi Feng Based on the Improved EDCSTFN Model, Modis, Landsat 8, and Sentinel-2 Data Were Fused to Obtain 10 m Dense Time Series Images IEEE Access 10 m time-series imagery data EDCSTFN model spatio-temporal fusion |
| title | Based on the Improved EDCSTFN Model, Modis, Landsat 8, and Sentinel-2 Data Were Fused to Obtain 10 m Dense Time Series Images |
| title_full | Based on the Improved EDCSTFN Model, Modis, Landsat 8, and Sentinel-2 Data Were Fused to Obtain 10 m Dense Time Series Images |
| title_fullStr | Based on the Improved EDCSTFN Model, Modis, Landsat 8, and Sentinel-2 Data Were Fused to Obtain 10 m Dense Time Series Images |
| title_full_unstemmed | Based on the Improved EDCSTFN Model, Modis, Landsat 8, and Sentinel-2 Data Were Fused to Obtain 10 m Dense Time Series Images |
| title_short | Based on the Improved EDCSTFN Model, Modis, Landsat 8, and Sentinel-2 Data Were Fused to Obtain 10 m Dense Time Series Images |
| title_sort | based on the improved edcstfn model modis landsat 8 and sentinel 2 data were fused to obtain 10 m dense time series images |
| topic | 10 m time-series imagery data EDCSTFN model spatio-temporal fusion |
| url | https://ieeexplore.ieee.org/document/10979304/ |
| work_keys_str_mv | AT jiechang basedontheimprovededcstfnmodelmodislandsat8andsentinel2datawerefusedtoobtain10mdensetimeseriesimages AT wendu basedontheimprovededcstfnmodelmodislandsat8andsentinel2datawerefusedtoobtain10mdensetimeseriesimages AT bozhang basedontheimprovededcstfnmodelmodislandsat8andsentinel2datawerefusedtoobtain10mdensetimeseriesimages AT sienguo basedontheimprovededcstfnmodelmodislandsat8andsentinel2datawerefusedtoobtain10mdensetimeseriesimages AT yingyin basedontheimprovededcstfnmodelmodislandsat8andsentinel2datawerefusedtoobtain10mdensetimeseriesimages AT zhuowang basedontheimprovededcstfnmodelmodislandsat8andsentinel2datawerefusedtoobtain10mdensetimeseriesimages AT tongyuxu basedontheimprovededcstfnmodelmodislandsat8andsentinel2datawerefusedtoobtain10mdensetimeseriesimages AT ziyifeng basedontheimprovededcstfnmodelmodislandsat8andsentinel2datawerefusedtoobtain10mdensetimeseriesimages |