Compressive Sensing Network Deeply Induced by Visual Mechanism
In recent years, deep learning methods have attracted widespread attention in the field of image compressive sensing. However, these methods still face challenges such as high computational complexity and severe loss of reconstruction details. To address these challenges, we propose a Full Visual Me...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10816429/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841563379988168704 |
|---|---|
| author | Mingkun Feng Xiaole Han Kai Zheng |
| author_facet | Mingkun Feng Xiaole Han Kai Zheng |
| author_sort | Mingkun Feng |
| collection | DOAJ |
| description | In recent years, deep learning methods have attracted widespread attention in the field of image compressive sensing. However, these methods still face challenges such as high computational complexity and severe loss of reconstruction details. To address these challenges, we propose a Full Visual Mechanism-based Compressive Sensing Network (FVM-CSNet) inspired by the human visual system’s process of perceiving and understanding images. A visual multi-resolution sampling subnetwork is designed to simulate the perceptual characteristics of the human visual system’s frontend, allowing measurements to better preserve visual information from the original image at the sampling stage. At the reconstruction stage, we use the information processing characteristics of the visual system’s backend and construct a lightweight deep reconstruction subnetwork to enhance improve quality of image reconstruction. Specifically, we introduce a discrete wavelet transform-based visual weighting module and an inverse discrete wavelet reconstruction fusion module to adjust the weights and fuse different frequency sub-bands, which not only enhances image reconstruction quality but also significantly reduces computational complexity. To further optimize the model’s efficiency, we employ a stepped replicating strategy in the feature transfer of dense residual blocks to improve feature transfer efficiency. Furthermore, by introducing dilated convolutions with varying dilation rates, we enable multi-scale feature to be learned, which enhance rich feature and expressive power without increasing model complexity. The experimental results show that our FVM-CSNet exhibits significant advantages on the Set14 dataset compared to existing advanced methods (TransCS, OCTUF and DPC-DUN). The average PSNR and average SSIM of FVM-CSNet are improved by 2.42% and 1.68%, 1.54% and 1.27%, and 0.28% and 1.33% compared to the above three advanced methods for four different sampling rates, respectively. Extensive experimental results of other datasets demonstrate the comprehensive superiority of our method compared to existing methods. Moreover, our FVM-CSNet also demonstrates significant advantages in terms of reconstruction speed. |
| format | Article |
| id | doaj-art-94127355231245cc836fe9f259668af5 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-94127355231245cc836fe9f259668af52025-01-03T00:01:08ZengIEEEIEEE Access2169-35362024-01-011219791719792810.1109/ACCESS.2024.352297810816429Compressive Sensing Network Deeply Induced by Visual MechanismMingkun Feng0https://orcid.org/0000-0001-6716-8949Xiaole Han1https://orcid.org/0009-0001-3879-7778Kai Zheng2https://orcid.org/0009-0007-8832-5289School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou, ChinaSchool of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou, ChinaSchool of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou, ChinaIn recent years, deep learning methods have attracted widespread attention in the field of image compressive sensing. However, these methods still face challenges such as high computational complexity and severe loss of reconstruction details. To address these challenges, we propose a Full Visual Mechanism-based Compressive Sensing Network (FVM-CSNet) inspired by the human visual system’s process of perceiving and understanding images. A visual multi-resolution sampling subnetwork is designed to simulate the perceptual characteristics of the human visual system’s frontend, allowing measurements to better preserve visual information from the original image at the sampling stage. At the reconstruction stage, we use the information processing characteristics of the visual system’s backend and construct a lightweight deep reconstruction subnetwork to enhance improve quality of image reconstruction. Specifically, we introduce a discrete wavelet transform-based visual weighting module and an inverse discrete wavelet reconstruction fusion module to adjust the weights and fuse different frequency sub-bands, which not only enhances image reconstruction quality but also significantly reduces computational complexity. To further optimize the model’s efficiency, we employ a stepped replicating strategy in the feature transfer of dense residual blocks to improve feature transfer efficiency. Furthermore, by introducing dilated convolutions with varying dilation rates, we enable multi-scale feature to be learned, which enhance rich feature and expressive power without increasing model complexity. The experimental results show that our FVM-CSNet exhibits significant advantages on the Set14 dataset compared to existing advanced methods (TransCS, OCTUF and DPC-DUN). The average PSNR and average SSIM of FVM-CSNet are improved by 2.42% and 1.68%, 1.54% and 1.27%, and 0.28% and 1.33% compared to the above three advanced methods for four different sampling rates, respectively. Extensive experimental results of other datasets demonstrate the comprehensive superiority of our method compared to existing methods. Moreover, our FVM-CSNet also demonstrates significant advantages in terms of reconstruction speed.https://ieeexplore.ieee.org/document/10816429/Deep Learningcompressive sensingwavelet transformstepped replicating strategy |
| spellingShingle | Mingkun Feng Xiaole Han Kai Zheng Compressive Sensing Network Deeply Induced by Visual Mechanism IEEE Access Deep Learning compressive sensing wavelet transform stepped replicating strategy |
| title | Compressive Sensing Network Deeply Induced by Visual Mechanism |
| title_full | Compressive Sensing Network Deeply Induced by Visual Mechanism |
| title_fullStr | Compressive Sensing Network Deeply Induced by Visual Mechanism |
| title_full_unstemmed | Compressive Sensing Network Deeply Induced by Visual Mechanism |
| title_short | Compressive Sensing Network Deeply Induced by Visual Mechanism |
| title_sort | compressive sensing network deeply induced by visual mechanism |
| topic | Deep Learning compressive sensing wavelet transform stepped replicating strategy |
| url | https://ieeexplore.ieee.org/document/10816429/ |
| work_keys_str_mv | AT mingkunfeng compressivesensingnetworkdeeplyinducedbyvisualmechanism AT xiaolehan compressivesensingnetworkdeeplyinducedbyvisualmechanism AT kaizheng compressivesensingnetworkdeeplyinducedbyvisualmechanism |