Application of a Transfer Learning Model Combining CNN and Self-Attention Mechanism in Wireless Signal Recognition

Application of a Transfer Learning Model Combining CNN and Self-Attention Mechanism in Wireless Signal Recognition

In this paper, we propose TransConvNet, a hybrid model combining Convolutional Neural Networks (CNNs), self-attention mechanisms, and transfer learning for wireless signal recognition under challenging conditions. The model effectively addresses challenges such as low signal-to-noise ratio (SNR), lo...

Full description

Saved in:
Bibliographic Details
Main Authors: Wu Wei, Chenqi Zhu, Lifan Hu, Pengfei Liu
Format: Article
Language:English
Published: MDPI AG 2025-07-01
Series:Sensors
Subjects:
convolutional neural network
self-attention
wireless signal recognition
low SNR
low sampling rate
Online Access:https://www.mdpi.com/1424-8220/25/13/4202
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we propose TransConvNet, a hybrid model combining Convolutional Neural Networks (CNNs), self-attention mechanisms, and transfer learning for wireless signal recognition under challenging conditions. The model effectively addresses challenges such as low signal-to-noise ratio (SNR), low sampling rates, and limited labeled data. The CNN module extracts local features and suppresses noise, while the self-attention mechanism within the Transformer encoder captures long-range dependencies in the signal. To enhance performance with limited data, we incorporate transfer learning by leveraging pre-trained models, ensuring faster convergence and improved generalization. Extensive experiments were conducted on a six-class wireless signal dataset, downsampled to 1 MSPS to simulate real-world constraints. The proposed TransConvNet achieved 92.1% accuracy, outperforming baseline models such as LSTM, CNN, and RNN across multiple evaluation metrics, including RMSE and <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mi>R</mi><mn>2</mn></msup></semantics></math></inline-formula>. The model demonstrated strong robustness under varying SNR conditions and exhibited superior discriminative ability, as confirmed by Precision–Recall and ROC curves. These results validate the effectiveness and robustness of the TransConvNet model for wireless signal recognition, particularly in resource-constrained and noisy environments.
ISSN:1424-8220

Similar Items