IRR-Net: A Joint Learning Framework for Image Reconstruction and Recognition of Photoacoustic Tomography
In photoacoustic tomography (PAT), object identification and classification are usually performed as postprocessing processes after image reconstruction. Since useful information about the target implied in the raw signal can be lost during image reconstruction, this two-step scheme can reduce the a...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-01-01
|
| Series: | IET Signal Processing |
| Online Access: | http://dx.doi.org/10.1049/2023/6615953 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850212881809801216 |
|---|---|
| author | Zheng Sun Bing Ai Meichen Sun Yingsa Hou |
| author_facet | Zheng Sun Bing Ai Meichen Sun Yingsa Hou |
| author_sort | Zheng Sun |
| collection | DOAJ |
| description | In photoacoustic tomography (PAT), object identification and classification are usually performed as postprocessing processes after image reconstruction. Since useful information about the target implied in the raw signal can be lost during image reconstruction, this two-step scheme can reduce the accuracy of tissue characterization. For learning-based methods, it is time consuming to train the network of each subtask separately. In this paper, we report on an end-to-end joint learning framework for simultaneous image reconstruction and object recognition, named IRR-Net. It establishes direct mapping of raw photoacoustic signals to high-quality images with recognized targets. The network consists of an image reconstruction module, an optimization module, and a recognition module, which achieved signal-to-image, image-to-image, and image-to-class conversion, respectively. We built simulation, phantom and in vivo data sets to train and test IRR-Net. The results show that the proposed method successfully yields concurrent improvements in both the quality of the reconstructed images and the accuracy of target recognition at a lower time cost compared to the separately trained networks. |
| format | Article |
| id | doaj-art-903a76a488ce49d98a669aab610e8d8f |
| institution | OA Journals |
| issn | 1751-9683 |
| language | English |
| publishDate | 2023-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Signal Processing |
| spelling | doaj-art-903a76a488ce49d98a669aab610e8d8f2025-08-20T02:09:14ZengWileyIET Signal Processing1751-96832023-01-01202310.1049/2023/6615953IRR-Net: A Joint Learning Framework for Image Reconstruction and Recognition of Photoacoustic TomographyZheng Sun0Bing Ai1Meichen Sun2Yingsa Hou3Department of Electronic and Communication EngineeringDepartment of Electronic and Communication EngineeringDepartment of Electronic and Communication EngineeringDepartment of Electronic and Communication EngineeringIn photoacoustic tomography (PAT), object identification and classification are usually performed as postprocessing processes after image reconstruction. Since useful information about the target implied in the raw signal can be lost during image reconstruction, this two-step scheme can reduce the accuracy of tissue characterization. For learning-based methods, it is time consuming to train the network of each subtask separately. In this paper, we report on an end-to-end joint learning framework for simultaneous image reconstruction and object recognition, named IRR-Net. It establishes direct mapping of raw photoacoustic signals to high-quality images with recognized targets. The network consists of an image reconstruction module, an optimization module, and a recognition module, which achieved signal-to-image, image-to-image, and image-to-class conversion, respectively. We built simulation, phantom and in vivo data sets to train and test IRR-Net. The results show that the proposed method successfully yields concurrent improvements in both the quality of the reconstructed images and the accuracy of target recognition at a lower time cost compared to the separately trained networks.http://dx.doi.org/10.1049/2023/6615953 |
| spellingShingle | Zheng Sun Bing Ai Meichen Sun Yingsa Hou IRR-Net: A Joint Learning Framework for Image Reconstruction and Recognition of Photoacoustic Tomography IET Signal Processing |
| title | IRR-Net: A Joint Learning Framework for Image Reconstruction and Recognition of Photoacoustic Tomography |
| title_full | IRR-Net: A Joint Learning Framework for Image Reconstruction and Recognition of Photoacoustic Tomography |
| title_fullStr | IRR-Net: A Joint Learning Framework for Image Reconstruction and Recognition of Photoacoustic Tomography |
| title_full_unstemmed | IRR-Net: A Joint Learning Framework for Image Reconstruction and Recognition of Photoacoustic Tomography |
| title_short | IRR-Net: A Joint Learning Framework for Image Reconstruction and Recognition of Photoacoustic Tomography |
| title_sort | irr net a joint learning framework for image reconstruction and recognition of photoacoustic tomography |
| url | http://dx.doi.org/10.1049/2023/6615953 |
| work_keys_str_mv | AT zhengsun irrnetajointlearningframeworkforimagereconstructionandrecognitionofphotoacoustictomography AT bingai irrnetajointlearningframeworkforimagereconstructionandrecognitionofphotoacoustictomography AT meichensun irrnetajointlearningframeworkforimagereconstructionandrecognitionofphotoacoustictomography AT yingsahou irrnetajointlearningframeworkforimagereconstructionandrecognitionofphotoacoustictomography |