Joint vibrotactile coding for machine recognition and human perception

In order to accurately transmit the content meaning of vibrotactile signals and achieve intelligent recognition and signal reconstruction, a joint vibrotactile coding scheme for machine recognition and human perception was proposed.At the encoding end, the original three-dimensional vibrotactile sig...

Full description

Saved in:
Bibliographic Details
Main Authors: Ying FANG, Yiwen XU, Tiesong ZHAO
Format: Article
Language:zho
Published: Editorial Department of Journal on Communications 2023-05-01
Series:Tongxin xuebao
Subjects:
Online Access:http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023099/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841539240927690752
author Ying FANG
Yiwen XU
Tiesong ZHAO
author_facet Ying FANG
Yiwen XU
Tiesong ZHAO
author_sort Ying FANG
collection DOAJ
description In order to accurately transmit the content meaning of vibrotactile signals and achieve intelligent recognition and signal reconstruction, a joint vibrotactile coding scheme for machine recognition and human perception was proposed.At the encoding end, the original three-dimensional vibrotactile signals were converted into one-dimensional signals.Then the semantic information of the signals was extracted using a short-time Fourier transform before being effectively compressed and transmitted.At the decoding end, a fully convolutional neural network was used to intelligently recognize based on the semantic information.The difference between the original signals and the reconstructed signals based on semantic information was used as compensation for the semantic information, and the quality of the reconstructed signals was gradually improved to meet human perceptual needs.The experimental results show that the proposed scheme achieve tactile recognition with semantic information at a lower bit rate while improving the compression efficiency of tactile data, thus satisfying human perceptual needs.
format Article
id doaj-art-ea17586ef4ae43cd93567f919fa0f875
institution Kabale University
issn 1000-436X
language zho
publishDate 2023-05-01
publisher Editorial Department of Journal on Communications
record_format Article
series Tongxin xuebao
spelling doaj-art-ea17586ef4ae43cd93567f919fa0f8752025-01-14T07:23:50ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2023-05-0144425159838116Joint vibrotactile coding for machine recognition and human perceptionYing FANGYiwen XUTiesong ZHAOIn order to accurately transmit the content meaning of vibrotactile signals and achieve intelligent recognition and signal reconstruction, a joint vibrotactile coding scheme for machine recognition and human perception was proposed.At the encoding end, the original three-dimensional vibrotactile signals were converted into one-dimensional signals.Then the semantic information of the signals was extracted using a short-time Fourier transform before being effectively compressed and transmitted.At the decoding end, a fully convolutional neural network was used to intelligently recognize based on the semantic information.The difference between the original signals and the reconstructed signals based on semantic information was used as compensation for the semantic information, and the quality of the reconstructed signals was gradually improved to meet human perceptual needs.The experimental results show that the proposed scheme achieve tactile recognition with semantic information at a lower bit rate while improving the compression efficiency of tactile data, thus satisfying human perceptual needs.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023099/hapticsemantic informationperceptual qualityjoint codingintelligent recognitionvibrotactile
spellingShingle Ying FANG
Yiwen XU
Tiesong ZHAO
Joint vibrotactile coding for machine recognition and human perception
Tongxin xuebao
haptic
semantic information
perceptual quality
joint coding
intelligent recognition
vibrotactile
title Joint vibrotactile coding for machine recognition and human perception
title_full Joint vibrotactile coding for machine recognition and human perception
title_fullStr Joint vibrotactile coding for machine recognition and human perception
title_full_unstemmed Joint vibrotactile coding for machine recognition and human perception
title_short Joint vibrotactile coding for machine recognition and human perception
title_sort joint vibrotactile coding for machine recognition and human perception
topic haptic
semantic information
perceptual quality
joint coding
intelligent recognition
vibrotactile
url http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023099/
work_keys_str_mv AT yingfang jointvibrotactilecodingformachinerecognitionandhumanperception
AT yiwenxu jointvibrotactilecodingformachinerecognitionandhumanperception
AT tiesongzhao jointvibrotactilecodingformachinerecognitionandhumanperception