Unlocking Dynamic Subtle Stimuli Tactile Perception: A Deep Learning‐Enhanced Super‐Resolution Tactile Sensor Array with Rapid Response

Human skin's touch perception, mediated by mechanoreceptors, can perceive tactile stimuli with a spatial resolution higher than the average spacing between mechanoreceptors, known as super‐resolution. This characteristic enables its sensitivity to both stimulus location and velocity. However, e...

Full description

Saved in:
Bibliographic Details
Main Authors: Shuyao Zhou, Depeng Kong, Mengke Wang, Baocheng Wang, Yuyao Lu, Honghao Lyu, Zhangli Lu, Yong Tao, Kaichen Xu, Geng Yang
Format: Article
Language:English
Published: Wiley 2025-05-01
Series:Advanced Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1002/aisy.202400913
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849744812774785024
author Shuyao Zhou
Depeng Kong
Mengke Wang
Baocheng Wang
Yuyao Lu
Honghao Lyu
Zhangli Lu
Yong Tao
Kaichen Xu
Geng Yang
author_facet Shuyao Zhou
Depeng Kong
Mengke Wang
Baocheng Wang
Yuyao Lu
Honghao Lyu
Zhangli Lu
Yong Tao
Kaichen Xu
Geng Yang
author_sort Shuyao Zhou
collection DOAJ
description Human skin's touch perception, mediated by mechanoreceptors, can perceive tactile stimuli with a spatial resolution higher than the average spacing between mechanoreceptors, known as super‐resolution. This characteristic enables its sensitivity to both stimulus location and velocity. However, existing robotic tactile sensors lag behind human tactile perception, failing to achieve high spatial resolution and rapid response simultaneously. This significantly hinders robots from executing accurate, time‐sensitive interaction tasks, particularly during dynamic slight‐contact events. Here, a 130 μm‐thick flexible tactile sensor array is designed, with spatial resolution enhanced by a tailored deep learning model, multistage attention‐based adaptive spatial–temporal graph convolutional networks (MS‐AASTGCN), simultaneously achieving a dynamic response of ≈30 ms and a super‐resolution factor of 75.19. The tactile sensor array, based on single‐electrode triboelectric nanogenerators, can detect dynamic subtle stimuli. It features a bio‐inspired topological structure, facilitating super‐resolution performance while offering a large perception area with low sensor (taxel) density. Additionally, the MS‐AASTGCN enhances positioning resolution by extracting features fromsensing data and revealing the hidden relationships among taxels. This research provides new insights into haptic perception systems, enabling the execution of precise, time‐sensitive interaction tasks, such as tracking a bouncing table tennis ball.
format Article
id doaj-art-6423eb3386e94b0f87dc6f305e1bb2a0
institution DOAJ
issn 2640-4567
language English
publishDate 2025-05-01
publisher Wiley
record_format Article
series Advanced Intelligent Systems
spelling doaj-art-6423eb3386e94b0f87dc6f305e1bb2a02025-08-20T03:08:17ZengWileyAdvanced Intelligent Systems2640-45672025-05-0175n/an/a10.1002/aisy.202400913Unlocking Dynamic Subtle Stimuli Tactile Perception: A Deep Learning‐Enhanced Super‐Resolution Tactile Sensor Array with Rapid ResponseShuyao Zhou0Depeng Kong1Mengke Wang2Baocheng Wang3Yuyao Lu4Honghao Lyu5Zhangli Lu6Yong Tao7Kaichen Xu8Geng Yang9State Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaState Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaState Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaState Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaState Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaState Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaState Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaSchool of Mechanical Engineering & Automation Beihang University Beijing 100191 ChinaState Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaState Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou 310030 ChinaHuman skin's touch perception, mediated by mechanoreceptors, can perceive tactile stimuli with a spatial resolution higher than the average spacing between mechanoreceptors, known as super‐resolution. This characteristic enables its sensitivity to both stimulus location and velocity. However, existing robotic tactile sensors lag behind human tactile perception, failing to achieve high spatial resolution and rapid response simultaneously. This significantly hinders robots from executing accurate, time‐sensitive interaction tasks, particularly during dynamic slight‐contact events. Here, a 130 μm‐thick flexible tactile sensor array is designed, with spatial resolution enhanced by a tailored deep learning model, multistage attention‐based adaptive spatial–temporal graph convolutional networks (MS‐AASTGCN), simultaneously achieving a dynamic response of ≈30 ms and a super‐resolution factor of 75.19. The tactile sensor array, based on single‐electrode triboelectric nanogenerators, can detect dynamic subtle stimuli. It features a bio‐inspired topological structure, facilitating super‐resolution performance while offering a large perception area with low sensor (taxel) density. Additionally, the MS‐AASTGCN enhances positioning resolution by extracting features fromsensing data and revealing the hidden relationships among taxels. This research provides new insights into haptic perception systems, enabling the execution of precise, time‐sensitive interaction tasks, such as tracking a bouncing table tennis ball.https://doi.org/10.1002/aisy.202400913deep learningdynamic perceptionssubtle stimuli perceptionssuper‐resolutiontactile perceptionstactile sensors
spellingShingle Shuyao Zhou
Depeng Kong
Mengke Wang
Baocheng Wang
Yuyao Lu
Honghao Lyu
Zhangli Lu
Yong Tao
Kaichen Xu
Geng Yang
Unlocking Dynamic Subtle Stimuli Tactile Perception: A Deep Learning‐Enhanced Super‐Resolution Tactile Sensor Array with Rapid Response
Advanced Intelligent Systems
deep learning
dynamic perceptions
subtle stimuli perceptions
super‐resolution
tactile perceptions
tactile sensors
title Unlocking Dynamic Subtle Stimuli Tactile Perception: A Deep Learning‐Enhanced Super‐Resolution Tactile Sensor Array with Rapid Response
title_full Unlocking Dynamic Subtle Stimuli Tactile Perception: A Deep Learning‐Enhanced Super‐Resolution Tactile Sensor Array with Rapid Response
title_fullStr Unlocking Dynamic Subtle Stimuli Tactile Perception: A Deep Learning‐Enhanced Super‐Resolution Tactile Sensor Array with Rapid Response
title_full_unstemmed Unlocking Dynamic Subtle Stimuli Tactile Perception: A Deep Learning‐Enhanced Super‐Resolution Tactile Sensor Array with Rapid Response
title_short Unlocking Dynamic Subtle Stimuli Tactile Perception: A Deep Learning‐Enhanced Super‐Resolution Tactile Sensor Array with Rapid Response
title_sort unlocking dynamic subtle stimuli tactile perception a deep learning enhanced super resolution tactile sensor array with rapid response
topic deep learning
dynamic perceptions
subtle stimuli perceptions
super‐resolution
tactile perceptions
tactile sensors
url https://doi.org/10.1002/aisy.202400913
work_keys_str_mv AT shuyaozhou unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT depengkong unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT mengkewang unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT baochengwang unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT yuyaolu unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT honghaolyu unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT zhanglilu unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT yongtao unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT kaichenxu unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse
AT gengyang unlockingdynamicsubtlestimulitactileperceptionadeeplearningenhancedsuperresolutiontactilesensorarraywithrapidresponse