Simultaneous In‐Hand Shape and Temperature Recognition Using Flexible Multilayered Sensor Arrays for Sense‐Based Robot Manipulation

Abstract Artificial tactile systems play a pivotal role in advancing human‐machine interaction technology by enabling precise physical interaction with objects and environments. Tactile information, such as pressure and temperature, allows robots to manipulate objects accurately and interact safely...

Full description

Saved in:
Bibliographic Details
Main Authors: Seong‐Min Im, Byeong‐Sun Park, Jaehwan Jang, Sungeun Hong, Changjoo Nam, Young Tack Lee, Min‐gu Kim
Format: Article
Language:English
Published: Wiley-VCH 2025-07-01
Series:Advanced Sensor Research
Subjects:
Online Access:https://doi.org/10.1002/adsr.70004
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849321243822522368
author Seong‐Min Im
Byeong‐Sun Park
Jaehwan Jang
Sungeun Hong
Changjoo Nam
Young Tack Lee
Min‐gu Kim
author_facet Seong‐Min Im
Byeong‐Sun Park
Jaehwan Jang
Sungeun Hong
Changjoo Nam
Young Tack Lee
Min‐gu Kim
author_sort Seong‐Min Im
collection DOAJ
description Abstract Artificial tactile systems play a pivotal role in advancing human‐machine interaction technology by enabling precise physical interaction with objects and environments. Tactile information, such as pressure and temperature, allows robots to manipulate objects accurately and interact safely with humans. To facilitate this, a robotic skin integrating flexible pressure and temperature sensor arrays has been developed. The capacitive pressure sensor, inspired by human skin and utilizing a micro‐dome structure, demonstrates fast, stable, and sensitive performance under applied pressure. Also, the resistive temperature sensor, based on reduced graphene oxide, exhibits highly sensitive responses to temperature changes, characterized by rapid and linear behavior. These sensors are vertically integrated into a multilayered system capable of simultaneously detecting real‐time pressure and temperature distribution. This integrated sensor system, when incorporated into a robotic gripper, enables accurate identification of object shapes and surface temperatures during manipulation tasks. By pairing the sensor system with a camera that captures macroscopic visual information, including areas not directly visible, robots achieve enhanced manipulation capabilities through the synergy of visual context and detailed tactile input. This development represents a fundamental technology for multimodal tactile recognition and highlights its potential applications in artificial intelligence‐driven visual‐tactile fusion technologies.
format Article
id doaj-art-551ab1907feb40ef9deafd916663c4fb
institution Kabale University
issn 2751-1219
language English
publishDate 2025-07-01
publisher Wiley-VCH
record_format Article
series Advanced Sensor Research
spelling doaj-art-551ab1907feb40ef9deafd916663c4fb2025-08-20T03:49:49ZengWiley-VCHAdvanced Sensor Research2751-12192025-07-0147n/an/a10.1002/adsr.70004Simultaneous In‐Hand Shape and Temperature Recognition Using Flexible Multilayered Sensor Arrays for Sense‐Based Robot ManipulationSeong‐Min Im0Byeong‐Sun Park1Jaehwan Jang2Sungeun Hong3Changjoo Nam4Young Tack Lee5Min‐gu Kim6Department of Integrated Medicine College of Medicine Yonsei University Seoul 06229 Republic of KoreaDepartment of Electrical and Computer Engineering Inha University Incheon 22212 Republic of KoreaDepartment of Integrated Medicine College of Medicine Yonsei University Seoul 06229 Republic of KoreaDepartment of Immersive Media Engineering Sungkyunkwan University Seoul 32541 Republic of KoreaDepartment of Electronic Engineering Sogang University Seoul 04107 Republic of KoreaDepartment of Electrical and Computer Engineering Inha University Incheon 22212 Republic of KoreaDepartment of Integrated Medicine College of Medicine Yonsei University Seoul 06229 Republic of KoreaAbstract Artificial tactile systems play a pivotal role in advancing human‐machine interaction technology by enabling precise physical interaction with objects and environments. Tactile information, such as pressure and temperature, allows robots to manipulate objects accurately and interact safely with humans. To facilitate this, a robotic skin integrating flexible pressure and temperature sensor arrays has been developed. The capacitive pressure sensor, inspired by human skin and utilizing a micro‐dome structure, demonstrates fast, stable, and sensitive performance under applied pressure. Also, the resistive temperature sensor, based on reduced graphene oxide, exhibits highly sensitive responses to temperature changes, characterized by rapid and linear behavior. These sensors are vertically integrated into a multilayered system capable of simultaneously detecting real‐time pressure and temperature distribution. This integrated sensor system, when incorporated into a robotic gripper, enables accurate identification of object shapes and surface temperatures during manipulation tasks. By pairing the sensor system with a camera that captures macroscopic visual information, including areas not directly visible, robots achieve enhanced manipulation capabilities through the synergy of visual context and detailed tactile input. This development represents a fundamental technology for multimodal tactile recognition and highlights its potential applications in artificial intelligence‐driven visual‐tactile fusion technologies.https://doi.org/10.1002/adsr.70004integrated sensor arraypressure sensor arraysense‐based robot manipulationshape recognitiontemperature recognitiontemperature sensor array
spellingShingle Seong‐Min Im
Byeong‐Sun Park
Jaehwan Jang
Sungeun Hong
Changjoo Nam
Young Tack Lee
Min‐gu Kim
Simultaneous In‐Hand Shape and Temperature Recognition Using Flexible Multilayered Sensor Arrays for Sense‐Based Robot Manipulation
Advanced Sensor Research
integrated sensor array
pressure sensor array
sense‐based robot manipulation
shape recognition
temperature recognition
temperature sensor array
title Simultaneous In‐Hand Shape and Temperature Recognition Using Flexible Multilayered Sensor Arrays for Sense‐Based Robot Manipulation
title_full Simultaneous In‐Hand Shape and Temperature Recognition Using Flexible Multilayered Sensor Arrays for Sense‐Based Robot Manipulation
title_fullStr Simultaneous In‐Hand Shape and Temperature Recognition Using Flexible Multilayered Sensor Arrays for Sense‐Based Robot Manipulation
title_full_unstemmed Simultaneous In‐Hand Shape and Temperature Recognition Using Flexible Multilayered Sensor Arrays for Sense‐Based Robot Manipulation
title_short Simultaneous In‐Hand Shape and Temperature Recognition Using Flexible Multilayered Sensor Arrays for Sense‐Based Robot Manipulation
title_sort simultaneous in hand shape and temperature recognition using flexible multilayered sensor arrays for sense based robot manipulation
topic integrated sensor array
pressure sensor array
sense‐based robot manipulation
shape recognition
temperature recognition
temperature sensor array
url https://doi.org/10.1002/adsr.70004
work_keys_str_mv AT seongminim simultaneousinhandshapeandtemperaturerecognitionusingflexiblemultilayeredsensorarraysforsensebasedrobotmanipulation
AT byeongsunpark simultaneousinhandshapeandtemperaturerecognitionusingflexiblemultilayeredsensorarraysforsensebasedrobotmanipulation
AT jaehwanjang simultaneousinhandshapeandtemperaturerecognitionusingflexiblemultilayeredsensorarraysforsensebasedrobotmanipulation
AT sungeunhong simultaneousinhandshapeandtemperaturerecognitionusingflexiblemultilayeredsensorarraysforsensebasedrobotmanipulation
AT changjoonam simultaneousinhandshapeandtemperaturerecognitionusingflexiblemultilayeredsensorarraysforsensebasedrobotmanipulation
AT youngtacklee simultaneousinhandshapeandtemperaturerecognitionusingflexiblemultilayeredsensorarraysforsensebasedrobotmanipulation
AT mingukim simultaneousinhandshapeandtemperaturerecognitionusingflexiblemultilayeredsensorarraysforsensebasedrobotmanipulation