Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human–Machine Interaction

With the increasing demand for immersive haptic experiences, multimodal tactile sensing and feedback have become crucial for enhancing user interaction. In this work, an interactive haptic system comprising a robotic hand and wearable tactile feedback device is introduced to facilitate tactile infor...

Full description

Saved in:
Bibliographic Details
Main Authors: Jingu Jeong, Mingyu Kang, Youngsup Song, Soonjae Pyo
Format: Article
Language:English
Published: Wiley 2025-05-01
Series:Advanced Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1002/aisy.202400578
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850129534126391296
author Jingu Jeong
Mingyu Kang
Youngsup Song
Soonjae Pyo
author_facet Jingu Jeong
Mingyu Kang
Youngsup Song
Soonjae Pyo
author_sort Jingu Jeong
collection DOAJ
description With the increasing demand for immersive haptic experiences, multimodal tactile sensing and feedback have become crucial for enhancing user interaction. In this work, an interactive haptic system comprising a robotic hand and wearable tactile feedback device is introduced to facilitate tactile information exchange between humans and robots. The robotic hand, equipped with force and temperature sensors, mimics human movements through vision recognition and captures detailed tactile data. The data are then transmitted to the user through a hydraulic feedback device, providing realistic touch sensations. The dual capabilities of the hydraulic mechanism to simultaneously simulate both pressure and temperature sensations simplify the device structure and enhance reliability compared to systems that require multiple tactile actuators. The force feedback system delivers pressures ranging from 0.5 to 10.5 N across five levels while the temperature feedback mechanism provides thermal sensations ranging from 3 to 50 °C across three levels. Extensive experimental validations demonstrate the system's effectiveness in applications such as remote robotic surgery and telepresence, enabling users to perceive real‐time contact pressure and temperature during remote manipulation tasks. The proposed system, capable of delivering multimodal tactile feedback through a single actuator, represents a significant step toward more immersive and realistic haptic experiences, highlighting its broad applicability.
format Article
id doaj-art-dbe2223b95dd44a2bcc949cf25e08bb8
institution OA Journals
issn 2640-4567
language English
publishDate 2025-05-01
publisher Wiley
record_format Article
series Advanced Intelligent Systems
spelling doaj-art-dbe2223b95dd44a2bcc949cf25e08bb82025-08-20T02:32:56ZengWileyAdvanced Intelligent Systems2640-45672025-05-0175n/an/a10.1002/aisy.202400578Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human–Machine InteractionJingu Jeong0Mingyu Kang1Youngsup Song2Soonjae Pyo3Department of Mechanical Design and Robot Engineering Seoul National University of Science and Technology 232 Gongneung‐ro Nowon‐gu Seoul 01811 Republic of KoreaDepartment of Mechanical Design and Robot Engineering Seoul National University of Science and Technology 232 Gongneung‐ro Nowon‐gu Seoul 01811 Republic of KoreaDepartment of Mechanical and Aerospace Engineering University of Florida 1064 Center Dr Gainesville FL 32611 USADepartment of Mechanical Design and Robot Engineering Seoul National University of Science and Technology 232 Gongneung‐ro Nowon‐gu Seoul 01811 Republic of KoreaWith the increasing demand for immersive haptic experiences, multimodal tactile sensing and feedback have become crucial for enhancing user interaction. In this work, an interactive haptic system comprising a robotic hand and wearable tactile feedback device is introduced to facilitate tactile information exchange between humans and robots. The robotic hand, equipped with force and temperature sensors, mimics human movements through vision recognition and captures detailed tactile data. The data are then transmitted to the user through a hydraulic feedback device, providing realistic touch sensations. The dual capabilities of the hydraulic mechanism to simultaneously simulate both pressure and temperature sensations simplify the device structure and enhance reliability compared to systems that require multiple tactile actuators. The force feedback system delivers pressures ranging from 0.5 to 10.5 N across five levels while the temperature feedback mechanism provides thermal sensations ranging from 3 to 50 °C across three levels. Extensive experimental validations demonstrate the system's effectiveness in applications such as remote robotic surgery and telepresence, enabling users to perceive real‐time contact pressure and temperature during remote manipulation tasks. The proposed system, capable of delivering multimodal tactile feedback through a single actuator, represents a significant step toward more immersive and realistic haptic experiences, highlighting its broad applicability.https://doi.org/10.1002/aisy.202400578augmented realitieshydraulic actuationsinteractive haptic systemsmultimodal tactile informationremote manipulationstactile interfaces
spellingShingle Jingu Jeong
Mingyu Kang
Youngsup Song
Soonjae Pyo
Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human–Machine Interaction
Advanced Intelligent Systems
augmented realities
hydraulic actuations
interactive haptic systems
multimodal tactile information
remote manipulations
tactile interfaces
title Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human–Machine Interaction
title_full Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human–Machine Interaction
title_fullStr Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human–Machine Interaction
title_full_unstemmed Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human–Machine Interaction
title_short Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human–Machine Interaction
title_sort interactive haptic system with multimodal tactile sensing and hydraulic feedback for realistic human machine interaction
topic augmented realities
hydraulic actuations
interactive haptic systems
multimodal tactile information
remote manipulations
tactile interfaces
url https://doi.org/10.1002/aisy.202400578
work_keys_str_mv AT jingujeong interactivehapticsystemwithmultimodaltactilesensingandhydraulicfeedbackforrealistichumanmachineinteraction
AT mingyukang interactivehapticsystemwithmultimodaltactilesensingandhydraulicfeedbackforrealistichumanmachineinteraction
AT youngsupsong interactivehapticsystemwithmultimodaltactilesensingandhydraulicfeedbackforrealistichumanmachineinteraction
AT soonjaepyo interactivehapticsystemwithmultimodaltactilesensingandhydraulicfeedbackforrealistichumanmachineinteraction