A Vision-Based Approach for Estimating Contact Forces: Applications to Robot-Assisted Surgery

The primary goal of this paper is to provide force feedback to the user using vision-based techniques. The approach presented in this paper can be used to provide force feedback to the surgeon for robot-assisted procedures. As proof of concept, we have developed a linear elastic finite element model...

Full description

Saved in:
Bibliographic Details
Main Authors: C. W. Kennedy, J. P. Desai
Format: Article
Language:English
Published: Wiley 2005-01-01
Series:Applied Bionics and Biomechanics
Online Access:http://dx.doi.org/10.1533/abbi.2004.0006
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850232399974105088
author C. W. Kennedy
J. P. Desai
author_facet C. W. Kennedy
J. P. Desai
author_sort C. W. Kennedy
collection DOAJ
description The primary goal of this paper is to provide force feedback to the user using vision-based techniques. The approach presented in this paper can be used to provide force feedback to the surgeon for robot-assisted procedures. As proof of concept, we have developed a linear elastic finite element model (FEM) of a rubber membrane whereby the nodal displacements of the membrane points are measured using vision. These nodal displacements are the input into our finite element model. In the first experiment, we track the deformation of the membrane in real-time through stereovision and compare it with the actual deformation computed through forward kinematics of the robot arm. On the basis of accurate deformation estimation through vision, we test the physical model of a membrane developed through finite element techniques. The FEM model accurately reflects the interaction forces on the user console when the interaction forces of the robot arm with the membrane are compared with those experienced by the surgeon on the console through the force feedback device. In the second experiment, the PHANToM haptic interface device is used to control the Mitsubishi PA-10 robot arm and interact with the membrane in real-time. Image data obtained through vision of the deformation of the membrane is used as the displacement input for the FEM model to compute the local interaction forces which are then displayed on the user console for providing force feedback and hence closing the loop.
format Article
id doaj-art-00c6ec72fa0e43b2979a345aa4e9680f
institution OA Journals
issn 1176-2322
1754-2103
language English
publishDate 2005-01-01
publisher Wiley
record_format Article
series Applied Bionics and Biomechanics
spelling doaj-art-00c6ec72fa0e43b2979a345aa4e9680f2025-08-20T02:03:13ZengWileyApplied Bionics and Biomechanics1176-23221754-21032005-01-0121536010.1533/abbi.2004.0006A Vision-Based Approach for Estimating Contact Forces: Applications to Robot-Assisted SurgeryC. W. Kennedy0J. P. Desai1Program for Robotics, Intelligent Sensing, and Mechatronics (PRISM) Laboratory, 3141 Chestnut Street, MEM Department, Room 2-115, Drexel University, Philadelphia, PA 19104, USAProgram for Robotics, Intelligent Sensing, and Mechatronics (PRISM) Laboratory, 3141 Chestnut Street, MEM Department, Room 2-115, Drexel University, Philadelphia, PA 19104, USAThe primary goal of this paper is to provide force feedback to the user using vision-based techniques. The approach presented in this paper can be used to provide force feedback to the surgeon for robot-assisted procedures. As proof of concept, we have developed a linear elastic finite element model (FEM) of a rubber membrane whereby the nodal displacements of the membrane points are measured using vision. These nodal displacements are the input into our finite element model. In the first experiment, we track the deformation of the membrane in real-time through stereovision and compare it with the actual deformation computed through forward kinematics of the robot arm. On the basis of accurate deformation estimation through vision, we test the physical model of a membrane developed through finite element techniques. The FEM model accurately reflects the interaction forces on the user console when the interaction forces of the robot arm with the membrane are compared with those experienced by the surgeon on the console through the force feedback device. In the second experiment, the PHANToM haptic interface device is used to control the Mitsubishi PA-10 robot arm and interact with the membrane in real-time. Image data obtained through vision of the deformation of the membrane is used as the displacement input for the FEM model to compute the local interaction forces which are then displayed on the user console for providing force feedback and hence closing the loop.http://dx.doi.org/10.1533/abbi.2004.0006
spellingShingle C. W. Kennedy
J. P. Desai
A Vision-Based Approach for Estimating Contact Forces: Applications to Robot-Assisted Surgery
Applied Bionics and Biomechanics
title A Vision-Based Approach for Estimating Contact Forces: Applications to Robot-Assisted Surgery
title_full A Vision-Based Approach for Estimating Contact Forces: Applications to Robot-Assisted Surgery
title_fullStr A Vision-Based Approach for Estimating Contact Forces: Applications to Robot-Assisted Surgery
title_full_unstemmed A Vision-Based Approach for Estimating Contact Forces: Applications to Robot-Assisted Surgery
title_short A Vision-Based Approach for Estimating Contact Forces: Applications to Robot-Assisted Surgery
title_sort vision based approach for estimating contact forces applications to robot assisted surgery
url http://dx.doi.org/10.1533/abbi.2004.0006
work_keys_str_mv AT cwkennedy avisionbasedapproachforestimatingcontactforcesapplicationstorobotassistedsurgery
AT jpdesai avisionbasedapproachforestimatingcontactforcesapplicationstorobotassistedsurgery
AT cwkennedy visionbasedapproachforestimatingcontactforcesapplicationstorobotassistedsurgery
AT jpdesai visionbasedapproachforestimatingcontactforcesapplicationstorobotassistedsurgery