Deformability-Based Grasp Pose Detection From a Visible Image

In this study, we introduce a method for estimating deformability from the appearance of an object and a technique for detecting the grasp pose using a single-depth image. Deformability, defined as a score, provides an approximate measure of the ease with which an object can be deformed, based on th...

Full description

Saved in:
Bibliographic Details
Main Authors: Koshi Makihara, Yukiyasu Domae, Ryo Hanai, Ixchel G. Ramirez-Alpizar, Hirokatsu Kataoka, Kensuke Harada
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10776971/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this study, we introduce a method for estimating deformability from the appearance of an object and a technique for detecting the grasp pose using a single-depth image. Deformability, defined as a score, provides an approximate measure of the ease with which an object can be deformed, based on the intuitive human assumption that appearance correlates with this property. Unlike previous approaches that synthesize the entire image in one step and struggle with accuracy in complex scenarios, such as cluttered environments with multiple objects, our method advances the field by employing an encoder-decoder model for simultaneous deformability estimation and instance segmentation from depth images, as well as by enhancing grasp pose detection for deformable objects under specific conditions using the outcomes of our deformability assessments. We demonstrated the efficacy of our integrated approach in diverse challenging settings, including the manipulation of deformable hollow objects in cluttered scenes, interaction with partially deformable objects, and displacement of nearby deformable objects in real-world environments.
ISSN:2169-3536