A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic Haptics
Using the senses is essential to interacting with objects in real-world environments. However, not all the senses are available when interacting with virtual objects in virtual environments. This paper presents a diamond methodology to fuse two technologies to represent the senses of sight and touch...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-02-01
|
| Series: | Multimodal Technologies and Interaction |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2414-4088/9/2/15 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850231562610671616 |
|---|---|
| author | Alma Rodriguez-Ramirez Osslan Osiris Vergara Villegas Manuel Nandayapa Francesco Garcia-Luna María Cristina Guevara Neri |
| author_facet | Alma Rodriguez-Ramirez Osslan Osiris Vergara Villegas Manuel Nandayapa Francesco Garcia-Luna María Cristina Guevara Neri |
| author_sort | Alma Rodriguez-Ramirez |
| collection | DOAJ |
| description | Using the senses is essential to interacting with objects in real-world environments. However, not all the senses are available when interacting with virtual objects in virtual environments. This paper presents a diamond methodology to fuse two technologies to represent the senses of sight and touch when interacting with a virtual object. The sense of sight is represented through augmented reality, and the sense of touch is represented through kinesthetic haptics. The diamond methodology is centered on the user experience and comprises five general stages: (i) experience design, (ii) sensory representation, (iii) development, (iv) display, and (v) fusion. The first stage is the expected, proposed, or needed user experience. Then, each technology takes its homologous activities from the second to the fourth stage, diverging from each other along their development. Finally, the technologies converge to the fifth stage for fusion in the user experience. The diamond methodology was tested by generating a user’s dual sensation when interacting with the elasticity of a tension virtual spring. The user can simultaneously perceive the visual and tactile change of the virtual spring during the interaction, representing the object’s deformation. The experimental results demonstrated that an interactive experience can be felt and seen in augmented reality following the diamond methodology. |
| format | Article |
| id | doaj-art-dd00ddab7c4b4d72aea9d1bfceede984 |
| institution | OA Journals |
| issn | 2414-4088 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Multimodal Technologies and Interaction |
| spelling | doaj-art-dd00ddab7c4b4d72aea9d1bfceede9842025-08-20T02:03:28ZengMDPI AGMultimodal Technologies and Interaction2414-40882025-02-01921510.3390/mti9020015A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic HapticsAlma Rodriguez-Ramirez0Osslan Osiris Vergara Villegas1Manuel Nandayapa2Francesco Garcia-Luna3María Cristina Guevara Neri4Department of Industrial and Manufacturing Engineering, Universidad Autónoma de Ciudad Juárez, Ciudad Juárez 32310, MexicoDepartment of Industrial and Manufacturing Engineering, Universidad Autónoma de Ciudad Juárez, Ciudad Juárez 32310, MexicoDepartment of Industrial and Manufacturing Engineering, Universidad Autónoma de Ciudad Juárez, Ciudad Juárez 32310, MexicoDepartment of Industrial and Manufacturing Engineering, Universidad Autónoma de Ciudad Juárez, Ciudad Juárez 32310, MexicoDepartment of Industrial and Manufacturing Engineering, Universidad Autónoma de Ciudad Juárez, Ciudad Juárez 32310, MexicoUsing the senses is essential to interacting with objects in real-world environments. However, not all the senses are available when interacting with virtual objects in virtual environments. This paper presents a diamond methodology to fuse two technologies to represent the senses of sight and touch when interacting with a virtual object. The sense of sight is represented through augmented reality, and the sense of touch is represented through kinesthetic haptics. The diamond methodology is centered on the user experience and comprises five general stages: (i) experience design, (ii) sensory representation, (iii) development, (iv) display, and (v) fusion. The first stage is the expected, proposed, or needed user experience. Then, each technology takes its homologous activities from the second to the fourth stage, diverging from each other along their development. Finally, the technologies converge to the fifth stage for fusion in the user experience. The diamond methodology was tested by generating a user’s dual sensation when interacting with the elasticity of a tension virtual spring. The user can simultaneously perceive the visual and tactile change of the virtual spring during the interaction, representing the object’s deformation. The experimental results demonstrated that an interactive experience can be felt and seen in augmented reality following the diamond methodology.https://www.mdpi.com/2414-4088/9/2/15augmented realityhapticsimmersive technologiestechnology fusion |
| spellingShingle | Alma Rodriguez-Ramirez Osslan Osiris Vergara Villegas Manuel Nandayapa Francesco Garcia-Luna María Cristina Guevara Neri A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic Haptics Multimodal Technologies and Interaction augmented reality haptics immersive technologies technology fusion |
| title | A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic Haptics |
| title_full | A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic Haptics |
| title_fullStr | A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic Haptics |
| title_full_unstemmed | A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic Haptics |
| title_short | A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic Haptics |
| title_sort | diamond approach to develop virtual object interaction fusing augmented reality and kinesthetic haptics |
| topic | augmented reality haptics immersive technologies technology fusion |
| url | https://www.mdpi.com/2414-4088/9/2/15 |
| work_keys_str_mv | AT almarodriguezramirez adiamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT osslanosirisvergaravillegas adiamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT manuelnandayapa adiamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT francescogarcialuna adiamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT mariacristinaguevaraneri adiamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT almarodriguezramirez diamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT osslanosirisvergaravillegas diamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT manuelnandayapa diamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT francescogarcialuna diamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics AT mariacristinaguevaraneri diamondapproachtodevelopvirtualobjectinteractionfusingaugmentedrealityandkinesthetichaptics |