A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy
Abstract We present a metaverse laboratory system that integrates mixed reality (MR) technologies with scanning probe microscopy (SPM) for interactive atomic-scale visualization and manipulation. In order to accommodate both the visualization and input of SPM data in a virtual environment and the ph...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-05-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-025-01578-y |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850141458023055360 |
|---|---|
| author | Zhuo Diao Hayato Yamashita Masayuki Abe |
| author_facet | Zhuo Diao Hayato Yamashita Masayuki Abe |
| author_sort | Zhuo Diao |
| collection | DOAJ |
| description | Abstract We present a metaverse laboratory system that integrates mixed reality (MR) technologies with scanning probe microscopy (SPM) for interactive atomic-scale visualization and manipulation. In order to accommodate both the visualization and input of SPM data in a virtual environment and the physical interaction with SPM-related equipment in the laboratory, the system incorporates a virtual reality (VR) and augmented reality (AR) framework to enable seamless switching between these two environments. Utilizing the pose-tracking capabilities in AR, users can intuitively interact with virtual interface elements and three-dimensional objects through physical hand gesture input to control SPM parameters and probe positioning. The system provides real-time visualization of scanned surfaces at the atomic scale in the virtual environment, enabling immediate feedback during experiments. To demonstrate the system’s capabilities, we performed atomic manipulation experiments using hand gestures for lateral probe positioning, showing how MR-enhanced SPM can simplify nanoscale operations and improve experimental efficiency. Our integrated MR–SPM system allows users to conduct experiments via the metaverse platform while enhancing the human-instrument interaction experience. It extends the practical utility required for both real-time physical and virtual environment SPM operations in the laboratory, making nanoscale research more accessible and intuitive. |
| format | Article |
| id | doaj-art-d9ea48ca41324cd2a3570ba4d8a2ad8c |
| institution | OA Journals |
| issn | 2045-2322 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-d9ea48ca41324cd2a3570ba4d8a2ad8c2025-08-20T02:29:26ZengNature PortfolioScientific Reports2045-23222025-05-0115111010.1038/s41598-025-01578-yA metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopyZhuo Diao0Hayato Yamashita1Masayuki Abe2Graduate School of Engineering Science, Osaka UniversityGraduate School of Engineering Science, Osaka UniversityGraduate School of Engineering Science, Osaka UniversityAbstract We present a metaverse laboratory system that integrates mixed reality (MR) technologies with scanning probe microscopy (SPM) for interactive atomic-scale visualization and manipulation. In order to accommodate both the visualization and input of SPM data in a virtual environment and the physical interaction with SPM-related equipment in the laboratory, the system incorporates a virtual reality (VR) and augmented reality (AR) framework to enable seamless switching between these two environments. Utilizing the pose-tracking capabilities in AR, users can intuitively interact with virtual interface elements and three-dimensional objects through physical hand gesture input to control SPM parameters and probe positioning. The system provides real-time visualization of scanned surfaces at the atomic scale in the virtual environment, enabling immediate feedback during experiments. To demonstrate the system’s capabilities, we performed atomic manipulation experiments using hand gestures for lateral probe positioning, showing how MR-enhanced SPM can simplify nanoscale operations and improve experimental efficiency. Our integrated MR–SPM system allows users to conduct experiments via the metaverse platform while enhancing the human-instrument interaction experience. It extends the practical utility required for both real-time physical and virtual environment SPM operations in the laboratory, making nanoscale research more accessible and intuitive.https://doi.org/10.1038/s41598-025-01578-y |
| spellingShingle | Zhuo Diao Hayato Yamashita Masayuki Abe A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy Scientific Reports |
| title | A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy |
| title_full | A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy |
| title_fullStr | A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy |
| title_full_unstemmed | A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy |
| title_short | A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy |
| title_sort | metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy |
| url | https://doi.org/10.1038/s41598-025-01578-y |
| work_keys_str_mv | AT zhuodiao ametaverselaboratorysetupforinteractiveatomvisualizationandmanipulationwithscanningprobemicroscopy AT hayatoyamashita ametaverselaboratorysetupforinteractiveatomvisualizationandmanipulationwithscanningprobemicroscopy AT masayukiabe ametaverselaboratorysetupforinteractiveatomvisualizationandmanipulationwithscanningprobemicroscopy AT zhuodiao metaverselaboratorysetupforinteractiveatomvisualizationandmanipulationwithscanningprobemicroscopy AT hayatoyamashita metaverselaboratorysetupforinteractiveatomvisualizationandmanipulationwithscanningprobemicroscopy AT masayukiabe metaverselaboratorysetupforinteractiveatomvisualizationandmanipulationwithscanningprobemicroscopy |