Parameterizing Method of Music Notation for Motion Timing and Control in a Piano-Playing Robot
This study investigated methods for interpreting sheet music data and converting them into control variables for robots to play the piano. Previous research has addressed the timing and duration of key presses but has not clearly defined the initiation of actions from the perspective of the robot. I...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10788694/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846110562439659520 |
|---|---|
| author | Hyojae Kang Yongjae Lee Daehee Han Seongtaek Im Dongil Park Kangsan Lee Min-Sung Kang |
| author_facet | Hyojae Kang Yongjae Lee Daehee Han Seongtaek Im Dongil Park Kangsan Lee Min-Sung Kang |
| author_sort | Hyojae Kang |
| collection | DOAJ |
| description | This study investigated methods for interpreting sheet music data and converting them into control variables for robots to play the piano. Previous research has addressed the timing and duration of key presses but has not clearly defined the initiation of actions from the perspective of the robot. In addition, the relationship between key press speed and velocity values from the musical instrument digital interface has not adequately addressed sound intensity. Therefore, this research proposes a method for converting musical symbols into control variables, defining the timing of each robot action, and linking key press speed to sound intensity for precise volume control. The study details the timing of the movements of the robot’s fingers and arms and adjusts pedaling according to temporal variations in piano performance. The proposed methods was validated through experiments using a cartesian robot with two hands. The experimental results confirm that the method effectively controls timing and volume of the robot’s play. This study analyzes the impact of varying musical symbols on performance through experiments and suggests their applicability to various robotic forms for piano playing. |
| format | Article |
| id | doaj-art-b8c6ab27a7ba4390ac50609b57eed3e9 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-b8c6ab27a7ba4390ac50609b57eed3e92024-12-24T00:01:03ZengIEEEIEEE Access2169-35362024-01-011218738618740510.1109/ACCESS.2024.351457510788694Parameterizing Method of Music Notation for Motion Timing and Control in a Piano-Playing RobotHyojae Kang0https://orcid.org/0000-0003-3744-0299Yongjae Lee1https://orcid.org/0009-0005-5807-1463Daehee Han2Seongtaek Im3Dongil Park4Kangsan Lee5Min-Sung Kang6https://orcid.org/0000-0002-8459-5843Department of Interdisciplinary Robot Engineering Systems, Hanyang University, Ansan, South KoreaDepartment of Interdisciplinary Robot Engineering Systems, Hanyang University, Ansan, South KoreaDepartment of Interdisciplinary Robot Engineering Systems, Hanyang University, Ansan, South KoreaDepartment of Interdisciplinary Robot Engineering Systems, Hanyang University, Ansan, South KoreaDepartment of Interdisciplinary Robot Engineering Systems, Hanyang University, Ansan, South KoreaDepartment of Interdisciplinary Robot Engineering Systems, Hanyang University, Ansan, South KoreaSchool of Smart Convergence Engineering, Hanyang University, Ansan, South KoreaThis study investigated methods for interpreting sheet music data and converting them into control variables for robots to play the piano. Previous research has addressed the timing and duration of key presses but has not clearly defined the initiation of actions from the perspective of the robot. In addition, the relationship between key press speed and velocity values from the musical instrument digital interface has not adequately addressed sound intensity. Therefore, this research proposes a method for converting musical symbols into control variables, defining the timing of each robot action, and linking key press speed to sound intensity for precise volume control. The study details the timing of the movements of the robot’s fingers and arms and adjusts pedaling according to temporal variations in piano performance. The proposed methods was validated through experiments using a cartesian robot with two hands. The experimental results confirm that the method effectively controls timing and volume of the robot’s play. This study analyzes the impact of varying musical symbols on performance through experiments and suggests their applicability to various robotic forms for piano playing.https://ieeexplore.ieee.org/document/10788694/Piano-playing robotmusic notation symbolspiano dynamicsentertainment robotics |
| spellingShingle | Hyojae Kang Yongjae Lee Daehee Han Seongtaek Im Dongil Park Kangsan Lee Min-Sung Kang Parameterizing Method of Music Notation for Motion Timing and Control in a Piano-Playing Robot IEEE Access Piano-playing robot music notation symbols piano dynamics entertainment robotics |
| title | Parameterizing Method of Music Notation for Motion Timing and Control in a Piano-Playing Robot |
| title_full | Parameterizing Method of Music Notation for Motion Timing and Control in a Piano-Playing Robot |
| title_fullStr | Parameterizing Method of Music Notation for Motion Timing and Control in a Piano-Playing Robot |
| title_full_unstemmed | Parameterizing Method of Music Notation for Motion Timing and Control in a Piano-Playing Robot |
| title_short | Parameterizing Method of Music Notation for Motion Timing and Control in a Piano-Playing Robot |
| title_sort | parameterizing method of music notation for motion timing and control in a piano playing robot |
| topic | Piano-playing robot music notation symbols piano dynamics entertainment robotics |
| url | https://ieeexplore.ieee.org/document/10788694/ |
| work_keys_str_mv | AT hyojaekang parameterizingmethodofmusicnotationformotiontimingandcontrolinapianoplayingrobot AT yongjaelee parameterizingmethodofmusicnotationformotiontimingandcontrolinapianoplayingrobot AT daeheehan parameterizingmethodofmusicnotationformotiontimingandcontrolinapianoplayingrobot AT seongtaekim parameterizingmethodofmusicnotationformotiontimingandcontrolinapianoplayingrobot AT dongilpark parameterizingmethodofmusicnotationformotiontimingandcontrolinapianoplayingrobot AT kangsanlee parameterizingmethodofmusicnotationformotiontimingandcontrolinapianoplayingrobot AT minsungkang parameterizingmethodofmusicnotationformotiontimingandcontrolinapianoplayingrobot |