Motion-generation system for violin-playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure values
Recently, research on human-robot communication attracts many researchers. We believe that music is one of the important channel between human and robot, because it can convey emotional information. In this research, we focus on the violin performance by a robot. Building a system capable of determi...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2024-11-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2024.1439629/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850266165293613056 |
|---|---|
| author | Kenzo Horigome Koji Shibuya |
| author_facet | Kenzo Horigome Koji Shibuya |
| author_sort | Kenzo Horigome |
| collection | DOAJ |
| description | Recently, research on human-robot communication attracts many researchers. We believe that music is one of the important channel between human and robot, because it can convey emotional information. In this research, we focus on the violin performance by a robot. Building a system capable of determining performance from a musical score will leads to better understanding communication through music. In this study, we aim to develop a system that can automatically determine bowing parameters, such as bow speed and bowing direction, from musical scores for a violin-playing robot to produce expressive sounds using reinforcement learning. We adopted Q-learning and ε-greedy methods. In addition, we utilized a neural network to approximate the value function. Our system uses a musical score that incorporates the sound pressure value of each note to determine the bowing speed and direction. This study introduces the design of this system. It also presents simulation results on the differences in bowing parameters caused by changes in learning conditions and sound-pressure values. Regarding learning conditions, the learning rate, discount rate, search rate, and the number of units in the hidden layer in the neural network were changed in the simulation. We used the last two bars of the score and the entire four bars in the first phrase of “Go Tell Aunt Rhody.” We determined the number of units in each layer and conducted simulations. Additionally, we conducted an analysis by adjusting the target sound pressure for each note in the score. As a result, negative rewards decreased and positive rewards increased. Consequently, even with changes in target sound pressure in both the last two bars and the entire four bars, the violin-playing robot can automatically play from the score by improving reinforcement learning. It has become clear that achieving an expressive performance using this method is possible. |
| format | Article |
| id | doaj-art-e7009ab01b7f4041ad0888474f805aaa |
| institution | OA Journals |
| issn | 2296-9144 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj-art-e7009ab01b7f4041ad0888474f805aaa2025-08-20T01:54:15ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442024-11-011110.3389/frobt.2024.14396291439629Motion-generation system for violin-playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure valuesKenzo Horigome0Koji Shibuya1Mechanical Engineering and Robotics Course, Graduate School of Advanced Science and Technology, Ryukoku University, Otsu, JapanMechanical Engineering and Robotics Course, Faculty of Advanced Science and Technology, Ryukoku University, Otsu, JapanRecently, research on human-robot communication attracts many researchers. We believe that music is one of the important channel between human and robot, because it can convey emotional information. In this research, we focus on the violin performance by a robot. Building a system capable of determining performance from a musical score will leads to better understanding communication through music. In this study, we aim to develop a system that can automatically determine bowing parameters, such as bow speed and bowing direction, from musical scores for a violin-playing robot to produce expressive sounds using reinforcement learning. We adopted Q-learning and ε-greedy methods. In addition, we utilized a neural network to approximate the value function. Our system uses a musical score that incorporates the sound pressure value of each note to determine the bowing speed and direction. This study introduces the design of this system. It also presents simulation results on the differences in bowing parameters caused by changes in learning conditions and sound-pressure values. Regarding learning conditions, the learning rate, discount rate, search rate, and the number of units in the hidden layer in the neural network were changed in the simulation. We used the last two bars of the score and the entire four bars in the first phrase of “Go Tell Aunt Rhody.” We determined the number of units in each layer and conducted simulations. Additionally, we conducted an analysis by adjusting the target sound pressure for each note in the score. As a result, negative rewards decreased and positive rewards increased. Consequently, even with changes in target sound pressure in both the last two bars and the entire four bars, the violin-playing robot can automatically play from the score by improving reinforcement learning. It has become clear that achieving an expressive performance using this method is possible.https://www.frontiersin.org/articles/10.3389/frobt.2024.1439629/fullreinforcement learninghumanoidviolin-playing robothidden layertarget sound pressuretotal-reward |
| spellingShingle | Kenzo Horigome Koji Shibuya Motion-generation system for violin-playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure values Frontiers in Robotics and AI reinforcement learning humanoid violin-playing robot hidden layer target sound pressure total-reward |
| title | Motion-generation system for violin-playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure values |
| title_full | Motion-generation system for violin-playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure values |
| title_fullStr | Motion-generation system for violin-playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure values |
| title_full_unstemmed | Motion-generation system for violin-playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure values |
| title_short | Motion-generation system for violin-playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure values |
| title_sort | motion generation system for violin playing robot using reinforcement learning differences in bowing parameters due to changes in learning conditions and sound pressure values |
| topic | reinforcement learning humanoid violin-playing robot hidden layer target sound pressure total-reward |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2024.1439629/full |
| work_keys_str_mv | AT kenzohorigome motiongenerationsystemforviolinplayingrobotusingreinforcementlearningdifferencesinbowingparametersduetochangesinlearningconditionsandsoundpressurevalues AT kojishibuya motiongenerationsystemforviolinplayingrobotusingreinforcementlearningdifferencesinbowingparametersduetochangesinlearningconditionsandsoundpressurevalues |