Restoration of Guqin Music by Deep Learning Methods

Guqin (古琴)music played an important role in the history of Asia cultures.The notation of Guqin ancient music remained more than 600, however, only about 100 of them are played in nowadays.The reason is that the handwritten Guqin notations named "Jianzi Pu" is hard to be understood, however, we challenge to restore the Guqin music by deep learning methods and few Jianzi Pu images.VGG16 and YOLOv5 were adopted in the recognition experiment for Guqin music restoration.For a well-known Guqin music "Sen-O-So"(仙翁操), 55 kinds of single characters of Jianzi Pu and 4,951 images of them were collected from 23 kinds of Sen-O-So version found by the Internet or obtained by image processing such as rotation, enlarge (zoom-in), reduce (zoom-out), filtering, etc.The average accuracies of VGG16 and YOLOv5 were 87.50% and 88.47% for the test data, respectively.Additionally, it was realized an online output of Guqin music as its output of audio or video forms by YOLOv5 in this study.