Automatic Evaluation of Aspects of Performance and Scheduling in Playing the Piano

Tamir-Ostrover H, Baruch G, Peleg O, et al. Automatic Evaluation of Aspects of Performance and Scheduling in Playing the Piano. Presented at the 30th ACM Conference on User Modeling, Adaptation and Personalization (UMAP), Barcelona.There is a growing trend to teach playing an instrument such as a piano at home using an automated system. A key component of such systems is the ability to rate performance of the learner in order to provide feedback and select appropriate exercises. In this study, we expand on previous works that have developed automatic evaluation systems for an overall grade by also providing predic- tions for specific aspects of performance: pitch, rhythm, tempo, and articulation & dynamics, as well as scheduling what is an appropri- ate next task. We describe how a set of salient features is extractedUMAP ’22, July 4–7, 2022, Barcelona, Spain by comparing MIDI performance data of three piano players to an ideal performance, how the features used for evaluation are selected, and evaluate using linear regression how well the selected features are able to predict the mean scores given by a group of domain experts (piano teachers). Relatively good R 2 scores (0.54 to 0.68) are achieved using a small number of features (2 - 4). Such automatic evaluation of different aspects of performance can be used as a part of an automatic learning system, and to help provide learners with detailed feedback on their performance