Image operator learning coupled with CNN classification and its application to staff line removal

Many image transformations can be modeled by image operators that are characterized by pixel-wise local functions defined on a finite support window. In image operator learning, these functions are estimated from training data using machine learning techniques. Input size is usually a critical issue when using learning algorithms, and it limits the size of practicable windows. We propose the use of convolutional neural networks (CNNs) to overcome this limitation. The problem of removing staff-lines in music score images is chosen to evaluate the effects of window and convolutional mask sizes on the learned image operator performance. Results show that the CNN based solution outperforms previous ones obtained using conventional learning algorithms or heuristic algorithms, indicating the potential of CNNs as base classifiers in image operator learning. The implementations will be made available on the TRIOSlib project site.Comment: To appear in ICDAR 201

Multimodal learning for dyslexic musicians: Practical applications for adults

Dyslexia affects 15 to 20% of the population according to the International Dyslexia Association. Multimodal media, such as smartphones and tablets, which are capable of presenting varied modes of information (for example, visual, aural, and kinetic), have been shown to aid learning in dyslexic children. Music has been identified as a useful multisensory tool to help educators improve literacy skills in children. However, little research has been done on the impact of dyslexia on a child or adult’s ability to learn and perform music. Few studies have been undertaken that focus solely on dyslexia’s effect on musical ability in children; even fewer address dyslexia in adult musicians. This study summarises the techniques and suggestions in the literature used by both professional dyslexic musicians and educators of dyslexic children. It is hoped that this summary can inform the creation of a resource that assist musicians and their educators to use in tackling the challenges dyslexia can pose in learning and performing music. A proposed customisable music reading application is described in detail. This application would utilise the multimodal nature of tablet computers and smartphones to suit the learning styles of dyslexic musicians