Analyzing Visual Mappings of Traditional and Alternative Music Notation

In this paper, we postulate that combining the domains of information visualization and music studies paves the ground for a more structured analysis of the design space of music notation, enabling the creation of alternative music notations that are tailored to different users and their tasks. Hence, we discuss the instantiation of a design and visualization pipeline for music notation that follows a structured approach, based on the fundamental concepts of information and data visualization. This enables practitioners and researchers of digital humanities and information visualization, alike, to conceptualize, create, and analyze novel music notation methods. Based on the analysis of relevant stakeholders and their usage of music notation as a mean of communication, we identify a set of relevant features typically encoded in different annotations and encodings, as used by interpreters, performers, and readers of music. We analyze the visual mappings of musical dimensions for varying notation methods to highlight gaps and frequent usages of encodings, visual channels, and Gestalt laws. This detailed analysis leads us to the conclusion that such an under-researched area in information visualization holds the potential for fundamental research. This paper discusses possible research opportunities, open challenges, and arguments that can be pursued in the process of analyzing, improving, or rethinking existing music notation systems and techniques.Comment: 5 pages including references, 3rd Workshop on Visualization for the Digital Humanities, Vis4DH, IEEE Vis 201

Interactive Extraction of High-Frequency Aesthetically-Coherent Colormaps

Color transfer functions (i.e. colormaps) exhibiting a high frequency luminosity component have proven to be useful in the visualization of data where feature detection or iso-contours recognition is essential. Having these colormaps also display a wide range of color and an aesthetically pleasing composition holds the potential to further aid image understanding and analysis. However producing such colormaps in an efficient manner with current colormap creation tools is difficult. We hereby demonstrate an interactive technique for extracting colormaps from artwork and pictures. We show how the rich and careful color design and dynamic luminance range of an existing image can be gracefully captured in a colormap and be utilized effectively in the exploration of complex datasets

The Research Space: using the career paths of scholars to predict the evolution of the research output of individuals, institutions, and nations

In recent years scholars have built maps of science by connecting the academic fields that cite each other, are cited together, or that cite a similar literature. But since scholars cannot always publish in the fields they cite, or that cite them, these science maps are only rough proxies for the potential of a scholar, organization, or country, to enter a new academic field. Here we use a large dataset of scholarly publications disambiguated at the individual level to create a map of science-or research space-where links connect pairs of fields based on the probability that an individual has published in both of them. We find that the research space is a significantly more accurate predictor of the fields that individuals and organizations will enter in the future than citation based science maps. At the country level, however, the research space and citations based science maps are equally accurate. These findings show that data on career trajectories-the set of fields that individuals have previously published in-provide more accurate predictors of future research output for more focalized units-such as individuals or organizations-than citation based science maps

Music Aid:Towards a Collaborative Experience for Deaf and Hearing People in Creating Music

This paper explores the possibility of breaking the barrier between deaf and hearing people when it comes to the subject of making music. Suggestions on how deaf and hearing people can collaborate in creating music together, are presented. The conducted research will focus on deaf people with a general interest in music as well as hearing musicians as target groups. Through reviewing different related research areas, it is found that visualization of sound along with a haptic feedback can help deaf people interpret and interact with music. With this in mind, three variations of a collaborative user interface are presented, in which deaf and hearing people are meant to collaborate in creating short beats and melody sequences. Through evaluating the three prototypes, with two deaf people and two hearing musicians, it is found that the target groups can collaborate to some extent in creating beats. However, in order for the target groups to create melodic sequences together in a satisfactory manner, more detailed visualization and distributed haptic output is necessary, mostly due to the fact that the deaf test participants struggle in distinguishing between higher pitch and timbre

Visualization of Musical Instruments through MIDI Interface

We have created a Music Visualization system that controls an LED strip by parsing MIDI signals that are sent by a musical instrument. This is achieved through a program that parses the MIDI note signals into three-byte RGB signals which are then transferred over WIFI to four Arduino boards that control the LEDs. The system provides a musician the ability to add a dynamic light display that responds to the music in real-time. The system utilizes Windows Presentation Foundation because of its event handling and GUI capabilities. The board we are using is the Arduino MKR 1010 WIFI board as it offers WIFI transmission and it can control the LEDs using pulse width modulation (PWM). The algorithms we designed for the RGB parsing are driven by the pitch and velocity of the MIDI note signals

Data Sonification in Creative Practice

Sonification is the process of data transmission with non-speech audio. While finding increasing acceptance as a scientific method, particularly where a visual representation of data is inadequate, it is still often derided as a ‘gimmick’. Composers have also shown growing interest in sonification as a compositional method. Both in science and in music, the criticism towards this method relates to poor aesthetics and gratuitous applications. This thesis aims to address these issues through an accompanying portfolio of pieces which use sonification as a compositional tool. It establishes the principles of ‘musification’, which can be defined as a sonification which uses musical structures; a sonification organised by musical principles. The practice-as-research portfolio explores a number of data sources, musical genres and science-music collaborations. The main contributions to knowledge derived from the project are a portfolio of compositions, a compositional framework for sonification and an evaluation framework for musification. This thesis demonstrates the validity of practice-as-research as a methodology in sonification research

Science, Art and Geometrical Imagination

From the geocentric, closed world model of Antiquity to the wraparound universe models of relativistic cosmology, the parallel history of space representations in science and art illustrates the fundamental role of geometric imagination in innovative findings. Through the analysis of works of various artists and scientists like Plato, Durer, Kepler, Escher, Grisey or the present author, it is shown how the process of creation in science and in the arts rests on aesthetical principles such as symmetry, regular polyhedra, laws of harmonic proportion, tessellations, group theory, etc., as well as beauty, conciseness and emotional approach of the world.Comment: 22 pages, 28 figures, invited talk at the IAU Symposium 260 "The Role of Astronomy in Society and Culture", UNESCO, 19-23 January 2009, Paris, Proceedings to be publishe