3 research outputs found
Networked Head-Mounted Displays for Animated Notation and Audio-Scores with SmartVox
International audienceThe combination of graphic/animated scores, acoustic signals (audio-scores) and Head-Mounted Display (HMD) technology offers promising potentials in the context of distributed notation, for live performances and concerts involving voices, instruments and electronics. After an explanation of what SmartVox is technically, and how it is used by composers and performers, this paper explains why this form of technology-aided performance might help musicians for (spectral) tuning and synchronization with an electronic tape. Then, from an exploration of the concepts of distributed notation and networked music performances, it proposes solutions (in conjunction with INScore, BabelScores and the Decibel Score Player) seeking for the expansion of distributed notation practice to a wider community. It finally presents findings relative to the use of SmartVox with HMDs.La combinaison de partitions graphiques/animées, de signaux acoustiques (partitions audio) et de technologie d'affichage "head-mounted display" (HMD) offre des perspectives prometteuses dans le contexte de la notation distribuée, pour des performances et concerts avec voix et instrumentistes équipés de smartphones. Après avoir expliqué ce qu'est techniquement SmartVox, et cet outil est utilisé par les compositeurs et les interprètes, cet article explique pourquoi cette forme de performance assistée pourrait aider les musiciens à s'accorder (spectralement) et à se synchroniser avec une bande électronique. Puis, à partir d’une exploration des concepts de notation distribuée et de performances musicales en réseau, il propose des solutions (conjointement avec INScore, BabelScores et le Decibel Score Player) visant à étendre la pratique de la notation distribuée à une communauté plus large. Il présente enfin des résultats relatifs à l’utilisation de SmartVox avec des casques HMD
BabelBox: un système dédié aux partitions distribuées sur Raspberry Pi, avec INScore, SmartVox et Babelscores
International audienceThe slow but steady shift away from printed text into digital media has not yet modified the working habits of chamber music practitioners. If most instrumentalists still heavily rely on printed scores, audiences increasingly access notated music online, with printed scores synced to an audio recording on youtube for instance. This paper proposes to guide the listener and/or the performer with a cursor scrolling on the page with INScore, in order to examine the consequences of representing time in this way as opposed to traditional bars and beats notation. In addition to its score following interest for pedagogy and analysis, the networking possibilities of today's ubiquitous technologies reveal interesting potentials for works in which the presence of a conductor is required for synchronization between performers and/or with fixed media (film or tape). A Raspberry Pi-embedded prototype for animated/distributed notation is presented here as a score player (such as the Decibel ScorePlayer, or SmartVox), in order to send and synchronize mp4 scores to any browser capable device connected to the same WIFI network. The corpus will concern pieces edited at BabelScores, an online library for contemporary classical music. The BabelScores pdf works, composed in standard engraving softwares, will be animated using INScore and video editors, in order to find strategies for animation or dynamic display of the unfolding of time, originally represented statically on the page.L'abandon lent mais certain du texte imprimé au profit des médias numériques n'a pas encore modifié les habitudes de travail des instrumentistes en musique de chambre. Si la plupart s'appuie encore fortement sur les partitions imprimées, le public a de plus en plus accès aux partitions en ligne, synchronisées sur un enregistrement audio sur youtube par exemple. Cet article propose de guider l'auditeur et/ou l'interprète à l'aide d'un curseur défilant sur la page (avec INScore), afin d'examiner ce qu'implique de représenter le temps de cette manière, par opposition à la notation traditionnelle des mesures rythmiques du solfège. Outre son intérêt pour la pédagogie et l'analyse, les possibilités de mise en réseau des technologies omniprésentes d'aujourd'hui révèlent des potentiels intéressants pour des œuvres dans lesquelles la présence d'un chef d'orchestre est requise pour la synchronisation entre interprètes et/ou avec des supports fixes (film ou bande). Un prototype pour la notation animée/distribuée intégré sur Raspberry Pi est présenté ici comme lecteur de partition (tel que le Decibel ScorePlayer ou SmartVox), afin d’envoyer et de synchroniser les partitions mp4 à n’importe quel appareil compatible avec un navigateur connecté au même réseau WIFI. Le corpus concernera des pièces éditées sur BabelScores, une bibliothèque en ligne de musique classique contemporaine. Les œuvres pdf de BabelScores, composées de logiciels de gravure standard, seront animées à l'aide d'éditeurs INScore et vidéo, afin de trouver des stratégies d'animation ou d'affichage dynamique du déroulement du temps, initialement représentées de manière statique sur la page
Interactive Sound in Performance Ecologies: Studying Connections among Actors and Artifacts
This thesis’s primary goal is to investigate performance ecologies, that is the compound
of humans, artifacts and environmental elements that contribute to the result of a per-
formance. In particular, this thesis focuses on designing new interactive technologies for
sound and music. The goal of this thesis leads to the following Research Questions (RQs):
• RQ1 How can the design of interactive sonic artifacts support a joint expression
across different actors (composers, choreographers, and performers, musicians, and
dancers) in a given performance ecology?
• RQ2 How does each different actor influence the design of different artifacts, and
what impact does this have on the overall artwork?
• RQ3 How do the different actors in the same ecology interact, and appropriate an
interactive artifact?
To reply to these questions, a new framework named ARCAA has been created. In this
framework, all the Actors of a given ecology are connected to all the Artifacts throughout
three layers: Role, Context and Activity. This framework is then applied to one systematic
literature review, two case studies on music performance and one case study in dance
performance. The studies help to better understand the shaded roles of composers, per-
formers, instrumentalists, dancers, and choreographers, which is relevant to better design
interactive technologies for performances. Finally, this thesis proposes a new reflection on
the blurred distinction between composing and designing a new instrument in a context
that involves a multitude of actors.
Overall, this work introduces the following contributions to the field of interaction
design applied to music technology: 1) ARCAA, a framework to analyse the set of inter-
connected relationship in interactive (music) performances, validated through 2 music
studies, 1 dance study and 1 systematic literature analysis; 2) Recommendations for de-
signing music interactive system for performance (music or dance), accounting for the
needs of the various actors and for the overlapping on music composition and design of in-
teractive technology; 3) A taxonomy of how scores have shaped performance ecologies in NIME, based on a systematic analysis of the literature on score in the NIME proceedings;
4) Proposal of a methodological approach combining autobiographical and idiographical
design approaches in interactive performances.O objetivo principal desta tese Ă© investigar as ecologias performativas, conjunto formado
pelos participantes humanos, artefatos e elementos ambientais que contribuem para o
resultado de uma performance. Em particular, esta tese foca-se na conceção de novas
tecnologias interativas para som e mĂşsica. O objetivo desta tese originou as seguintes
questões de investigação (Research Questions RQs):
• RQ1 Como o design de artefatos sonoros interativos pode apoiar a expressão con-
junta entre diferentes atores (compositores, coreĂłgrafos e performers, mĂşsicos e
dançarinos) numa determinada ecologia performativa?
• RQ2 Como cada ator influencia o design de diferentes artefatos e que impacto isso
tem no trabalho artĂstico global?
• RQ3 Como os diferentes atores de uma mesma ecologia interagem e se apropriam
de um artefato interativo?
Para responder a essas perguntas, foi criado uma nova framework chamada ARCAA.
Nesta framework, todos os atores (Actores) de uma dada ecologia estĂŁo conectados a todos
os artefatos (Artefacts) através de três camadas: Role, Context e Activity. Esta framework
foi então aplicada a uma revisão sistemática da literatura, a dois estudos de caso sobre
performance musical e a um estudo de caso em performance de dança. Estes estudos aju-
daram a comprender melhor os papéis desempenhados pelos compositores, intérpretes,
instrumentistas, dançarinos e coreógrafos, o que é relevante para melhor projetar as tec-
nologias interativas para performances. Por fim, esta tese propõe uma nova reflexão sobre
a distinção entre compor e projetar um novo instrumento num contexto que envolve uma
multiplicidade de atores.
Este trabalho apresenta as seguintes contribuições principais para o campo do design
de interação aplicado à tecnologia musical: 1) ARCAA, uma framework para analisar o
conjunto de relações interconectadas em performances interativas, validado através de
dois estudos de caso relacionados com a mĂşsica, um estudo de caso relacionado com
a dança e uma análise sistemática da literatura; 2) Recomendações para o design de sistemas interativos musicais para performance (música ou dança), tendo em conta as
necessidades dos vários atores e a sobreposição entre a composição musical e o design de
tecnologia interactiva; 3) Uma taxonomia sobre como as partituras musicais moldaram
as ecologias performativas no NIME, com base numa análise sistemática da literatura
dos artigos apresentados e publicados nestas conferĂŞncia; 4) Proposta de uma aborda-
gem metodológica combinando abordagens de design autobiográfico e idiográfico em
performances interativas