Enabling Audiovisual User Interfaces

“Enabling Audiovisual User Interfaces” was a 2-year project, supported by a Marie Curie EU fellowship, conducted at EAVI, Goldsmiths. During the project, I investigated how human-computer interactions can be audiovisualized in order to improve user experience and usability. To address this issue, a new UI paradigm was proposed – AVUI (AudioVisual User Interface). AVUI links interaction, sound and image, building upon the concept of Graphical User Interface (GUI) by adding interconnected sound and image. The research hypothesis was: the introduction of AVUI, integrating interrelated sonic and visual feedback, reacting to user interactions, would lead to more usable, accessible, playful and engaging UIs, as compared to a traditional GUI – particularly in use cases where accessibility and/or engagement were determinant. I applied AVUIs to case studies, which was the object of user testing. After reaching conclusions from these, I proposed an AVUI framework, including software modules and a set of best practices. Dissemination activities were also implemented

Co-organising hackathons with students: opportunities and best practices

We identify problems regarding teaching in higher education, particularly in computing subjects: short attention spans; lack of focus on cutting-edge topics; lack of attention to relevant issues for students; and disconnect from research. We propose that co-organising hackathons with students can assist in addressing these issues. We present a literature review, our experience in organising three hackathons and the resulting feedback gathered from participants. Based on that experience, and in articulation with related literature, we suggest best practices for organising these events. We also discuss applicability to other fields beyond computing

Multimédia em Portugal: dinâmicas de inovação

Instituto Superior de Economia e GestãoN/

From GUI to AVUI: situating audiovisual user interfaces within human-computer interaction and related fields

INTRODUCTION: We propose AudioVisual User Interfaces (AVUI), a novel type of UI linking interaction, sound and image. It extends the concept of Graphical User Interface (GUI) by adding interconnected sound and image. OBJECTIVES: We aim to situate AVUIs in relation to identified relevant fields: Human-Computer Interaction (HCI), sonic interaction design, cognitive psychology and audiovisual art, and to identify benefits of AVUIs in the context of those fields. METHODS: In this research, we combine literature review of related concepts with a user-centered design methodology, involving a community of audiovisual artists and performers. RESULTS: We contextualize AVUI within the identified fields and identify benefits for the implementation of AVUIs in relation to those fields. CONCLUSION: These results can contribute to the further adoption of AVUIs by the HCI community, particularly those interested in multisensory experience involving sound and image

Connected layers: evaluating visualizations of embodiment in contemporary dance performances

There has been a growing interest in interactive visuals in contemporary dance performances. These visuals often rely on embodied interaction techniques, such as motion capture or biosignal sensors. However, there is a lack of research into how audience members experience these interactive visuals, and how to enhance that experience. We conducted an audience study, involving four different dance performances. Each of the performances explored a different approach for interaction involving visuals. We collected data from audience members, regarding their experience of the performances, using questionnaires and interviews. The analysis of this data allows us to identify implications for design: balancing trade-offs within a mapping clarity spectrum; connecting layers; visuals as co-creative mediator; defined territory and individuality of visuals; exploration of perspective shift and abstract fragmentation. We argue that these considerations are relevant for designers of systems visualizing embodied interaction, not just for dance, but also for other related applications

VR open scores: scores as inspiration for VR scenarios

In this paper, we introduce the concept of VR Open Scores: aleatoric score-based virtual scenarios where an aleatoric score is embedded in a virtual environment. This idea builds upon the notion of graphic scores and composed in- strument, and apply them in a new context. Our proposal also explores possible parallels between open meaning in interaction design, and aleatoric score, conceptualized as Open Work by the Italian philosopher Umberto Eco. Our approach has two aims. The first aim is to create an envi- ronment where users can immerse themselves in the visual elements of a score while listening to the corresponding mu- sic. The second aim is to facilitate users to develop a per- sonal relationship with both the system and the score. To achieve those aims, as a practical implementation of our proposed concept, we developed two immersive scenarios: a 360o video and an interactive space. We conclude pre- senting how our design aims were accomplished in the two scenarios, and describing positive and negative elements of our implementations

Water Quality And Zooplankton Composition In Fishponds (Castanhal, Pará).

Viveiros de piscicultura como sistemas artificiais rasos sofrem influência externa e interna que vão atuar na comunidade planctônica e na qualidade da água. Neste sentido, o trabalho foi desenvolvido em seis viveiros e teve como objetivos: listar as espécies de zooplâncton, aplicar métodos quantitativos, calculando densidade, abundância relativa, riqueza, diversidade e equitabilidade entre os organismos registrados e avaliar a qualidade da água. Amostragens para determinação qualitativa e quantitativa do zooplâncton, além de análises de temperatura, oxigênio dissolvido, pH, condutividade elétrica e sólidos totais dissolvidos foram efetuadas. As médias de OD estiveram acima de 6,0 mg/l e o pH variou de básico a ligeiramente ácido. A condutividade variou de 8,5 a 25,3µS/cm. Foram identificados 80 taxa, sendo 60 de Rotifera, três de Protista e 17 de Artrhopoda. Em termos de densidade, a estação 06 se destacou, sendo Rotifera o grupo dominante, com pico em janeiro, 2.374,5org/l. Em termos de freqüência de ocorrência, as formas naupliares se destacaram entre os copepodes, Cyclestheria hislopi e Alona poppei entre os cladóceros e Keratella americana e Trichocerca pusilla entre os rotíferos. A estação 01 teve os maiores valores de diversidade e equitabilidade, demonstrando maior uniformidade de espécies. Neste estudo, as variáveis abióticas não variaram significativamente e estavam dentro da faixa recomendada para o cultivo, exceto a condutividade. A maior riqueza de espécies e dominância de rotíferos permitiu considerá-los como o grupo mais importante da Estação. Copépodos e cladóceros, por serem maiores, provavelmente estiveram mais sujeitos à predação visual por peixes.Fishponds as flat artificial systems suffer external and internal influence that go to act in the planktonic community and the factors physicist-chemistries of the water. In this direction, the paper was developed in six ponds and had as objective: to list the zooplanktonic species, to apply quantitative methods, calculating density, relative abundance, wealth, diversity and equitability between the registered organisms and to evaluate the water quality based on the parameters physicist-chemists. Samplings for qualitative and quantitative determination of zooplankton, beyond analyses of temperature, dissolved oxygen, pH, electric conductivity and dissolved total solids had been effected. The dissolved oxygen averages had been above of 6,0mg/l and pH varied of basic the slightly acid one. The conductivity varied of 8,5 the 25,3µS/cm. Had been identified 80 tax, being 60 of Rotifer, three of Protozoa and 17 of Artrhopoda. In density terms, station 06 if detached, being Rotifera the dominant group, with peak in january, 2374.5org/l. In terms of occurrence frequency, the naupliar forms if had detached among copepodes, Cyclestheria hislopi and Alona poppei between the cladocera and Keratella americana e Trichocerca pusilla between the rotifers. Station 01 had the biggest values of diversity and equitabilidity, demonstrating bigger uniformity of species. In this study, the abiotic variable had not varied significantly and were inside of the band recommended for the culture, except the conductivity. The biggest wealth of species and dominance of rotifers allowed to consider them as the group most important of the Station. Copepods and cladocers, for being bigger, had probably been citizens to the visual prerestitution for fish

NIME scores: a systematic review of how scores have shaped performance ecologies in NIME

This paper investigates how the concept of score has been used in the NIME community. To this end, we performed a systematic literature review of the NIME proceedings, analyzing papers in which scores play a central role. We analyzed the score not as an object per se but in relation to the users and the interactive system(s). In other words, we primarily looked at the role that scores play in the performance ecology. For this reason, to analyze the papers, we relied on ARCAA, a recent framework created to investigate artifact ecologies in computer music performances. Using the framework, we created a scheme for each paper and clustered the papers according to similarities. Our analysis produced five main categories that we present and discuss in relation to literature about musical scores