328 research outputs found
Mobile Music Development Tools for Creative Coders
This project is a body of work that facilitates the creation of musical mobile artworks. The project includes a code toolkit that enhances and simplifies the development of mobile music iOS applications, a flexible notation system designed for mobile musical interactions, and example apps and scored compositions to demonstrate the toolkit and notation system.
The code library is designed to simplify the technical aspect of user-centered design and development with a more direct connection between concept and deliverable. This sim- plification addresses learning problems (such as motivation, self-efficacy, and self-perceived understanding) by bridging the gap between idea and functional prototype and improving the ability to contextualize the development process for musicians and other creatives. The toolkit helps to circumvent the need to learn complex iOS development patterns and affords more readable code.
CSPD (color, shape, pattern, density) notation is a pseudo-tablature that describes performance interactions. The system leverages visual density and patterns of both color and shape to describe types of gestures (physical or musical) and their relationships rather than focusing on strict rhythmic or pitch/frequency content. The primary design goal is to visualize macro musical concepts that create middleground structure
Models and Analysis of Vocal Emissions for Biomedical Applications
The International Workshop on Models and Analysis of Vocal Emissions for Biomedical Applications (MAVEBA) came into being in 1999 from the particularly felt need of sharing know-how, objectives and results between areas that until then seemed quite distinct such as bioengineering, medicine and singing. MAVEBA deals with all aspects concerning the study of the human voice with applications ranging from the newborn to the adult and elderly. Over the years the initial issues have grown and spread also in other fields of research such as occupational voice disorders, neurology, rehabilitation, image and video analysis. MAVEBA takes place every two years in Firenze, Italy. This edition celebrates twenty-two years of uninterrupted and successful research in the field of voice analysis
Proceedings of the 7th Sound and Music Computing Conference
Proceedings of the SMC2010 - 7th Sound and Music Computing Conference, July 21st - July 24th 2010
The development of corpus-based computer assisted composition program and its application for instrumental music composition
In the last 20 years, we have seen the nourishing environment for the development of
music software using a corpus of audio data expanding significantly, namely that synthesis
techniques producing electronic sounds, and supportive tools for creative activities
are the driving forces to the growth. Some software produces a sequence of sounds by
means of synthesizing a chunk of source audio data retrieved from an audio database
according to a rule. Since the matching of sources is processed according to their descriptive
features extracted by FFT analysis, the quality of the result is significantly
influenced by the outcomes of the Audio Analysis, Segmentation, and Decomposition.
Also, the synthesis process often requires a considerable amount of sample data and
this can become an obstacle to establish easy, inexpensive, and user-friendly applications
on various kinds of devices. Therefore, it is crucial to consider how to treat the
data and construct an efficient database for the synthesis. We aim to apply corpusbased
synthesis techniques to develop a Computer Assisted Composition program, and
to investigate the actual application of the program on ensemble pieces. The goal of
this research is to apply the program to the instrumental music composition, refine its
function, and search new avenues for innovative compositional method
Computational composition strategies in audiovisual laptop performance
We live in a cultural environment in which computer based musical performances have become ubiquitous. Particularly the use of laptops as instruments is a thriving practice in many genres and subcultures. The opportunity to command the most intricate level of control on the smallest of time scales in music composition and computer graphics introduces a number of complexities and dilemmas for the performer working with algorithms. Writing computer code to create audiovisuals offers abundant opportunities for discovering new ways of expression in live performance while simultaneously introducing challenges and presenting the user with difficult choices. There are a host of computational strategies that can be employed in live situations to assist the performer, including artificially intelligent performance agents who operate according to predefined algorithmic rules. This thesis describes four software systems for real time multimodal improvisation and composition in which a number of computational strategies for audiovisual laptop performances is explored and which were used in creation of a portfolio of accompanying audiovisual compositions
Collaborative Mobile-Learning Systems for Music Education and Training
Ph.DDOCTOR OF PHILOSOPH
Multi-Sensory Interaction for Blind and Visually Impaired People
This book conveyed the visual elements of artwork to the visually impaired through various sensory elements to open a new perspective for appreciating visual artwork. In addition, the technique of expressing a color code by integrating patterns, temperatures, scents, music, and vibrations was explored, and future research topics were presented. A holistic experience using multi-sensory interaction acquired by people with visual impairment was provided to convey the meaning and contents of the work through rich multi-sensory appreciation. A method that allows people with visual impairments to engage in artwork using a variety of senses, including touch, temperature, tactile pattern, and sound, helps them to appreciate artwork at a deeper level than can be achieved with hearing or touch alone. The development of such art appreciation aids for the visually impaired will ultimately improve their cultural enjoyment and strengthen their access to culture and the arts. The development of this new concept aids ultimately expands opportunities for the non-visually impaired as well as the visually impaired to enjoy works of art and breaks down the boundaries between the disabled and the non-disabled in the field of culture and arts through continuous efforts to enhance accessibility. In addition, the developed multi-sensory expression and delivery tool can be used as an educational tool to increase product and artwork accessibility and usability through multi-modal interaction. Training the multi-sensory experiences introduced in this book may lead to more vivid visual imageries or seeing with the mind’s eye
Sound based social networks
The sound environment is an eco of the activity and character of each
place, often carrying additional information to that made available to the eyes
(both new and redundant). It is, therefore, an intangible and volatile acoustic
fingerprint of the place, or simply an acoustic snapshot of a single event. Such
rich resource, full of meaning and subtleness, Schaeffer called Soundscape.
The exploratory research project presented here addresses the Soundscape
in the context of Mobile Online Social Networking, aiming at determining the
extent of its applicability regarding the establishment and/or strengthening of
new and existing social links. Such research goal demanded an interdisciplinary
approach, which we have anchored in three main stems: Soundscapes,
Mobile Sound and Social Networking. These three areas pave the scientific
ground for this study and are introduced during the first part of the thesis. An
extensive survey of the state-of-the-arte projects related with this research is
also presented, gathering examples from different but adjacent areas such as
mobile sensing, wearable computing, sonification, social media and contextaware
computing. This survey validates that our approach is scientifically opportune
and unique, at the same time.
Furthermore, in order to assess the role of Soundscapes in the context
of Social Networking, an experimental procedure has been implemented
based on an Online Social Networking mobile application, enriched with environmental
sensing mechanisms, able to capture and analyze the surrounding
Soundscape and users' movements. Two main goals guided this prototypal
research tool: collecting data regarding users' activity (both sonic and kinetic)
and providing users with a real experience using a Sound-Based Social Network,
in order to collect informed opinions about this unique type of Social
Networking. The application – Hurly-Burly – senses the surrounding Soundscape
and analyzes it using machine audition techniques, classifying it according
to four categories: speech, music, environmental sounds and silence. Additionally, it determines the sound pressure level of the sensed Soundscape
in dB(A)eq. This information is then broadcasted to the entire online social
network of the user, allowing each element to visualize and audition a representation
of the collected data. An individual record for each user is kept
available in a webserver and can be accessed through an online application,
displaying the continuous acoustic profile of each user along a timeline graph.
The experimental procedure included three different test groups, forming each
one a social network with a cluster coefficient equal to one.
After the implementation and result analysis stages we concluded that
Soundscapes can have a role in the Online Social Networking paradigm, specially
when concerning mobile applications. Has been proven that current offthe-
shelf mobile technology is a promising opportunity for accomplishing this
kind of tasks (such as continuous monitoring, life logging and environment
sensing) but battery limitations and multitasking's constraints are still the bottleneck,
hindering the massification of successful applications. Additionally,
online privacy is something that users are not enthusiastic in letting go: using
captured sound instead of representations of the sound would abstain users
from utilizing such applications. We also demonstrated that users who are
more aware of the Soundscape concept are also more inclined to assume it
as playing an important role in OSN. This means that more pedagogy towards
the acoustic phenomenon is needed and this type of research gives a step
further in that direction.O ambiente sonoro de um lugar é um eco da sua atividade e carácter,
transportando, na maior parte da vezes, informação adicional àquela que é
proporcionada à visão (quer seja redundante ou complementar). É, portanto,
uma impressão digital acústica - tangível e volátil - do lugar a que pertence,
ou simplesmente uma fotografia acústica de um evento pontual. A este opulento
recurso, carregado de significados e subtilezas, Schafer chamou de
Paisagem-Sonora. O projeto de investigação de carácter exploratório que
aqui apresentamos visa o estudo da Paisagem-Sonora no contexto das Redes
Sociais Móveis Em-Linha, procurando entender os moldes e limites da
sua aplicação, tendo em vista o estabelecimento e/ou reforço de novos ou
existente laços sociais, respectivamente. Para satisfazer este objectivo foi
necessária uma abordagem multidisciplinar, ancorada em três pilares principais:
a Paisagem-Sonora, o Som Móvel e as Redes Sociais. Estas três áreas
determinaram a moldura científica de referência em que se enquadrou esta
investigação, sendo explanadas na primeira parte da tese. Um extenso levantamento
do estado-da-arte referente a projetos relacionados com este estudo
é também apresentado, compilando exemplos de áreas distintas mas adjacentes,
tais como: Computação Sensorial Móvel, Computação Vestível, Sonificação,
Média Social e Computação Contexto-Dependente. Este levantamento
veio confirmar quer a originalidade quer a pertinência científica do projeto
apresentado.
Posteriormente, a fim de avaliar o papel da Paisagem-Sonora no contexto
das Redes Sociais, foi posto em prática um procedimento experimental
baseado numa Rede Social Sonora Em-Linha, desenvolvida de raiz para dispositivos
móveis e acrescida de mecanismos sensoriais para estímulos ambientais,
capazes de analisar a Paisagem-Sonora envolvente e os movimentos
do utilizador. Dois objectivos principais guiaram a produção desta ferramenta
de investigação: recolher dados relativos à atividade cinética e sonora dos utilizadores e proporcionar a estes uma experiência real de utilização
uma Rede Social Sonora, de modo a recolher opiniões fundamentadas sobre
esta tipologia específica de socialização. A aplicação – Hurly-Burly – analisa
a Paisagem-Sonora através de algoritmos de Audição Computacional, classificando-
a de acordo com quatro categorias: diálogo (voz), música, sons ambientais
(“ruídos”) e silêncio. Adicionalmente, determina o seu nível de pressão
sonora em dB(A)eq. Esta informação é então distribuída pela rede social
dos utilizadores, permitindo a cada elemento visualizar e ouvir uma representação
do som analisado. É mantido num servidor Web um registo individual
da informação sonora e cinética captada, o qual pode ser acedido através de
uma aplicação Web que mostra o perfil sonoro de cada utilizador ao longo do
tempo, numa visualização ao estilo linha-temporal. O procedimento experimental
incluiu três grupos de teste distintos, formando cada um a sua própria
rede social com coeficiente de aglomeração igual a um. Após a implementação
da experiência e análise de resultados, concluímos que a Paisagem-
Sonora pode desempenhar um papel no paradigma das Redes Sociais Em-
Linha, em particular no que diz respeito à sua presença nos dispositivos móveis.
Ficou provado que os dispositivos móveis comerciais da atualidade
apresentam-se com uma oportunidade promissora para desempenhar este
tipo de tarefas (tais como: monitorização contínua, registo quotidiano e análise
sensorial ambiental), mas as limitações relacionadas com a autonomia
energética e funcionamento em multitarefa representam ainda um constrangimento
que impede a sua massificação. Além disso, a privacidade no mundo
virtual é algo que os utilizadores atuais não estão dispostos a abdicar: partilhar
continuamente a Paisagem-Sonora real em detrimento de uma representação
de alto nível é algo que refrearia os utilizadores de usar a aplicação.
Também demonstrámos que os utilizadores que mais conhecedores do fenómeno
da Paisagem-Sonora são também os que consideram esta como importante
no contexto das Redes Sociais Em-Linha. Isso significa que uma atitude
pedagógica em relação ao fenómeno sonoro é essencial para obter dele
o maior ganho possível. Esta investigação propõe-se a dar um passo em
frente nessa direção
- …