1,617 research outputs found
Collection of Design Directions for the Realization of a Visual Interface with Haptic Feedback to Convey the Notion of Sonic Grain to DHH Students
This paper presents the results of a survey campaign aimed at distilling design directions for the realization of a visual interface with haptic feedback. The scope of the interface is to ease the conveyance of the concept of "sonic grain" to deaf and hard of hearing music students. Results from the questionnaire were leveraged for the realization of a prototype which exploits cross-modal associations among images, colors, sounds and textures to render different types of sonic grains and offer a multisensorial perceptual experience to the users. Such prototype represents a promising starting point for further investigation on how to jointly exploit visual, auditory and haptic feedback to support more inclusive pedagogical approaches to music teaching
The listening talker: A review of human and algorithmic context-induced modifications of speech
International audienceSpeech output technology is finding widespread application, including in scenarios where intelligibility might be compromised - at least for some listeners - by adverse conditions. Unlike most current algorithms, talkers continually adapt their speech patterns as a response to the immediate context of spoken communication, where the type of interlocutor and the environment are the dominant situational factors influencing speech production. Observations of talker behaviour can motivate the design of more robust speech output algorithms. Starting with a listener-oriented categorisation of possible goals for speech modification, this review article summarises the extensive set of behavioural findings related to human speech modification, identifies which factors appear to be beneficial, and goes on to examine previous computational attempts to improve intelligibility in noise. The review concludes by tabulating 46 speech modifications, many of which have yet to be perceptually or algorithmically evaluated. Consequently, the review provides a roadmap for future work in improving the robustness of speech output
Pervasive Technologies and Support for Independent Living
A broad range of pervasive technologies are used in many domains, including healthcare: however, there appears to be little work examining the role of such technologies in the home, or the different wants and needs of elderly users. Additionally, there exist ethical issues surrounding the use of highly personal healthcare-related data, and interface issues centred on the novelty of the technologies and the disabilities experienced by the users. This report examines these areas, before considering the ways in which they might come together to help support independent-living users with disabilities which may be age-related
Practical, appropriate, empirically-validated guidelines for designing educational games
There has recently been a great deal of interest in the
potential of computer games to function as innovative
educational tools. However, there is very little evidence of
games fulfilling that potential. Indeed, the process of
merging the disparate goals of education and games design
appears problematic, and there are currently no practical
guidelines for how to do so in a coherent manner. In this
paper, we describe the successful, empirically validated
teaching methods developed by behavioural psychologists
and point out how they are uniquely suited to take
advantage of the benefits that games offer to education. We
conclude by proposing some practical steps for designing
educational games, based on the techniques of Applied
Behaviour Analysis. It is intended that this paper can both
focus educational games designers on the features of games
that are genuinely useful for education, and also introduce a
successful form of teaching that this audience may not yet
be familiar with
Sound based social networks
The sound environment is an eco of the activity and character of each
place, often carrying additional information to that made available to the eyes
(both new and redundant). It is, therefore, an intangible and volatile acoustic
fingerprint of the place, or simply an acoustic snapshot of a single event. Such
rich resource, full of meaning and subtleness, Schaeffer called Soundscape.
The exploratory research project presented here addresses the Soundscape
in the context of Mobile Online Social Networking, aiming at determining the
extent of its applicability regarding the establishment and/or strengthening of
new and existing social links. Such research goal demanded an interdisciplinary
approach, which we have anchored in three main stems: Soundscapes,
Mobile Sound and Social Networking. These three areas pave the scientific
ground for this study and are introduced during the first part of the thesis. An
extensive survey of the state-of-the-arte projects related with this research is
also presented, gathering examples from different but adjacent areas such as
mobile sensing, wearable computing, sonification, social media and contextaware
computing. This survey validates that our approach is scientifically opportune
and unique, at the same time.
Furthermore, in order to assess the role of Soundscapes in the context
of Social Networking, an experimental procedure has been implemented
based on an Online Social Networking mobile application, enriched with environmental
sensing mechanisms, able to capture and analyze the surrounding
Soundscape and users' movements. Two main goals guided this prototypal
research tool: collecting data regarding users' activity (both sonic and kinetic)
and providing users with a real experience using a Sound-Based Social Network,
in order to collect informed opinions about this unique type of Social
Networking. The application – Hurly-Burly – senses the surrounding Soundscape
and analyzes it using machine audition techniques, classifying it according
to four categories: speech, music, environmental sounds and silence. Additionally, it determines the sound pressure level of the sensed Soundscape
in dB(A)eq. This information is then broadcasted to the entire online social
network of the user, allowing each element to visualize and audition a representation
of the collected data. An individual record for each user is kept
available in a webserver and can be accessed through an online application,
displaying the continuous acoustic profile of each user along a timeline graph.
The experimental procedure included three different test groups, forming each
one a social network with a cluster coefficient equal to one.
After the implementation and result analysis stages we concluded that
Soundscapes can have a role in the Online Social Networking paradigm, specially
when concerning mobile applications. Has been proven that current offthe-
shelf mobile technology is a promising opportunity for accomplishing this
kind of tasks (such as continuous monitoring, life logging and environment
sensing) but battery limitations and multitasking's constraints are still the bottleneck,
hindering the massification of successful applications. Additionally,
online privacy is something that users are not enthusiastic in letting go: using
captured sound instead of representations of the sound would abstain users
from utilizing such applications. We also demonstrated that users who are
more aware of the Soundscape concept are also more inclined to assume it
as playing an important role in OSN. This means that more pedagogy towards
the acoustic phenomenon is needed and this type of research gives a step
further in that direction.O ambiente sonoro de um lugar é um eco da sua atividade e carácter,
transportando, na maior parte da vezes, informação adicional àquela que é
proporcionada à visão (quer seja redundante ou complementar). É, portanto,
uma impressão digital acústica - tangível e volátil - do lugar a que pertence,
ou simplesmente uma fotografia acústica de um evento pontual. A este opulento
recurso, carregado de significados e subtilezas, Schafer chamou de
Paisagem-Sonora. O projeto de investigação de carácter exploratório que
aqui apresentamos visa o estudo da Paisagem-Sonora no contexto das Redes
Sociais Móveis Em-Linha, procurando entender os moldes e limites da
sua aplicação, tendo em vista o estabelecimento e/ou reforço de novos ou
existente laços sociais, respectivamente. Para satisfazer este objectivo foi
necessária uma abordagem multidisciplinar, ancorada em três pilares principais:
a Paisagem-Sonora, o Som Móvel e as Redes Sociais. Estas três áreas
determinaram a moldura científica de referência em que se enquadrou esta
investigação, sendo explanadas na primeira parte da tese. Um extenso levantamento
do estado-da-arte referente a projetos relacionados com este estudo
é também apresentado, compilando exemplos de áreas distintas mas adjacentes,
tais como: Computação Sensorial Móvel, Computação Vestível, Sonificação,
Média Social e Computação Contexto-Dependente. Este levantamento
veio confirmar quer a originalidade quer a pertinência científica do projeto
apresentado.
Posteriormente, a fim de avaliar o papel da Paisagem-Sonora no contexto
das Redes Sociais, foi posto em prática um procedimento experimental
baseado numa Rede Social Sonora Em-Linha, desenvolvida de raiz para dispositivos
móveis e acrescida de mecanismos sensoriais para estímulos ambientais,
capazes de analisar a Paisagem-Sonora envolvente e os movimentos
do utilizador. Dois objectivos principais guiaram a produção desta ferramenta
de investigação: recolher dados relativos à atividade cinética e sonora dos utilizadores e proporcionar a estes uma experiência real de utilização
uma Rede Social Sonora, de modo a recolher opiniões fundamentadas sobre
esta tipologia específica de socialização. A aplicação – Hurly-Burly – analisa
a Paisagem-Sonora através de algoritmos de Audição Computacional, classificando-
a de acordo com quatro categorias: diálogo (voz), música, sons ambientais
(“ruídos”) e silêncio. Adicionalmente, determina o seu nível de pressão
sonora em dB(A)eq. Esta informação é então distribuída pela rede social
dos utilizadores, permitindo a cada elemento visualizar e ouvir uma representação
do som analisado. É mantido num servidor Web um registo individual
da informação sonora e cinética captada, o qual pode ser acedido através de
uma aplicação Web que mostra o perfil sonoro de cada utilizador ao longo do
tempo, numa visualização ao estilo linha-temporal. O procedimento experimental
incluiu três grupos de teste distintos, formando cada um a sua própria
rede social com coeficiente de aglomeração igual a um. Após a implementação
da experiência e análise de resultados, concluímos que a Paisagem-
Sonora pode desempenhar um papel no paradigma das Redes Sociais Em-
Linha, em particular no que diz respeito à sua presença nos dispositivos móveis.
Ficou provado que os dispositivos móveis comerciais da atualidade
apresentam-se com uma oportunidade promissora para desempenhar este
tipo de tarefas (tais como: monitorização contínua, registo quotidiano e análise
sensorial ambiental), mas as limitações relacionadas com a autonomia
energética e funcionamento em multitarefa representam ainda um constrangimento
que impede a sua massificação. Além disso, a privacidade no mundo
virtual é algo que os utilizadores atuais não estão dispostos a abdicar: partilhar
continuamente a Paisagem-Sonora real em detrimento de uma representação
de alto nível é algo que refrearia os utilizadores de usar a aplicação.
Também demonstrámos que os utilizadores que mais conhecedores do fenómeno
da Paisagem-Sonora são também os que consideram esta como importante
no contexto das Redes Sociais Em-Linha. Isso significa que uma atitude
pedagógica em relação ao fenómeno sonoro é essencial para obter dele
o maior ganho possível. Esta investigação propõe-se a dar um passo em
frente nessa direção
- …