5,397 research outputs found
Gulliver project: performers and visitors
This paper discusses two projects in our research environment. The Gulliver
project, an ambitious project conceived by some artists connected to our
research efforts, and the Aveiro-project, as well ambitious, but with goals
that can be achieved beause of technological developments, rather than be
dependent on artistic and 'political' (read: financial) sources. Both projects
are on virtual and augmented reality. The main goal is to design inhabited
environments, where 'inhabited' refers to autonomous agents and agents that
represent humans, realtime or off-line, visiting the virtual environment and
interacting with other agents. The Gulliver environment has been designed by
two artists: Matjaz Stuk and Alena Hudcovicova. The Aveiro project is a research
effort of a group of researchers trying to design models of intelligence and
interaction underlying the behavior of (groups of) agents inhabiting virtual
worlds. In this paper we survey the current state of both projects and we
discuss current and future attempts to have music performances by virtual and
real performers in these environments
Towards virtual communities on the Web: Actors and audience
We report about ongoing research in a virtual
reality environment where visitors can interact with
agents that help them to obtain information, to perform
certain transactions and to collaborate with them in order
to get some tasks done. Our environment models a
theatre in our hometown. We discuss attempts to let this
environment evolve into a theatre community where we
do not only have goal-directed visitors, but also visitors
that that are not sure whether they want to buy or just
want information or visitors who just want to look
around. It is shown that we need a multi-user and multiagent
environment to realize our goals. Since our environment
models a theatre it is also interesting to investigate
the roles of performers and audience in this environment.
For that reason we discuss capabilities and personalities of agents. Some notes on the historical development of networked communities are included
A Human-Computer Duet System for Music Performance
Virtual musicians have become a remarkable phenomenon in the contemporary
multimedia arts. However, most of the virtual musicians nowadays have not been
endowed with abilities to create their own behaviors, or to perform music with
human musicians. In this paper, we firstly create a virtual violinist, who can
collaborate with a human pianist to perform chamber music automatically without
any intervention. The system incorporates the techniques from various fields,
including real-time music tracking, pose estimation, and body movement
generation. In our system, the virtual musician's behavior is generated based
on the given music audio alone, and such a system results in a low-cost,
efficient and scalable way to produce human and virtual musicians'
co-performance. The proposed system has been validated in public concerts.
Objective quality assessment approaches and possible ways to systematically
improve the system are also discussed
Towards a multi-layer architecture for multi-modal rendering of expressive actions
International audienceExpressive content has multiple facets that can be conveyed by music, gesture, actions. Different application scenarios can require different metaphors for expressiveness control. In order to meet the requirements for flexible representation, we propose a multi-layer architecture structured into three main levels of abstraction. At the top (user level) there is a semantic description, which is adapted to specific user requirements and conceptualization. At the other end are low-level features that describe parameters strictly related to the rendering model. In between these two extremes, we propose an intermediate layer that provides a description shared by the various high-level representations on one side, and that can be instantiated to the various low-level rendering models on the other side. In order to provide a common representation of different expressive semantics and different modalities, we propose a physically-inspired description specifically suited for expressive actions
Full Measures
“Full Measures” is a 3D Animated Short Film about a pianist’s struggle writing the music he desires before his deadline. With musical creatures taunting him, will he defeat his nightmares in time?
“Full Measures” has two meanings, it’s literally definition is “to perform a task as well as possible.” The second definition is a play on words meaning “Passages with heavily written music.” It’s a phrase I found through speaking with musician at the Eastman School of Music.
In life we all aspire to achieve what we want to create. Often the greatest obstacles are constructs in our minds. We must overcome these walls to accomplish the things we desire. It is the same with our pianist; this film attempts to represent his struggle through taking the audience through a fanciful journey inside his mind.
This thesis outlines the whole creation process of making this animation from concept to completion. It describes my intentions, obstacles, effort, and successes throughout this entire production
Sensing and mapping for interactive performance
This paper describes a trans-domain mapping (TDM) framework for translating meaningful activities from one creative domain onto another. The multi-disciplinary framework is designed to facilitate an intuitive and non-intrusive interactive multimedia performance interface that offers the users or performers real-time control of multimedia events using their physical movements. It is intended to be a highly dynamic real-time performance tool, sensing and tracking activities and changes, in order to provide interactive multimedia performances.
From a straightforward definition of the TDM framework, this paper reports several implementations and multi-disciplinary collaborative projects using the proposed framework, including a motion and colour-sensitive system, a sensor-based system for triggering musical events, and a distributed multimedia server for audio mapping of a real-time face tracker, and discusses different aspects of mapping strategies in their context.
Plausible future directions, developments and exploration with the proposed framework, including stage augmenta tion, virtual and augmented reality, which involve sensing and mapping of physical and non-physical changes onto multimedia control events, are discussed
Musical Behaviours: Algorithmic Composition Via Plug-ins
The author’s recent software research addresses a deficiency in commercial musical composition software: the limited ability to apply algorithmic processes to the practice of musical composition. The remedy takes the form of a software plug-in design called “musical behaviours” — compositional algorithms of limited scope that can be applied cumulatively and in real time to MIDI performance data. The software runs on the author’s software composition platform, The Transformation Engine
- …