Face modeling and animation language for MPEG-4 XMT framework

This paper proposes FML, an XML-based face modeling and animation language. FML provides a structured content description method for multimedia presentations based on face animation. The language can be used as direct input to compatible players, or be compiled within MPEG-4 XMT framework to create MPEG-4 presentations. The language allows parallel and sequential action description, decision-making and dynamic event-based scenarios, model configuration, and behavioral template definition. Facial actions include talking, expressions, head movements, and low-level MPEG-4 FAPs. The ShowFace and iFACE animation frameworks are also reviewed as example FML-based animation systems

Coarticulation and speech synchronization in MPEG-4 based facial animation

In this paper, we present a novel coarticulation and speech synchronization framework compliant with MPEG-4 facial animation. The system we have developed uses MPEG-4 facial animation standard and other development to enable the creation, editing and playback of high resolution 3D models; MPEG-4 animation streams; and is compatible with well-known related systems such as Greta and Xface. It supports text-to-speech for dynamic speech synchronization. The framework enables real-time model simplification using quadric-based surfaces. Our coarticulation approach provides realistic and high performance lip-sync animation, based on Cohen-Massaro’s model of coarticulation adapted to MPEG-4 facial animation (FA) specification. The preliminary experiments show that the coarticulation technique we have developed gives overall good and promising results when compared to related techniques

Elckerlyc in practice - on the integration of a BML Realizer in real applications

Building a complete virtual human application from scratch is a daunting task, and it makes sense to rely on existing platforms for behavior generation. When building such an interactive application, one needs to be able to adapt and extend the capabilities of the virtual human offered by the platform, without having to make invasive modications to the platform itself. This paper describes how Elckerlyc, a novel platform for controlling a virtual human, offers these possibilities

Low velocity impact response of rc beam with artificial polyethylene aggregate as concrete block infill

In structural design, an ideal situation for saving materials would be to reduce the weight of the structure without having to compromise on its strength and serviceability. A new lightweight composite reinforced concrete section was developed with a novel use of a lightweight concrete block as infill utilizing Artificial Polyethylene Aggregate (APEA and MAPEA). The concrete near the neutral axis acts as a stress transfer medium between the compression and tension zones. Partial replacement of the concrete near the neutral axis could create a reduction in weight and savings in the use of materials. In this experimental work, APEA and MAPEA were utilized as replacement for normal aggregates (NA) at percentages of 0%, 3%, 6%, and 9%, 12%, and 100% in the concrete mix. In this study, the concrete block infill uses the 100% MAPEA as a replacement for coarse aggregate. A total of sixteen beams were prepared measuring 170 mm × 250 mm × 1000 mm, in which four specimens were used as control samples (NRC) and twelve specimens were the reinforced concrete beam incorporated with different size of concrete block infill (RCAI) consisting of 100% MAPEA. All beams were tested with 100 kg steel weight dropped vertically from a height of 0.6 m and 1.54 m, which was equivalent to 3.5 m/s and 5.5 m/s respectively. Based on the experimental results, the impact force, displacement and crack patterns were affected by the impact load. For RCAI specimens, the impact force was larger but smaller displacement value was observed, compared to the NRC specimens. Furthermore, the width of the cracks generated in the RCAI specimens near the mid-span was less than that on the NRC specimen. All experiment results were validated against FEM. The transient impact force histories, displacement and crack patterns obtained from FEM matched reasonably well with the experiment results. The error reported a range of 1% to 15%. The results showed that the proposed use of concrete block infill produced desirable results under the impact loads. The main advantages of the concrete block infill that utilized MAPEA from waste plastic bags due to the weight reduction about 6% in the concrete beams

Improvement of speed response in four-phase DC–DC converter switching using two shunt voltage-source

This study proposes a technique that is able to improve the speed response of a four-phase DC–DC converter switching. The basic concept of the proposed technique is the inclusion of two shunt-connected voltage sources in series to the converter system. Using a higher input voltage to drive the load, a higher current per microsecond output system will be obtained and reverts to its nominal input upon obtaining desired references. Thus, the transient response observed when using this proposed technique is found to be much faster when compared to the conventional converter. Moreover, this technique is easily implemented as it requires only an additional voltage source, power switch, and power diode. The integrated model of the two shunt voltage-source in a four-phase DC–DC converter was simulated in MATLAB/Simulink and validated against the experimental results of a laboratory prototype, 600 W four-phase DC–DC converter. The novelty of this proposed technique is its ability to provide faster operations for critical loads applications, lower output capacitor and lower operating frequency

Artimate: an articulatory animation framework for audiovisual speech synthesis

We present a modular framework for articulatory animation synthesis using speech motion capture data obtained with electromagnetic articulography (EMA). Adapting a skeletal animation approach, the articulatory motion data is applied to a three-dimensional (3D) model of the vocal tract, creating a portable resource that can be integrated in an audiovisual (AV) speech synthesis platform to provide realistic animation of the tongue and teeth for a virtual character. The framework also provides an interface to articulatory animation synthesis, as well as an example application to illustrate its use with a 3D game engine. We rely on cross-platform, open-source software and open standards to provide a lightweight, accessible, and portable workflow.Comment: Workshop on Innovation and Applications in Speech Technology (2012

A framework for realistic 3D tele-immersion

Meeting, socializing and conversing online with a group of people using teleconferencing systems is still quite differ- ent from the experience of meeting face to face. We are abruptly aware that we are online and that the people we are engaging with are not in close proximity. Analogous to how talking on the telephone does not replicate the experi- ence of talking in person. Several causes for these differences have been identified and we propose inspiring and innova- tive solutions to these hurdles in attempt to provide a more realistic, believable and engaging online conversational expe- rience. We present the distributed and scalable framework REVERIE that provides a balanced mix of these solutions. Applications build on top of the REVERIE framework will be able to provide interactive, immersive, photo-realistic ex- periences to a multitude of users that for them will feel much more similar to having face to face meetings than the expe- rience offered by conventional teleconferencing systems

Towards a Unified Knowledge-Based Approach to Modality Choice

This paper advances a unified knowledge-based approach to the process of choosing the most appropriate modality or combination of modalities in multimodal output generation. We propose a Modality Ontology (MO) that models the knowledge needed to support the two most fundamental processes determining modality choice – modality allocation (choosing the modality or set of modalities that can best support a particular type of information) and modality combination (selecting an optimal final combination of modalities). In the proposed ontology we model the main levels which collectively determine the characteristics of each modality and the specific relationships between different modalities that are important for multi-modal meaning making. This ontology aims to support the automatic selection of modalities and combinations of modalities that are suitable to convey the meaning of the intended message

Survey on Multimedia Technologies for Mobile Learning Applications

Mobile technologies are developing very fast. This paper presents a survey on multimedia technologies for mobile learning applications, focusing on multimedia programming techniques for Windows Mobile, Symbian, and Java ME.multimedia, mobile devices, mobile applications, mobile learning