Semantic framework for interactive animation generation and its application in virtual shadow play performance.

Designing and creating complex and interactive animation is still a challenge in the field of virtual reality, which has to handle various aspects of functional requirements (e.g. graphics, physics, AI, multimodal inputs and outputs, and massive data assets management). In this paper, a semantic framework is proposed to model the construction of interactive animation and promote animation assets reuse in a systematic and standardized way. As its ontological implementation, two domain specific ontologies for the hand-gesture-based interaction and animation data repository have been developed in the context of Chinese traditional shadow play art. Finally, prototype of interactive Chinese shadow play performance system using deep motion sensor device is presented as the usage example

An Analysis of How Interactive Technology Supports the Appreciation of Traditional Chinese Puppetry: A Review of Case Studies

From the perspective of safeguarding Chinese Cultural Heritage, this paper discusses how to enhance the appreciation of traditional Chinese puppetry through the support of interactive technology. The author analyses extensive, yet current case studies, based on the findings described in the interactive systems for puppetry performances and interactive technology for puppetry appreciation. The author summarises four aspects of how to enhance the appreciation of, and engagement with, traditional Chinese puppetry: (1) maintaining originality is necessary for the design phase; (2) it is crucial to explore how to use interactive technology in order to design a way for adults to appreciate this form of art; (3) it is also necessary to determine ways to support adult audiences in grasping the cultural significance and folk customs of traditional Chinese puppetry; and (4) the study’s further main research goals are to investigate ways to use emotional expressions, digital storytelling and other methods in conjunction with interactive technology to help multi-cultural users comprehend traditional Chinese puppetry

Supporting the Cross-cultural Appreciation of Traditional Chinese Puppetry Through a Digital Gesture Library

In recent years, digital cultural heritage has attracted much attention in the HCI domain, but there are currently few studies that focus on enhancing the appreciation of intangible cultural heritage content amongst cross-cultural audiences. This article reports on the development of a Digital Gesture Library to support cross-cultural appreciation of traditional Chinese puppetry. We describe fieldwork with professional puppeteers to understand their practices and art form, which informed the development of the Digital Gesture Library, which uses a three-perspective archive of puppetry gestures and a tangible interface to support cross-cultural audiences’ appreciation of puppetry and encourages further exploration of Chinese culture. We present findings on the efficacy of the Digital Gesture Library from qualitative and quantitative user studies and, from this, discuss the opportunities and challenges for developing digital technology for cross-cultural appreciation of intangible heritage

The Shadow Mirror

The shadow mirror project is an interactive art installation which mimics user motions and displays them in the form of a a puppet\u27s shadow. In order to accomplish the shadow effect, a motion capture solution is needed alongside a puppet with a controllable motion system and lighting effects. This piece is open to a wide range of audiences both age-wide and culture-wide, allowing us to achieve our goal of bringing forth a universal bond and introducing a new way of interaction through the blending of technology and art

Exploring expressive augmented reality: The fing AR puppet system for social pretend play

We present “FingAR Puppet”, an Augmented Reality (AR) system enhancing social pretend play by young children. Un-like goal-oriented AR systems that augment reality with in-formative instructions, FingAR Puppet helps children asso-ciate expressive interpretations with immediate reality. Em-pirical results show that FingAR Puppet promotes reasoning about emotional states, communication and divergent think-ing during social pretend play for children 4-6 years old. We suggest that this study opens an interesting space for future AR systems to support complex cognitive and social devel-opment in early childhood. We also identify broader implica-tions from using theories of cognitive development to guide the design of tangible and augmented interactions

DIGITAL CAPITAL AS INFORMAL SOCIAL PROTECTION IN THE PANDEMIC COVID-19S ERA (CASE STUDY OF THE WAYANG KULIT ASSOCIATION IN YOGYAKARTA)

This article explains digital capital in the wayang kulit (Javanese traditional shadow puppet) association in Yogyakarta during the Covid-19 pandemic era and how its digital capital can protect and serve as informal social protection for the wayang kulit artists association in Yogyakarta in the difficult time. Following the case study method is to investigate WL (Ki SN) association, the group of wayang kulit GP (Ki CB) and SK (Ki GS). The three associations were chosen because they can survive in the middle of the pandemic by holding wayang kulit performances virtually using existing social capital and digital capital. Based on the research results show during the Covid-19 pandemic, digital capital is more effective in providing social protection for group or associations of wayang kulit in Yogyakarta than the traditional social capital scene. The higher the digital capital has seen from the virtual social network (subscriber and viewer or virtual audience), norms of reciprocity, and trust existing with external parties to increase the virtual shows, therefore it can meet the economic needs and welfare of every member in the group and association for facing the pandemic. This research offers a new alternative framework related to digital capital as a informal social protection form. Meanwhile, the practical result is as references for wayang kulit artists to survive in the uncertainty of pandemic and adapt to the challenges of technological digitalization. In addition, it can suggest for the government in formulating rules and an effective model of social protection policy for wayang kulit performances, shadow puppet artists, and in general other artist who rely on art performance as their livelihoods.