Full Body Interaction beyond Fun: Engaging Museum Visitors in Human-Data Interaction

Engaging museum visitors in data exploration using full-body interaction is still a challenge. In this paper, we explore four strategies for providing entry-points to the interaction: instrumenting the floor; forcing collaboration; implementing multiple body movements to control the same effect; and, visualizing the visitors' silhouette beside the data visualization. We discuss preliminary results of an in-situ study with 56 museum visitors at Discovery Place, and provide design recommendations for crafting engaging Human-Data Interaction experiences

MIFTel: a multimodal interactive framework based on temporal logic rules

Human-computer and multimodal interaction are increasingly used in everyday life. Machines are able to get more from the surrounding world, assisting humans in different application areas. In this context, the correct processing and management of signals provided by the environments is determinant for structuring the data. Different sources and acquisition times can be exploited for improving recognition results. On the basis of these assumptions, we are proposing a multimodal system that exploits Allen’s temporal logic combined with a prevision method. The main object is to correlate user’s events with system’s reactions. After post-elaborating coming data from different signal sources (RGB images, depth maps, sounds, proximity sensors, etc.), the system is managing the correlations between recognition/detection results and events in real-time to create an interactive environment for the user. For increasing the recognition reliability, a predictive model is also associated with the proposed method. The modularity of the system grants a full dynamic development and upgrade with custom modules. Finally, a comparison with other similar systems is shown, underlining the high flexibility and robustness of the proposed event management method

Proceedings of the 10th international conference on disability, virtual reality and associated technologies (ICDVRAT 2014)

The proceedings of the conferenc