An augmented haptic interface as applied to flow visualization

A novel 3D computer interface is proposed in which a physical handle containing force sensors and capable of simulating virtual touch through force feedback is coupled to a variety of virtual tools in a 3D virtual environment. The visual appearance of each tool reflects its capabilities. At one moment a user might feel they are holding a virtual grabber, activated by squeezing, and at another moment they are holding a virtual turntable activated by physical motion of a virtual wheel. In this way it is intended that form and function can be combined so that users rapidly learn the functional capabilities of the tools and retain this learning. It is also intended that the tools be easy to use because of intuitive mappings of forces to actions. A virtual environment is constructed to test this concept, and an evaluation of the interface conducted

PENERAPAN TEKNOLOGI NATURAL USER INTERACE (NUI) SEBAGAI STRATEGI PEMBELAJARAN TERHADAP RETENSI BELAJAR

This study explains the use of the Natural User Interface (NUI) on retention of learning. The combination of multimedia and virtual reality is called immersive multimedia. Immersive multimedia is the reality of computer simulations that replicate the environment resulting in user interaction. Immersive multimedia technology is applied to natural user interface (NUI). Natural user interface (NUI) has great potential to facilitate new ways of computer-based learning. The result of instructional media development in this research is an interactive learning media that allows learners to display presentation content and manipulate presentation content directly so as to stimulate visual which improves learning retention. Key Word: Natural User Interface (NUI), Educational, Retention, Immersive Multimedia, Interactive Learnin

Multicolour sketch recognition in a learning environment.

Virtual physics environments are becoming increasingly popular as a teaching tool for grade and high school level mechanical physics. While useful, these tools often offer a complex user interface, lacking the intuitive nature of the traditional whiteboard. Furthermore, the systems are often too advanced to be used by novices for further experimentation. In this paper we describe a physics learning environment using multicolour sketch recognition techniques on digital whiteboards. We argue that the use of coloured pens helps to resolve several ambiguities appearing in single colour sketching interfaces. The recognition system is based on a combination of Support Vector Machines and rule based methods. The system was evaluated using a constructive interaction method, with users completing a set task

Learning Depth Vision-Based Personalized Robot Navigation From Dynamic Demonstrations in Virtual Reality

For the best human-robot interaction experience, the robot's navigation policy should take into account personal preferences of the user. In this paper, we present a learning framework complemented by a perception pipeline to train a depth vision-based, personalized navigation controller from user demonstrations. Our refined virtual reality interface enables the demonstration of robot navigation trajectories under motion of the user for dynamic interaction scenarios. In a detailed analysis, we evaluate different configurations of the perception pipeline. As the experiments demonstrate, our new pipeline compresses the perceived depth images to a latent state representation and, thus, enables efficient reasoning about the robot's dynamic environment to the learning. We discuss the robot's navigation performance in various virtual scenes by enrolling a variational autoencoder in combination with a motion predictor and demonstrate the first personalized robot navigation controller that solely relies on depth images

Natural User Interface for Education in Virtual Environments

Education and self-improvement are key features of human behavior. However, learning in the physical world is not always desirable or achievable. That is how simulators came to be. There are domains where purely virtual simulators can be created in contrast to physical ones. In this research we present a novel environment for learning, using a natural user interface. We, humans, are not designed to operate and manipulate objects via keyboard, mouse or a controller. The natural way of interaction and communication is achieved through our actuators (hands and feet) and our sensors (hearing, vision, touch, smell and taste). That is the reason why it makes more sense to use sensors that can track our skeletal movements, are able to estimate our pose, and interpret our gestures. After acquiring and processing the desired – natural input, a system can analyze and translate those gestures into movement signals