Attentive Learning of Sequential Handwriting Movements: A Neural Network Model

Defense Advanced research Projects Agency and the Office of Naval Research (N00014-95-1-0409, N00014-92-J-1309); National Science Foundation (IRI-97-20333); National Institutes of Health (I-R29-DC02952-01)

SpaceWalk

We introduce SpaceWalk, an experimental approach to allow a person to move around a small room while wearing a Head Mounted Display. The goal is to get immersed users in everyday settings out of their seats and naturally experiencing movement within the simulation. SpaceWalk integrates a wireless solution around commodity equipment and requires no calibration by the user. This allows a low encumbrance full-body immersion in virtual reality while walking around living-room sized real-world spaces. The platform combines a commodity Head Mounted Display (Oculus Rift), with a depth-based camera (Kinect2) capturing movement of body and limbs within the space. A tablet computer, carried in a backpack, runs commodity VR software (Unity) with our own extensions that integrate the components. A brief survey of the literature demonstrates a gap in that other systems do neither allow a person's body to be routinely tracked without calibration, or movement around the space without the encumbrance of wires. The proposed full body immersive virtual reality platform opens the door to Virtual Reality in small environments, such as people's homes, that is compelling, easy to setup and use. After half a century, VR is coming of age, yet routine and unencumbered movement still needs to be achieved. This paper offers a method for doing so. Its contribution is to make Virtual Reality accessible to a wider group of users who do not have access to a professional virtual reality facility. In doing so it may help to unlock new paradigms for work, learning and entertainment