Interactive natural user interfaces

For many years, science fiction entertainment has showcased holographic technology and futuristic user interfaces that have stimulated the world\u27s imagination. Movies such as Star Wars and Minority Report portray characters interacting with free-floating 3D displays and manipulating virtual objects as though they were tangible. While these futuristic concepts are intriguing, it\u27s difficult to locate a commercial, interactive holographic video solution in an everyday electronics store. As used in this work, it should be noted that the term holography refers to artificially created, free-floating objects whereas the traditional term refers to the recording and reconstruction of 3D image data from 2D mediums. This research addresses the need for a feasible technological solution that allows users to work with projected, interactive and touch-sensitive 3D virtual environments. This research will aim to construct an interactive holographic user interface system by consolidating existing commodity hardware and interaction algorithms. In addition, this work studies the best design practices for human-centric factors related to 3D user interfaces. The problem of 3D user interfaces has been well-researched. When portrayed in science fiction, futuristic user interfaces usually consist of a holographic display, interaction controls and feedback mechanisms. In reality, holographic displays are usually represented by volumetric or multi-parallax technology. In this work, a novel holographic display is presented which leverages a mini-projector to produce a free-floating image onto a fog-like surface. The holographic user interface system will consist of a display component: to project a free-floating image; a tracking component: to allow the user to interact with the 3D display via gestures; and a software component: which drives the complete hardware system. After examining this research, readers will be well-informed on how to build an intuitive, eye-catching holographic user interface system for various application arenas

Mid-Air Gestural Interaction with a Large Fogscreen

Projected walk-through fogscreens have been created, but there is little research on the evaluation of the interaction performance with fogscreens. The present study investigated mid-air hand gestures for interaction with a large fogscreen. Participants (N = 20) selected objects from a fogscreen using tapping and dwell-based gestural techniques, with and without vibrotactile/haptic feedback. In terms of Fitts’ law, the throughput was about 1.4 bps to 2.6 bps, suggesting that gestural interaction with a large fogscreen is a suitable and effective input method. Our results also suggest that tapping without haptic feedback has good performance and potential for interaction with a fogscreen, and that tactile feedback is not necessary for effective mid-air interaction. These findings have implications for the design of gestural interfaces suitable for interaction with fogscreens.Peer reviewe

水面を利用したディスプレイの情報提示および認識手法

スマートフォンやタブレットなどの小型コンピュータは現在多くの人が保持し，常に持ち歩いている状況である．近年では，入浴時でもこれらの電子機器を持ち込み，動画や音楽鑑賞，ウェブページ閲覧，メールチェックなどを行う人が増えている．しかし，電子機器と水場である浴室は機器の故障を誘発させる危険性が高く相性が悪い．そのため，浴室環境でも安心して情報閲覧および操作を行えるシステムが必要であると考えられる．浴室環境を考慮したインタラクティブシステムとしてAquaTop Displayが挙げられる．このシステムは水面を入浴時の身体動作を利用してマルチユーザーかつマルチタッチ可能なウォーターサーフェスシステムである．このシステムで用いられるジェスチャは水特性を上手く利用しているが，ジェスチャ認識精度や情報提示手法に問題がある．そこで，これらの問題を解決し，より安定したジェスチャ認識精度，より入浴時に適した情報提示が可能なシステムを実装し評価することが我々の目的である．我々は先ず，これらの問題点の原因を調査した．その後，ジェスチャ認識の解決案として，水面を認識することに特化したビジョンベースのライブラリ群であるAquaTop Core Vision Frameworkを実装し，フレームワークの有効性を検証した．また，浴室環境に適した情報提示の解決案として，浴槽内で動画および音楽鑑賞，ウェブページ閲覧，メール送信など従来のスマートフォンやタブレットで行っていることを水面上で可能にするAquaTop Multi Viewerを提案し実装した．さらに，認識精度を低下させる最大の原因である水面への操作によって発生する波ノイズの対処方法を提案し検証した．今後は提案したシステムを実際の浴室環境で利用し，実装したジェスチャ操作の有効性を検証したい．電気通信大学201

SonicSpray: a technique to reconfigure permeable mid-air displays

Permeable, mid-air displays, such as those using fog or water mist are limited by our ability to shape and control the aerosol and deal with two major issues: (1) the size and complexity of the system, and (2) the creation of laminar flow, to retain display quality. Here we present SonicSpray, a technique using ultrasonic Bessel beams to create reconfigurable mid-air displays. We build a prototype from low-cost, off-the-shelf parts. We explore the potential and limitations of SonicSpray to create and redirect laminar flows of fog. We demonstrate a working prototype that precisely controls laminar aerosols through only 6x6 ultrasound transducers array. We describe the implementation steps to build the device, verify the control and projection algorithm for the display, and evaluate its performance. We finally report our exploration of several useful applications, in learning, entertainment and arts