Specialized CNT-based Sensor Framework for Advanced Motion Tracking

In this work, we discuss the design and development of an advanced framework for high-fidelity finger motion tracking based on Specialized Carbon Nanotube (CNT) stretchable sensors developed at our research facilities. Earlier versions of the CNT sensors have been employed in the high-fidelity finger motion tracking Data Glove commercialized by Yamaha, Japan. The framework presented in this paper encompasses our continuing research and development of more advanced CNT-based sensors and the implementation of novel high-fidelity motion tracking products based on them. The CNT sensor production and communication framework components are considered in detail and wireless motion tracking experiments with the developed hardware and software components integrated with the Yamaha Data Glove are reported

Infrared vs. ultrasonic finger detection on a virtual piano keyboard

An immaterial digital keyboard is presented, aiming at testing possibilities to substitute physical with augmented piano keys during the performance. The main effort has been made around the realization of an accurate meanwhile fast detection of the hands movement. To achieve this goal we have tested low-cost infrared as well as ultrasonic capture devices, whose current pros and cons are presented in either cases. Multimodal feedback has been realized by filming the hands\u2019 action with the rear camera of a consumer\u2019s tablet PC, and then projecting this action on its screen; furthermore this projection has been layered over the image of a piano keyboard reacting to the hands\u2019 action. Especially in connection with a Leap Motion system in charge of doing the infrared-based detection, and other light hardware for the sonic and vibrotactile rendering of the feedback, the proposed prototype promises potential application as an inexpensive mobile music interface transforming a normal table in an augmented reality scenario, where a pianist can perform simple musical tasks by relying on reasonably accurate and realistic feedback even in absence of a hardware keyboard

視覚障がい者のための日常生活支援システムの開発

東京電機大学201