Skip to main content
Article thumbnail
Location of Repository

The EyeHarp: A Gaze-Controlled Musical tonomous Generation of Soundscapes using Unstructured Sound Databases Instrument

By  and Zacharias VamvakousisNathaniel Finney and Zacharias Vamvakousis

Abstract

In the thesis, we present the EyeHarp, a digital musical instrument based on eye tracking. The EyeHarp consists of a self-built low-cost eye-tracking device which communicates with an intuitive musical interface. The system allows the performer to produce music in real time by controlling sound settings and musical events only through eye movements. The instrument can also be controlled using any input device that can take control of the mouse pointer, and thus it could be appropriate for many cases of people with disabilities. Following the EyeWriter ’ s initiative instructions, a e50 eye tracking device was constructed and used along with the provided open source code for getting the user’s gaze coordinates on the screen. Having that as an input, the EyeHarp digital musical instrument was implemented in openFrameworks C++ toolkit. The user can play music in real time controlling the chords and melody of his composition through an intuitive interface based on the pie menus. On top of it, an arpeggiator machine and a step sequencer provide the opportunity of creating a harmonic and rhythmic background. Depending on the desired task, dwell time or screen button gaze selection technique is applied. A preliminary discount usability experiment is conducted having the eye gaze versus the head movements as input. i Acknowledgements Thanks to my family for supporting me this year. Many thanks to all my colleges from this master, for the amazing moments we shared during this year! I want to thank separately my college Emilio Molina for bringing me in contact with organizations of people with disabilities and my supervisor Dr. Rafael Ramirez for his support

Year: 2013
OAI identifier: oai:CiteSeerX.psu:10.1.1.353.1821
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://mtg.upf.edu/system/file... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.