Eye-tracking technology in vehicles: application and design

This work analyses the eye-tracking technology and, as an outcome, it presents an idea of implementing it, along with other kinds of technology, in vehicles. The main advantage of such an implementation would be to augment safety while driving. The setup and the methodology used for detecting human activity and interaction using the means of the eye-tracking technology are investigated. Research in that area is growing rapidly and its results are used in a variety of cases. The main reasons for that growth are the constant lowering of prices of the special equipment that is necessary, the portability that is available in some cases as well as the easiness of use that make the usage of that technology more user-friendly than it was a few years ago. The whole idea of eye-tracking is to track the movements of the eyes in an effort to determine the direction of the gaze, using sophisticated software and purpose built hardware. This manuscript, makes a brief introduction in the history of eye monitoring presenting the very early scientific approaches used in an effort to better understand the movements of the human while tracking an object or during an activity. Following, there is an overview of the theory and the methodology used to track a specific object. As a result there exists a short presentation of the image processing and the machine learning procedures that are used to accomplish such tasks. Thereafter, we further analyze the specific eye-tracking technologies and techniques that are used nowadays and the characteristics that affect the exact choice of eye-tracking equipment. For the appropriate choice we have to take into account the area of research-interest in which the equipment will be used. In addition, the main categories of eye-tracking applications are presented and we shortlist the latest state of the art eye-tracking commercial systems. Following, we present our first approach, trying to describe an eye-tracking device that could be used in vehicles offering much better safety standards, controlling various parameters, continuously checking the readiness of the driver and alerting him for potential imminent collision incidents. Finally, we describe the existing way of connecting a device, in our case an eye-tracker, can be connected to an automobile’s system

Aerospace Medicine and Biology: A cumulative index to the 1974 issues of a continuing bibliography

This publication is a cumulative index to the abstracts contained in supplements 125 through 136 of Aerospace Medicine and Biology: A Continuing Bibliography. It includes three indexes--subject, personal author, and corporate source

Developing a new generation of neuro-prosthetic interfaces: structure-function correlates of viable retina-CNT biohybrids

PhD ThesisOne of the many challenges in the development of neural prosthetic devices is the choice of electrode material. Electrodes must be biocompatible, and at the same time, they must be able to sustain repetitive current injections in a highly corrosive physiological environment. We investigated the suitability of carbon nanotube (CNT) electrodes for retinal prosthetics by studying prolonged exposure to retinal tissue and repetitive electrical stimulation of retinal ganglion cells (RGCs). Experiments were performed on retinal wholemounts isolated from the Cone rod homeobox (CRX) knockout mouse, a model of Leber congenital amaurosis. Retinas were interfaced at the vitreo-retinal juncture with CNT assemblies and maintained in physiological conditions for up to three days to investigate any anatomical (immunohistochemistry and electron microscopy) and electrophysiological changes (multielectrode array stimulation and recordings; electrodes were made of CNTs or commercial titanium nitride). Anatomical characterisation of the inner retina, including RGCs, astrocytes and Müller cells as well as cellular matrix and inner retinal vasculature, provide strong evidence of a gradual remodelling of the retina to incorporate CNT assemblies, with very little indication of an immune response. Prolonged electrophysiological recordings, performed over the course of three days, demonstrate a gradual increase in signal amplitudes, lowering of stimulation thresholds and an increase in cellular recruitment for RGCs interfaced with CNT electrodes, but not with titanium nitride electrodes. These results provide for the first time electrophysiological, ultrastructural and cellular evidence of the time-dependent formation of strong and viable bio-hybrids between the RGC layer and CNT arrays in intact retinas. We conclude that CNTs are a promising material for inclusion in retinal prosthetic devices

Emerging ExG-based NUI Inputs in Extended Realities : A Bottom-up Survey

Incremental and quantitative improvements of two-way interactions with extended realities (XR) are contributing toward a qualitative leap into a state of XR ecosystems being efficient, user-friendly, and widely adopted. However, there are multiple barriers on the way toward the omnipresence of XR; among them are the following: computational and power limitations of portable hardware, social acceptance of novel interaction protocols, and usability and efficiency of interfaces. In this article, we overview and analyse novel natural user interfaces based on sensing electrical bio-signals that can be leveraged to tackle the challenges of XR input interactions. Electroencephalography-based brain-machine interfaces that enable thought-only hands-free interaction, myoelectric input methods that track body gestures employing electromyography, and gaze-tracking electrooculography input interfaces are the examples of electrical bio-signal sensing technologies united under a collective concept of ExG. ExG signal acquisition modalities provide a way to interact with computing systems using natural intuitive actions enriching interactions with XR. This survey will provide a bottom-up overview starting from (i) underlying biological aspects and signal acquisition techniques, (ii) ExG hardware solutions, (iii) ExG-enabled applications, (iv) discussion on social acceptance of such applications and technologies, as well as (v) research challenges, application directions, and open problems; evidencing the benefits that ExG-based Natural User Interfaces inputs can introduceto the areaof XR.Peer reviewe

Gaze-Based Control of Robot Arm in Three-Dimensional Space

Eye tracking technology has opened up a new communication channel for people with very restricted body movements. These devices had already been successfully applied as a human computer interface, e.g. for writing a text, or to control different devices like a wheelchair. This thesis proposes a Human Robot Interface (HRI) that enables the user to control a robot arm in 3-Dimensional space using only 2-Dimensional gaze direction and the states of the eyes. The introduced interface provides all required commands to translate, rotate, open or close the gripper with the definition of different control modes. In each mode, different commands are provided and direct gaze direction of the user is applied to generate continuous robot commands. To distinguish between natural inspection eye movements and the eye movements that intent to control the robot arm, dynamic command areas are proposed. The dynamic command areas are defined around the robot gripper and are updated with its movements. To provide a direct interaction of the user, gaze gestures and states of the eyes are used to switch between different control modes. For the purpose of this thesis, two versions of the above-introduced HRI were developed. In the first version of the HRI, only two simple gaze gestures and two states of the eye (closed eyes and eye winking) are used for switching. In the second version, instead of the two simple gestures, four complex gaze gestures were applied and the positions of the dynamic command areas were optimized. The complex gaze gestures enable the user to switch directly from initial mode to the desired control mode. These gestures are flexible and can be generated directly in the robot environments. For the recognition of complex gaze gestures, a novel algorithm based on Dynamic Time Warping (DTW) is proposed. The results of the studies conducted with both HRIs confirmed their feasibility and showed the high potential of the proposed interfaces as hands-free interfaces. Furthermore, the results of subjective and objective measurements showed that the usability of the interface with simple gaze gestures had been improved with the integration of complex gaze gestures and the new positions of the dynamic command areas

Emerging ExG-based NUI Inputs in Extended Realities : A Bottom-up Survey

Incremental and quantitative improvements of two-way interactions with extended realities (XR) are contributing toward a qualitative leap into a state of XR ecosystems being efficient, user-friendly, and widely adopted. However, there are multiple barriers on the way toward the omnipresence of XR; among them are the following: computational and power limitations of portable hardware, social acceptance of novel interaction protocols, and usability and efficiency of interfaces. In this article, we overview and analyse novel natural user interfaces based on sensing electrical bio-signals that can be leveraged to tackle the challenges of XR input interactions. Electroencephalography-based brain-machine interfaces that enable thought-only hands-free interaction, myoelectric input methods that track body gestures employing electromyography, and gaze-tracking electrooculography input interfaces are the examples of electrical bio-signal sensing technologies united under a collective concept of ExG. ExG signal acquisition modalities provide a way to interact with computing systems using natural intuitive actions enriching interactions with XR. This survey will provide a bottom-up overview starting from (i) underlying biological aspects and signal acquisition techniques, (ii) ExG hardware solutions, (iii) ExG-enabled applications, (iv) discussion on social acceptance of such applications and technologies, as well as (v) research challenges, application directions, and open problems; evidencing the benefits that ExG-based Natural User Interfaces inputs can introduceto the areaof XR.Peer reviewe

Micro-optics for Opto-genetic Neuro-stimulation with Micro-LED Arrays

The breakthrough discovery of a nanoscale optically gated ion channel protein, Channelrhodopsin 2 (ChR2), in combination with a genetically expressed optically activated ion pump, Halorhodopsin, allowed the direct stimulation and inhibition of individual action potentials with light alone. This thesis describes the development of optics and micro-optics which when used with micro-led array sources, collects and projects light efficiently and uniformly onto such opto-genetically modified specimens. When used with enhanced light gated ion channels and pumps these systems allow us to further our understanding of both brain and visual systems. Micro-LED arrays permit spatio-temporal control of neuron stimulation on sub-millisecond timescales. However, micro-led arrays are disadvantaged by the broad-angular spread of their light emission and their low spatial fill factor. We present the design of macro and micro-optics systems for use with a micro-LED arrays consisting of a matrix of 25μm diameter micro-LEDs with 150 or 80μm centre-to-centre spacing. On one system, the micro-LED array is imaged onto off-the-shelf micro-optics using macro-optics and in the other system; micro-LED array and custom micro-optics are optimised and integrated together. The two systems are designed to improve the fill-factor from 2% to more than 78% by capturing a larger fraction of the LED emission and directing it correctly to the sample plane. This approach allows low fill factor arrays to be used effectively, which in turn has benefits in terms of thermal management and electrical drive from CMOS backplane electronics. These systems were implemented as an independent set that could be connected to a variety of different microscopes available for Patch-clamp and Multi-electrode measurements. As well, the feasibility of an eye prosthesis was tested using virtual reality optics and a fake eye to stimulate ganglion cells and by doing in-vivo stimulation of the genetically modified retina of a mouse.Open Acces

Faculty Publications and Creative Works 1997

One of the ways we recognize our faculty at the University of New Mexico is through this annual publication which highlights our faculty\u27s scholarly and creative activities and achievements and serves as a compendium of UNM faculty efforts during the 1997 calendar year. Faculty Publications and Creative Works strives to illustrate the depth and breadth of research activities performed throughout our University\u27s laboratories, studios and classrooms. We believe that the communication of individual research is a significant method of sharing concepts and thoughts and ultimately inspiring the birth of new of ideas. In support of this, UNM faculty during 1997 produced over 2,770 works, including 2,398 scholarly papers and articles, 72 books, 63 book chapters, 82 reviews, 151 creative works and 4 patents. We are proud of the accomplishments of our faculty which are in part reflected in this book, which illustrates the diversity of intellectual pursuits in support of research and education at the University of New Mexico. Nasir Ahmed Interim Associate Provost for Research and Dean of Graduate Studie