Designing touch screen user interfaces for future flight deck operations

Many interactional issues with Flight Management Systems (FMS) in modern flight decks have been reported. Avionics designers are seeking for ways to reduce cognitive load of pilots with the aim to reduce the potential for human error. Academic research showed that touch screen interfaces reduce cognitive effort and provide an intuitive way of interaction. A new way of interaction to manipulate radio frequencies of avionics systems is presented in this paper. A usability experiment simulating departures and approaches to airports was used to evaluate the interface and compare it with the current system (FMS). In addition, interviews with pilots were conducted to find out their personal impressions and to reveal problem areas of the interface. Analyses of task completion time and error rates showed that the touch interface is significantly faster and less prone to user input errors than the conventional input method (via physical or virtual keypad). Potential problem areas were identified and an improved interface is suggested

Taking Fitts' Slow: The Effects of Delayed Visual Feedback on Human Motor Performance and User Experience

abstract: ABSTRACT The present studies investigated the separate effects of two types of visual feedback delay – increased latency and decreased updating rate – on performance – both actual (e.g. response time) and subjective (i.e. rating of perceived input device performance) – in 2-dimensional pointing tasks using a mouse as an input device. The first sub-study examined the effects of increased latency on performance using two separate experiments. In the first experiment the effects of constant latency on performance were tested, wherein participants completed blocks of trials with a constant level of latency. Additionally, after each block, participants rated their subjective experience of the input device performance at each level of latency. The second experiment examined the effects of variable latency on performance, where latency was randomized within blocks of trials. The second sub-study investigated the effects of decreased updating rates on performance in the same manner as the first study, wherein experiment one tested the effect of constant updating rate on performance as well as subjective rating, and experiment two tested the effect of variable updating rate on performance. The findings suggest that latency is negative correlated with actual performance as well as subjective ratings of performance, and updating rate is positively correlated with actual performance as well as subjective ratings of performance.Dissertation/ThesisMasters Thesis Applied Psychology 201

The Mole: a pressure-sensitive mouse

The traditional mouse enables the positioning of a cursor in a 2D plane, as well as the interaction of binary elements within that plane (e.g., buttons, links, icons). While this basic functionality is sufficient for interacting with every modern computing environment, it makes little use of the human hand\u27s ability to perform complex multi-directional movements. Devices developed to capture these multi-directional capabilities typically lack the familiar form and function of the mouse. This thesis details the design and development of a pressure-sensitive device called The Mole. The Mole retains the familiar form and function of the mouse while passively measuring the magnitude of normal hand force (i.e., downward force normal to the 2D operating surface). The measurement of this force lends itself to the development of novel interactions, far beyond what is possible with a typical mouse. This thesis demonstrates two such interactions: the positioning of a cursor in 3D space, and the simultaneous manipulation of cursor position and graphic tool parameters

Controlling a Mouse Pointer with a Single-Channel EEG Sensor

Goals: The purpose of this study was to analyze the feasibility of using the information obtained from a one-channel electro-encephalography (EEG) signal to control a mouse pointer. We used a low-cost headset, with one dry sensor placed at the FP1 position, to steer a mouse pointer and make selections through a combination of the user’s attention level with the detection of voluntary blinks. There are two types of cursor movements: spinning and linear displacement. A sequence of blinks allows for switching between these movement types, while the attention level modulates the cursor’s speed. The influence of the attention level on performance was studied. Additionally, Fitts’ model and the evolution of the emotional states of participants, among other trajectory indicators, were analyzed. (2) Methods: Twenty participants distributed into two groups (Attention and No-Attention) performed three runs, on different days, in which 40 targets had to be reached and selected. Target positions and distances from the cursor’s initial position were chosen, providing eight different indices of difficulty (IDs). A self-assessment manikin (SAM) test and a final survey provided information about the system’s usability and the emotions of participants during the experiment. (3) Results: The performance was similar to some brain–computer interface (BCI) solutions found in the literature, with an averaged information transfer rate (ITR) of 7 bits/min. Concerning the cursor navigation, some trajectory indicators showed our proposed approach to be as good as common pointing devices, such as joysticks, trackballs, and so on. Only one of the 20 participants reported difficulty in managing the cursor and, according to the tests, most of them assessed the experience positively. Movement times and hit rates were significantly better for participants belonging to the attention group. (4) Conclusions: The proposed approach is a feasible low-cost solution to manage a mouse pointe

Evaluation of Fitts’ Throughput as a Possible Performance Measure for Manual Assembly Tasks

Assembly lines are the backbone of the manufacturing sector. Workers at the assembly lines are expected to perform fast pace hand-arm exertions with precision and accuracy. To protect the workers from injuries, OSHA mandates the use of personal protective equipment (PPE) including gloves. Certain assembly operations require the use of special gloves. Some of these gloves can inhibit hand performance, further increasing the task difficulty. The Index of Difficulty (ID) is a metric measured in ‘bits’ quantifies task difficulty through the quotient of target width and target motion, i.e., distance travelled. The time required to complete the target motion is the Movement time (MT). The ratio of ID and MT was defined by Fitts as ‘throughput’ and is measured in bits/s. This study aims to evaluate Fitts’ throughput as a possible performance measure for gloves used in the manual assembly tasks. An experimental study was performed using fifteen healthy participants with three types of gloves which were evaluated using two tests, Fitts’ throughput test and a hand tool dexterity test (HTDT). The Fitts’ throughput test was designed using ISO 9241-411 standard and involved a series of target transfer tasks with varying ID levels. In the HTDT test, participants performed a simulated assembly task with different glove conditions. Statistical analysis revealed that the effect of glove condition was significant for both throughput and assembly time. The mean throughput of 3.91 bits/s for bare hand was higher compared to the three glove conditions. Among the three glove conditions, Glove 2 was found to have a higher throughput of 3.72 bits/s followed by Glove 1 with 3.51 bits/s, and Glove 3 with 3.47 bits/s. The mean assembly times for Gloves 2, 1, 3 were 462.52 sec, 501.88 sec and 558.48 sec, respectively. In general, an inverse relationship between throughput and assembly time was observed, indicating that a glove with higher throughput produces lower assembly time. Thus, the study findings seem to indicate that Fitts’ throughput can serve as a possible performance measure for manual assembly tasks

Mechanical device or touchscreen widget: the effects of input device and task size on data entry on the primary flight display

ABSTRACT: Due to their customizability, touchscreens continue to advance as a device of choice when designing aircraft cockpits. Previous studies investigated the effect of turbulence on human performance when using touchscreens, but few have evaluated its performance for realistic aviation-specific tasks. In this study, we compared four touchscreen widgets and three mechanical devices during realistic data input on a primary flight display (PFD). Twenty participants took part in the experiment at a constant level of vibration, while simultaneously completing a secondary tracking task. Results indicated that virtual keypads lead to faster completion time for medium to large changes while keeping error rates low. Rotary knobs were fastest for small changes. Virtual keypads also had lower workload and discomfort compared to rotary knobs and drag-based widgets. We found the completion time to be the most important factor in tracking task performance, which translated in higher precision for keypads. These findings suggest that virtual keypads represent an efficient and secure option for numerical data input at low-to-medium vibration

Effects of Local Latency on Games

Video games are a major type of entertainment for millions of people, and feature a wide variety genres. Many genres of video games require quick reactions, and in these games it is critical for player performance and player experience that the game is responsive. One of the major contributing factors that can make games less responsive is local latency — the total delay between input and a resulting change to the screen. Local latency is produced by a combination of delays from input devices, software processing, and displays. Due to latency, game companies spend considerable time and money play-testing their games to ensure the game is both responsive and that the in-game difficulty is reasonable. Past studies have made it clear that local latency negatively affects both player performance and experience, but there is still little knowledge about local latency’s exact effects on games. In this thesis, we address this problem by providing game designers with more knowledge about local latency’s effects. First, we performed a study to examine latency’s effects on performance and experience for popular pointing input devices used with games. Our results show significant differences between devices based on the task and the amount of latency. We then provide design guidelines based on our findings. Second, we performed a study to understand latency’s effects on ‘atoms’ of interaction in games. The study varied both latency and game speed, and found game speed to affect a task’s sensitivity to latency. Third, we used our findings to build a model to help designers quickly identify latency-sensitive game atoms, thus saving time during play-testing. We built and validated a model that predicts errors rates in a game atom based on latency and game speed. Our work helps game designers by providing new insight into latency’s varied effects and by modelling and predicting those effect

Visuohaptic Simulation of a Borescope for Aircraft Engine Inspection

Consisting of a long, fiber optic probe containing a small CCD camera controlled by hand-held articulation interface, a video borescope is used for remote visual inspection of hard to reach components in an aircraft. The knowledge and psychomotor skills, specifically the hand-eye coordination, required for effective inspection are hard to acquire through limited exposure to the borescope in aviation maintenance schools. Inexperienced aircraft maintenance technicians gain proficiency through repeated hands-on learning in the workplace along a steep learning curve while transitioning from the classroom to the workforce. Using an iterative process combined with focused user evaluations, this dissertation details the design, implementation and evaluation of a novel visuohaptic simulator for training novice aircraft maintenance technicians in the task of engine inspection using a borescope. First, we describe the development of the visual components of the simulator, along with the acquisition and modeling of a representative model of a {PT-6} aircraft engine. Subjective assessments with both expert and novice aircraft maintenance engineers evaluated the visual realism and the control interfaces of the simulator. In addition to visual feedback, probe contact feedback is provided through a specially designed custom haptic interface that simulates tip contact forces as the virtual probe intersects with the {3D} model surfaces of the engine. Compared to other haptic interfaces, the custom design is unique in that it is inexpensive and uses a real borescope probe to simulate camera insertion and withdrawal. User evaluation of this simulator with probe tip feedback suggested a trend of improved performance with haptic feedback. Next, we describe the development of a physically-based camera model for improved behavioral realism of the simulator. Unlike a point-based camera, the enhanced camera model simulates the interaction of the borescope probe, including multiple points of contact along the length of the probe. We present visual comparisons of a real probe\u27s motion with the simulated probe model and develop a simple algorithm for computing the resultant contact forces. User evaluation comparing our custom haptic device with two commonly available haptic devices, the Phantom Omni and the Novint Falcon, suggests that the improved camera model as well as probe contact feedback with the 3D engine model plays a significant role in the overall engine inspection process. Finally, we present results from a skill transfer study comparing classroom-only instruction with both simulator and hands-on training. Students trained using the simulator and the video borescope completed engine inspection using the real video borescope significantly faster than students who received classroom-only training. The speed improvements can be attributed to reduced borescope probe maneuvering time within the engine and improved psychomotor skills due to training. Given the usual constraints of limited time and resources, simulator training may provide beneficial skills needed by novice aircraft maintenance technicians to augment classroom instruction, resulting in a faster transition into the aviation maintenance workforce

The WOZ Recognizer: A Tool For Understanding User Perceptions of Sketch-Based Interfaces

Sketch recognition has the potential to be an important input method for computers in the coming years; however, designing and building an accurate and sophisticated sketch recognition system is a time consuming and daunting task. Since sketch recognition is still at a level where mistakes are common, it is important to understand how users perceive and tolerate recognition errors and other user interface elements with these imperfect systems. A problem in performing this type of research is that we cannot easily control aspects of recognition in order to rigorously study the systems. We performed a study examining user perceptions of three pen-based systems for creating logic gate diagrams: a sketch-based interface, a WIMP-based interface, and a hybrid interface that combined elements of sketching and WIMP. We found that users preferred the sketch-based interface and we identified important criteria for pen-based application design. This work exposed the issue of studying recognition systems without fine-grained control over accuracy, recognition mode, and other recognizer properties. In order to solve this problem, we developed a Wizard of Oz sketch recognition tool, the WOZ Recognizer, that supports controlled symbol and position accuracy and batch and streaming recognition modes for a variety of sketching domains. We present the design of the WOZ Recognizer, modeling recognition domains using graphs, symbol alphabets, and grammars; and discuss the types of recognition errors we included in its design. Further, we discuss how the WOZ Recognizer simulates sketch recognition, controlling the WOZ Recognizer, and how users interact with it. In addition, we present an evaluative user study of the WOZ Recognizer and the lessons we learned. We have used the WOZ Recognizer to perform two user studies examining user perceptions of sketch recognition; both studies focused on mathematical sketching. In the first study, we examined whether users prefer recognition feedback now (real-time recognition) or later (batch recognition) in relation to different recognition accuracies and sketch complexities. We found that participants displayed a preference for real-time recognition in some situations (multiple expressions, low accuracy), but no statistical preference in others. In our second study, we examined whether users displayed a greater tolerance for recognition errors when they used mathematical sketching applications they found interesting or useful compared to applications they found less interesting. Participants felt they had a greater tolerance for the applications they preferred, although our statistical analysis did not positively support this. In addition to the research already performed, we propose several avenues for future research into user perceptions of sketch recognition that we believe will be of value to sketch recognizer researchers and application designers