Tools for Designing, Evaluating, and Certifying NextGen Technologies and Procedures: Automation Roles and Responsibilities

Barbara Kanki from NASA Ames Research Center will discuss research that focuses on the collaborations between pilots, air traffic controllers and dispatchers that will change in NextGen systems as automation increases and roles and responsibilities change. The approach taken by this NASA Ames team is to build a collaborative systems assessment template (CSAT) based on detailed task descriptions within each system to establish a baseline of the current operations. The collaborative content and context are delineated through the review of regulatory and advisory materials, policies, procedures and documented practices as augmented by field observations and interviews. The CSAT is developed to aid the assessment of key human factors and performance tradeoffs that result from considering different collaborative arrangements under NextGen system changes. In theory, the CSAT product may be applied to any NextGen application (such as Trajectory Based Operations) with specified ground and aircraft capabilities

Human Factors Throughout the Life Cycle: Lessons Learned from the Shuttle Program

With the ending of the Space Shuttle Program, it is critical that we not forget the Human Factors lessons we have learned over the years. At every phase of the life cycle, from manufacturing, processing and integrating vehicle and payload, to launch, flight operations, mission control and landing, hundreds of teams have worked together to achieve mission success in one of the most complex, high-risk socio-technical enterprises ever designed. Just as there was great diversity in the types of operations performed at every stage, there was a myriad of human factors that could further complicate these human systems. A single mishap or close call could point to issues at the individual level (perceptual or workload limitations, training, fatigue, human error susceptibilities), the task level (design of tools, procedures and aspects of the workplace), as well as the organizational level (appropriate resources, safety policies, information access and communication channels). While we have often had to learn through human mistakes and technological failures, we have also begun to understand how to design human systems in which individuals can excel, where tasks and procedures are not only safe but efficient, and how organizations can foster a proactive approach to managing risk and supporting human enterprises. Panelists will talk about their experiences as they relate human factors to a particular phase of the shuttle life cycle. They will conclude with a framework for tying together human factors lessons-learned into system-level risk management strategies

Upset Recovery Human Factors

Accident and incident analyses as well as industry group concerns and recommendations have justified taking a second look at proficiency standards related to upset recovery training and performance. Quite a number of factors and theories have been suggested-- leading the NASA Aviation Safety Program to reconsider manual handling skills in highly automated aircraft particularly in conditions that can potentially lead to Loss of Control events. Our team of Subject Matter Experts (SMEs) first identified 76 Basic Recovery Skills that were important for effective crew response under five different anomaly conditions. In addition to manual handling skills, the skill set included knowledge and cognitive skills, as well as decision making and management skills. Advanced Recovery Skills were identified by combining skills, integrating with crew resource management skills, and developing heuristics for decision making.Using the Advanced Recovery Skill set, the SMEs then developed a generic process flow starting from the problem discovery phase (e.g., identifying an anomaly) through the decision making and management phase (e.g., assessing response options), through the recovery phase (e.g., controlling the aircraft). The generic process flow was refined by testing it against six additional scenarios. The next part of the project was to develop an approach for assessing and revising a generic training curriculum (we used an operators Advanced Qualification Program (AQP) as a framework). Although many of the Basic and Advanced Recovery Skills could be found in the Job Task Listing, they were not always structured or combined in the most effective way. Recommendations were developed for assessing relevant aspects of the Job Task Listing and Continuing Qualification curriculum so that the more comprehensive set of Upset Recovery skillsincluding Human Factors--could be trained and assessed in the most appropriate and effective context. The existing AQP methodology provides a natural way to insert targeted Upset Recovery skills into its system of proficiency objectives, training devices, training activities, and ultimately, into the event sets of a simulator training scenario

Near-Term Nextgen and Class 2 EFBS

This study is based on data collected at the Electronic Flight Bag (EFB) Advanced Software and Authorization Workshop for US operators currently involved in EFB software evaluation or implementation for their own fleets. With most US operators not taking delivery of new, larger aircraft in the next few years, they are considering ways of displaying near-term NextGen data on board existing aircraft through systems such as the EFB. The workshop collected operator near-term needs in the areas of EFB user interface and standardization and EFB advanced software applications. The analysis of the data collected during the workshop provided a prioritized list of operator needs over the next few years with an emphasis on runway safety and related NextGen systems. The study reports on those needs in the context of near-term NextGen systems and Class 2 EFBs

Personality factors in flight operations. Volume 1: Leader characteristics and crew performance in a full-mission air transport simulation

Crew effectiveness is a joint product of the piloting skills, attitudes, and personality characteristics of team members. As obvious as this point might seem, both traditional approaches to optimizing crew performance and more recent training development highlighting crew coordination have emphasized only the skill and attitudinal dimensions. This volume is the first in a series of papers on this simulation. A subsequent volume will focus on patterns of communication within crews. The results of a full-mission simulation research study assessing the impact of individual personality on crew performance is reported. Using a selection algorithm described in previous research, captains were classified as fitting one of three profiles along a battery of personality assessment scales. The performances of 23 crews led by captains fitting each profile were contrasted over a one-and-one-half-day simulated trip. Crews led by captains fitting a positive Instrumental-Expressive profile (high achievement motivation and interpersonal skill) were consistently effective and made fewer errors. Crews led by captains fitting a Negative Expressive profile (below average achievement motivation, negative expressive style, such as complaining) were consistently less effective and made more errors. Crews led by captains fitting a Negative Instrumental profile (high levels of competitiveness, verbal aggressiveness, and impatience and irritability) were less effective on the first day but equal to the best on the second day. These results underscore the importance of stable personality variables as predictors of team coordination and performance

The impact of cockpit automation on crew coordination and communication. Volume 1: Overview, LOFT evaluations, error severity, and questionnaire data

The purpose was to examine, jointly, cockpit automation and social processes. Automation was varied by the choice of two radically different versions of the DC-9 series aircraft, the traditional DC-9-30, and the glass cockpit derivative, the MD-88. Airline pilot volunteers flew a mission in the simulator for these aircraft. Results show that the performance differences between the crews of the two aircraft were generally small, but where there were differences, they favored the DC-9. There were no criteria on which the MD-88 crews performed better than the DC-9 crews. Furthermore, DC-9 crews rated their own workload as lower than did the MD-88 pilots. There were no significant differences between the two aircraft types with respect to the severity of errors committed during the Line-Oriented Flight Training (LOFT) flight. The attitude questionnaires provided some interesting insights, but failed to distinguish between DC-9 and MD-88 crews

Human Factors Design of Electronic Documents

The Federal Aviation Administration (FAA), working with the Master Minimum Equipment List (MMEL) Industry Group, is developing a new MMEL electronic format. The MMEL refers to a series of documents controlled by the FAA that lists equipment that may be inoperative under certain conditions while still allowing the aircraft to be airworthy. Each aircraft model has an MMEL, and operators must work with that master document to determine the relief items for their specific aircraft. The resulting Minimum Equipment List (MEL) for an operator\u27s aircraft is used by both ground personnel and pilots to determine the procedures for maintaining airworthiness. Currently, the MMEL is available in text format, and the industry needs an electronic format that is more efficient and that will be compatible with key aspects of future data standards. Members of the MMEL Industry Group were surveyed to determine the main user needs and human factors considerations for the development and evaluation of the MMEL electronic format. This study identifies key operator needs that can direct the development of not only the new MMEL format but also the broader category of aviation electronic documents

Optimizing EFB Use Through Training, Standards, and Best Practices

The Electronic Flight Bag (EFB) provides an integrated information management system that promises new capabilities and benefits to pilots, but information access and display differs substantially from traditional paper documents. Pilots must understand what information is available and where it is located, how data is accessed and entered, and how this system interacts with other aircraft systems. Operators must develop standards, best practices and training that will optimize the EFB capabilities and ensure safe and effective crew performance. This paper presents how key training and procedural enhancements as well as the identification of best practices can be identified during the EFB operational evaluation for incorporation into ongoing line operations

Beyond Electronic Flight Bag (EFB) Approval: Improving Crew Performance

As operators evaluate and implement Electronic Flight Bags (EFBs), the emphasis has been on their operational approval and certification. This research provides data that demonstrate how an operator can aim beyond the limited objectives of the EFB approval process to improving crew performance. This paper reports on evaluation results that show how crews working with an EFB can not only equal, but can exceed the performance of those working with traditional paper documents

Patterns of Error in Confidential Maintenance Incident Reports

Confidential reports of maintenance incidents are a valuable source of information on maintenance errors and the contexts within which they occur. NASA's Aviation Safety Reporting System (ASRS) has been receiving an increasing number of maintenance incident reports since a specialized maintenance reporting form was introduced in 1996. In a series of studies, the database of ASRS maintenance incidents was examined using correspondence analysis, a statistical technique that converts complex data tables into a visual form. The analyses revealed patterns within the ASRS data set that would have otherwise been difficult to detect. The results have implications for a range of purposes including human factors training, the design of procedures, and the identification of improvements in aircraft design