A Summary Of: Collecting Sleep, Circadian, Fatigue, and Performance Data in Complex Operational Environments

Sleep loss and circadian misalignment contribute to a meaningful proportion of operational accidents and incidents. Countermeasures and work scheduling designs aimed at mitigating fatigue are typically evaluated in controlled laboratory environments, but the effectiveness of translating such strategies to operational environments can be challenging to assess. This manuscript summarizes an approach for collecting sleep, circadian, fatigue, and performance data in a complex operational environment. We studied 44 airline pilots over 34 days while they flew a fixed schedule, which included a baseline data collection with 5 days of mid-morning flights, four early flights, four high-workload mid-day flights, and four late flights that landed after midnight. Each work block was separated by 3-4 days of rest. To assess sleep, participants wore a wrist-worn research-validated activity monitor continuously and completed daily sleep diaries. To assess the circadian phase, pilots were asked to collect all urine produced in four or eight hourly bins during the 24 h after each duty block for the assessment of 6-sulfatoxymelatonin (aMT6s), which is a biomarker of the circadian rhythm. To assess subjective fatigue and objective performance, participants were provided with a touchscreen device used to complete the Samn-Perelli Fatigue Scale and Psychomotor Vigilance Task (PVT) during and after each flight, and at wake-time, mid-day, and bedtime. Using these methods, it was found that sleep duration was reduced during early starts and late finishes relative to baseline. Circadian phase shifted according to duty schedule, but there was a wide range in the aMT6s peak between individuals on each schedule. PVT performance was worse on the early, high-workload, and late schedules relative to baseline. Overall, the combination of these methods was practical and effective for assessing the influence of sleep loss and circadian phase on fatigue and performance in a complex operational environment

Variation in Sleep Duration and Circadian Phase by Duty Start Time Among Short-Haul Commercial Airline Pilots

Prior studies have confirmed that commercial airline pilots experience circadian phase shifts and short sleep duration following travel with layovers in different time zones. Few studies have examined the impact of early and late starts on the sleep and circadian phase of airline pilots who return to their domicile after each duty period. We recruited 44 pilots (4 female) from a short-haul commercial airline to participate in a study examining sleep and circadian phase over four duty schedules (baseline, early starts, mid-day starts, late starts). Each duty schedule was five days long, separated by three rest days. Participants completed the rosters in the same order. Sleep outcomes were estimated using wrist-borne actigraphy (Actiware Software, Respironics, Bend, OR) and daily sleep diaries. Thirteen participants volunteered to collect urine samples for the assessment of 6-sulfatoxymelatonin (aMT6s). Urine samples were collected in four hourly bins during the day and eight-hourly bins during sleep episodes, for 24 hours immediately following each experimental duty schedule. The aMT6s results were fit to a cosine in order to obtain the acrophase to estimate circadian phase. Univariate statistics were calculated for acrophase changes, schedule start times and sleep times. All statistical analyses were computed using SAS software (Cary, IN).The mean duty start times varied as expected (baseline 10:17 [ 3:50], early starts 5:24 [ 0:30], mid-day starts 13:52 [ 1:20], late starts 16:33 [ 1:33]). Actigraphy-derived sleep duration varied between schedule types, with the shortest average sleep durations occurring during the early starts and night duty. Mean circadian phase was similar during each schedule type (baseline 26:14 [ 3:22], early starts 25:29 [2:13], mid-day starts 26:20 [ 3:16], late starts 25:49 [ 4:28]), but there were wide inter-individual differences in phase shifting from the beginning to the end of the study, with phase shifts ranging from a 5.98 hour phase advance to an 11.34 hour phase delay. Our preliminary findings suggest that early and late starts are associated with reduced sleep duration. The dispersion in inter-individual differences in circadian phase across shifting duty schedules should be further evaluated to determine how schedule-induced phase shifts may affect operational performance

Benefits of Matching Domain Structure for Planning Software: The Right Stuff

We investigated the role of domain structure in software design. We compared 2 planning applications, for a Mission Control group (International Space Station), and measured users speed and accuracy. Based on our needs analysis, we identified domain structure and used this to develop new prototype software that matched domain structure better than the legacy system. We took a high-fidelity analog of the natural task into the laboratory and found (large) periformance differences, favoring the system that matched domain structure. Our task design enabled us to attribute better periormance to better match of domain structure. We ran through the whole development cycle, in miniature, from needs analysis through design, development, and evaluation. Doing so enabled inferences not just about the particular systems compared, but also provided evidence for the viability of the design process (particularly needs analysis) that we are exploring

Aircraft Exceedances Vary According to Time of Day and Workload

The Flight Operational Quality Assurance (FOQA) programs have been implemented in US and Europe to identify anomalous flights based on data recorded on board an aircraft in an effort to improve flight safety. Numerous methods have been developed to support the analysis of FOQA data. However, it is unclear how FOQA data relates to the performance of the pilot. We sought to characterize the frequency and type of flight exceedances extracted from FOQA data during a controlled pilot schedule in order to determine whether patterns of exceedances related to human control of the aircraft would change according to scheduling factors

Perspectives on fatigue in short-haul flight operations from US pilots: A focus group study

There are few studies investigating the impact of fatigue in short-haul flight operations conducted under United States (US) 14 Code of Federal Regulations Part 117 flight and duty limitations and rest requirements. In order to understand the fatigue factors unique to short-haul operations, we conducted a series of focus groups across four major commercial passenger airlines in the US. Ninety short-haul pilots were recruited through emails distributed by airline safety teams and labor representatives. Fourteen focus groups were conducted via an online conferencing platform in which participants were asked to identify short-haul schedules and operations that they felt: a) elevated fatigue, b) were not fatiguing, and c) were important to study. Data were collected anonymously and coded using conventional qualitative content analysis, with axial coding and summative analysis used to identify main themes and over-arching categories. The six fatigue factor categories identified were: circadian disruption, high workload, inadequate rest opportunity, schedule changes, regulation implementation and policy issues, and long sits. It appears that additional mitigation strategies may be needed to manage fatigue in short-haul operations beyond the current regulations. Future field studies of short-haul operations in the US should investigate the prevalence and impact of these factors

The Relationship between Workload, Performance and Fatigue in a Short-Haul Airline

Short-haul flights are associated with irregular work schedules and increased workload, due to frequent takeoffs and landings. We examined the relationship between pilot workload, performance and subjective fatigue during normal short-haul operations. Ninety airline pilots (8 female), mean age 33 (8 years) completed a NASA-Task Load Index (NASA-TLX), a Psychomotor Vigilance Task (PVT; a reaction time test sensitive to sleep loss) and a Samn-Perelli (SP) fatigue scale, over a period of 20 duty days at top-of-descent on 2762 short-haul flights. The duty days included either 2 or 4 flights per day starting at different times as scheduled during normal operations. Workload was measured using the six NASA-TLX scales: mental demand, physical demand, temporal demand, effort, performance and frustration. Lapses (reaction times [RT] > 500ms) were calculated for the PVT. Spearman correlations were calculated to identify relationships between the NASA-TLX, PVT lapses, and SP. The six scales of NASA-TLX were positively correlated with the PVT lapses (p < 0.01) showing an increase in workload when lapses increased. There was a positive correlation between subjective fatigue as measured by the SP fatigue scale and each of the six scales of NASA-TLX (p < 0.001) suggesting that pilots reported higher workload when perceived levels of fatigue were higher. Of the six workload scales, mental demand and performance were rated the highest (mental: M = 40.99, SD = 20.32; performance: M = 41.61, SD = 20.71) and effort was rated the lowest (M = 15.59, SD = 8.98). Preliminary analyses suggest that high workload is associated with poorer PVT performance and increased self-reported fatigue in this population of short-haul pilots. Future studies should explore how other workload factors (i.e. flight hours, time of day) influence self-reported and objective fatigue measures