Introduction  Results  Discussion  Current Investigation

Blickensderfer, Beth

King, Jayde

McSorley, Jackie

English

Embry-Riddle Aeronautical University

General Aviation Weather Display Interpretation General Aviation Weather 5-2019 Exploring Perceived Usability and Interpretability of Aviation Weather Products Among GA Pilots Jackie McSorley Embry-Riddle Aeronautical University Jayde King Embry-Riddle Aeronautical University Beth Blickensderfer Embry-Riddle Aeronautical University, blick488@erau.edu Follow this and additional works at: https://commons.erau.edu/ga-wx-display-interpretation  Part of the Aviation Commons, Cognitive Psychology Commons, Human Factors Psychology Commons, and the Meteorology Commons Scholarly Commons Citation McSorley, J., King, J., & Blickensderfer, B. (2019). Exploring Perceived Usability and Interpretability of Aviation Weather Products Among GA Pilots. , (). Retrieved from https://commons.erau.edu/ga-wx-display-interpretation/6 This Article is brought to you for free and open access by the General Aviation Weather at Scholarly Commons. It has been accepted for inclusion in General Aviation Weather Display Interpretation by an authorized administrator of Scholarly Commons. For more information, please contact commons@erau.edu. Exploring Perceived Usability and Interpretability of Aviation Weather Products Among GA PilotsJackie McSorley, M.S.Jayde King, M.S.Beth Blickensderfer, Ph.DPresentation given at the 20th International Symposium on Aviation Psychology, Dayton, Ohio, May 2019 1Agenda➢ Introduction ➢ Results➢ Discussion➢ Current Investigations2Introduction3General Aviation Weather Accidents● 480 weather-related accidents from 2008-2017 (AOPA, 2019)● Majority of these accidents due to flying VFR into IMC4Aviation Weather Products5● Preflight weather planning is an essential step to determine if route is safe● Pilots must look at a variety of weather products to create a holistic pictureObservationsExample: SIGMETs6McSorley, 2018What could be causing problems?● Product interpretability7● Product usabilityInterpretability● Study conducted by Blickensderfer et al. (2017) tested pilots on their aviation weather knowledge and product interpretability● 95 questions○ 12 SIGMET (Cronbach’s α = .67)○ 5 Surface Prognostic Chart (Cronbach’s α = .59)○ 8 Winds Aloft (Cronbach’s α = .61)● Results found that pilots scored highest on Winds Aloft, average on Surface Prognostic Charts, and poor on SIGMETs 8● A modified System Usability Scale was used to assess different aviation weather products (Remy, 2017)● SUS is used to evaluate perceived usability on a 100-point scale (Brooke, 1986) ● Results indicated ○ Winds Aloft = 74○ Surface Prognostic Charts = 68.63○ SIGMETs = 64.139Usability Analysis(Bangor et al., 2009)1. I think that I would like to use this weather information frequently on the Aviation Weather Center website.2. I found the weather information unnecessarily complex on the Aviation Weather Center website.3. I thought the weather information was easy to use on the Aviation Weather Center website.4. I think that I would need the support of a technical person to be able to use this weather information on the Aviation Weather Center website.5. I found the various functions in this weather information were well integrated on the Aviation Weather Center website.6. I thought there was too much inconsistency in using this weather information on the Aviation Weather Center website.7. I would imagine that most people would learn to use this weather information very quickly on the Aviation Weather Center website.8. I found the weather information very cumbersome to use on the Aviation Weather Center website.9. I felt very confident using the weather information on the Aviation Weather Center website.10. I needed to learn a lot of things before I could get going with this weather information on the Aviation Weather Center website.10SUSPurposeInvestigate whether the perceived usability ratings in Remy (2017) are comparable to product interpretability performance scores (Blickensderfer et al., 2017)11Results12ParticipantsBlickensderfer et al., 2017● 204 pilots● Mean Age = 22.5 ± 2.57● Mean Flight Hours = 201.4 13Pilot Certificate and Rating Remy, 2017● 20 pilots● Mean Age = 27.4 ± 9.6● Mean Flight Hours = 674.4Blickensderfer et al., 2017 ResultsOne-way repeated measures ANOVA ● Wilks’ Λ = 0.539, F (2, 202) = 86.33, p > 0.01, partial η ² = 0.46 14Winds AloftSurface PrognosticSIGMETComparison of Blickensderfer et al. (2017) and Remy (2017) datasets15● Both datasets trend in the same direction● No access to usability data to actually conduct statistical tests● Higher usability scores seem to parallel higher interpretability scoresDiscussion16Discussion Results Summary: Interpretability of aviation weather products is comparable to perceived usability in a similar study  Limitation: Two different samples Difference in sample size Don’t have access to dataset from Remy (2017) Next Steps: Identify specific usability characteristics of these weather products to promote understanding of the display and information provided Conclusion: Improving usability may improve interpretability of aviation weather products17Current Lab Investigations18Questions?19ReferencesBangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3), 114-123.Brooke, J. (1986). System usability scale (SUS): a quick-and-dirty method of system evaluation user information. Reading, UK: Digital Equipment Co Ltd, 43.Noaa, & National Weather Service. (2013, March 15). AWC - Aviation Weather Center. Retrieved from https://aviationweather.gov/Remy, B. (2017). Exploring Usability in Web-Based Aviation Weather: An Assessment of the Aviation Weather Center Website (Master’s Thesis).Weather-Related Accident Rate. (2017, November 12). Retrieved from https://www.aopa.org/Training-and-Safety/Air-Safety-Institute/Accident-Analysis/WeatherGraphics created in Piktochart20

Exploring Perceived Usability and Interpretability of Aviation Weather Products Among GA Pilots

https://commons.erau.edu/cgi/viewcontent.cgi?article=1010&context=ga-wx-display-interpretation

Exploring Perceived Usability and Interpretability of Aviation Weather Products Among GA Pilots

Abstract

Similar works

Full text

Available Versions

Embry-Riddle Aeronautical University