The Japan Aerospace Exploration Agency (JAXA) has developed a Crew Resource Management (CRM) Skills measurement method that includes a Threat and Error Management (TEM) concept and identifies a crew’s level of CRM Skills by the way in which they manage human errors and threats. To validate the method, a CRM Skills measurement experiment was carried out by four raters using Line Oriented Flight Training (LOFT) scenarios. To increase inter-rater reliability, the raters collated their results to develop “True Scores”. The experiment identified factors contributing to individual scoring differences between the raters and provided information for improving the CRM Skills rating sheet, inter-rater reliability training and LOFT scenarios
