Indexing Dynamic Collective Constructs Using Computer-Aided Text Analysis: Construct Validity Evidence and Illustrations Featuring Team Processes

Organizational processes have been widely recognized as both multilevel and dynamic, yet traditional methods of measurements limit our ability to model and understand such phenomena. Featuring a popular model of team processes advanced by Marks et al. (2001), we illustrate a method to use individuals’ communications as construct valid unobtrusive measures of collective constructs occurring over time. Thus, the purpose of this investigation is to develop computer-aided text analysis (CATA) techniques that can score members’ communications into valid team process measures. We apply a deductive content validitybased method to construct CATA dictionaries for Marks et al.’s dimensions. We then demonstrate their convergent validity with subject matter experts’ (SMEs) hand-coded team communications and different SMEs’ behaviorally anchored rating scales based on video recordings of team interactions, using multitrait– multimethod analyses in two samples. Using a third sample of paramedics performing a high-fidelity mass casualty incident exercise, we further demonstrate the convergent validity of the CATA and SME scorings of communications. We then model the relationships among processes across episodes using all three samples. Next, we test criterion-related validity using a longitudinal dual-discontinuous change growth modeling design featuring the paramedic CATA-scored team processes as related to a dynamic performance criterion. Finally, we integrate behavioral data from wearable sensor badges to illustrate how CATA can be scored at the individual level and then leveraged to model dynamic networks of team interactions. Implications, limitations, directions for the future research, and guidelines for the application of these techniques to other collective constructs are discussed

Geological tasks during HI-SEAS planetary analog mission simulations, Mauna Loa, Hawai\u27i

The Hawai\u27i Space Exploration Analog and Simulation (HI-SEAS) project is a NASA-funded research program operating long-duration planetary analog surface mission simulations on Mauna Loa volcano, Hawai\u27i. During missions lasting from 4 to 12 months, crews of six analog astronaut participants live and work in an isolated habitat, communicating with a remote mission support team via a 20-min time delay. The main purpose of HI-SEAS is to study team effectiveness and adaptation over time in isolated, confined, and high autonomy mission scenarios. Among other duties, Crewmembers are tasked with routinely conducting geological fieldwork requiring extravehicular activity (EVA) in the environment surrounding the habitat. They must determine how they will accomplish these tasks, conduct the tasks themselves, and report results by a due date set by the remote science team. Here we describe the design, task parameters, and performance outcomes of HI-SEAS geology EVA tasks from four 6-person missions. We describe the assigned tasks, how the crews carried out their assignments, and the results of their work in terms of six performance metrics for each task: 1) number of days required for completion; 2) number of crewmembers participating; 3) number of EVAs required; 4) total EVA time required; 5) difference between required and planned EVA times; and 6) performance score evaluating how well crew met the task objective. We find weak evidence of a decrease in geology task performance during the third quarter of missions M2-M4. This dataset provides insights into varying crew performance over time for different mission durations