Integrating the First Person View and the Third Person View Using a Connected VR-MR System for Pilot Training

Virtual reality (VR)-based flight simulator provides pilots the enhanced reality from the first-person view. Mixed reality (MR) technology generates effective 3D graphics. The users who wear the MR headset can walk around the 3D graphics to see all its 360 degrees of vertical and horizontal aspects maintaining the consciousness of real space. A VR flight simulator and an MR application were connected to create the capability of both first-person view and third-person view for a comprehensive pilot training system. This system provided users the capability to monitor the aircraft progress along the planned path from the third-person view as well as how the aircraft pilot follows the desired flight procedures in the cockpit from the first-person view. Six flight instructors provided their feedback after trying the prototype functions. The three flight instructors with more than 1,000 flight hours gave negative feedback whereas the three instructors with less than 1,000 flight hours were more open to the technologies. The effectiveness of MR-based real-time monitoring and post-debriefing system is yet to be clear. However, the test results included the potentials of the prototype for future improvement based on MR technology’s flexibility

Novel Mixed Reality Use Cases for Pilot Training

This study explored novel mixed reality (MR) use cases for pilot training using a mix of methods rooted in the general innovation theory of dynamic capabilities. The aim was to identify areas of improvement for various aspects of the flight training based on MR, in a socially and economically sustainable manner. Multiple surveys and workshops have been conducted with flight instructors, administrative staff, pilots and student pilots. The main result of this study is a systematic identification of the three most promising MR use cases: interactive theory training, cockpit procedure, and outside check training. These results are important because they inform the development of technical didactic tools for pilot training. The applicability of MR technologies to accommodate diverse user needs and preferences is addressed, while also considering aspects of economical sustainability

Human Factors in Aviation Maintenance: Understanding Errors, Management, and Technological Trends

Aircraft maintenance and inspection are complex systems that work on a time-based schedule and require teamwork of different professionals to maintain the airworthiness of aircraft. Errors in maintenance and inspection processes cause in-flight engine shutdowns, flight delays, flight cancellation, sometimes resulting in accidents and incidents that cause significant economic consequences. Due to the substantial impact on both safety and financial aspects of an air carrier, this paper focuses on hangar maintenance as the work is carried out across several shifts by different technicians, addressing various human factor issues that contribute to errors. The paper will also briefly discuss shift work and the health problems of maintenance technicians, human factor issues affecting maintenance, the significance of understanding human factor models, and the impact of maintenance and inspection errors with case studies, particularly aircraft accidents predominantly caused by human factor issues. Additionally, the paper also explores recent advances and trends in aircraft maintenance technologies, highlighting their transformative potential through predictive maintenance, robotics, augmented and virtual reality, big data analytics, blockchain, and additive manufacturing. These technologies promise enhanced efficiency, safety, and effectiveness for maintenance practices. The paper concludes by presenting insights into error management methods and providing recommendations for future research. By integrating traditional insights with cutting-edge technological considerations, this comprehensive analysis aims to significantly contribute to the evolution of safety protocols and practices within the aviation maintenance domain

IoT and Wearable Devices-Enhanced Information Provision of AR Glasses: A Multi-Modal Analysis in Aviation Industry

While Augmented Reality (AR) glasses are now instrumental in industries for delivering work-related information, the current one-size-fits-all information provision of AR glasses fails to cater to diverse workers’ needs and environmental conditions. We propose a framework for harnessing Internet of thing (IoT) and wearable technology to improve the adaptability and customization of information provision by AR. As a preliminary exploration, this short paper develops a multi-modal data processing system for work performance classification in the aviation industry. Using machine learning algorithms for multi-modal feature extraction and classifier construction, this framework provides a more objective and consistent evaluation of work performance compared to single-modal approaches. The proposed analytics architecture can provide valuable insights for other industries struggling to implement IoT and mixed reality

Development of a multi-directional manoeuvre for unified handling qualities investigation

A slalom and alignment tracking manoeuvre was developed for multi-directional handling qualities analysis of large transport aircraft in simulation environments. The manoeuvre is defined and scaled as a function of aircraft characteristics, flight conditions using a simple set of mathematical models. Throughout the manoeuvre, the trajectory and overall performances are monitored at a set of gross position and alignment control checkpoints methodically distributed and sized to buoy the task and allow handling qualities analysis based on Cooper Harper Ratings and quantitative data analysis. Initial tests have shown that the manoeuvre sizing method led to feasible manoeuvres at multiple points of the flight envelope of a large civil transport aircraft. The manoeuvre capability to highlight desirable and undesirable handling qualities was also highlighted based on the initial findings for a couple of commercial large transport aircraft, a high aspect ratio wing and in-flight folding wingtip aircraft concepts. The relevance and applicability of the manoeuvre for multi-directional studies are discussed and compared against a more conventional offset landing manoeuvre. Finally, the potential use of the manoeuvre for different aircraft type and test flight is also suggested based on augmented reality technology

Systems Engineering

The book "Systems Engineering: Practice and Theory" is a collection of articles written by developers and researches from all around the globe. Mostly they present methodologies for separate Systems Engineering processes; others consider issues of adjacent knowledge areas and sub-areas that significantly contribute to systems development, operation, and maintenance. Case studies include aircraft, spacecrafts, and space systems development, post-analysis of data collected during operation of large systems etc. Important issues related to "bottlenecks" of Systems Engineering, such as complexity, reliability, and safety of different kinds of systems, creation, operation and maintenance of services, system-human communication, and management tasks done during system projects are addressed in the collection. This book is for people who are interested in the modern state of the Systems Engineering knowledge area and for systems engineers involved in different activities of the area. Some articles may be a valuable source for university lecturers and students; most of case studies can be directly used in Systems Engineering courses as illustrative materials

Systematic Review of Intelligent Tutoring Systems for Hard Skills Training in Virtual Reality Environments

Advances in immersive virtual reality (I-VR) technology have allowed for the development of I-VR learning environments (I-VRLEs) with increasing fidelity. When coupled with a sufficiently advanced computer tutor agent, such environments can facilitate asynchronous and self-regulated approaches to learning procedural skills in industrial settings. In this study, we performed a systematic review of published solutions involving the use of an intelligent tutoring system (ITS) to support hard skills training in an I-VRLE. For the seven solutions that qualified for the final analysis, we identified the learning context, the implemented system, as well as the perceptual, cognitive, and guidance features of the utilized tutoring agent. Generally, the I-VRLEs emulated realistic work environments or equipment. The solutions featured either embodied or embedded tutor agents. The agents’ perception was primarily based on either learner actions or learner progress. The agents’ guidance actions varied among the solutions, ranging from simple procedural hints to event interjections. Several agents were capable of answering certain specific questions. The cognition of the majority of agents represented variations on branched programming. A central limitation of all the solutions was that none of the reports detailed empirical studies conducted to compare the effectiveness of the developed training and tutoring solutions.Peer reviewe