Design Concepts for Automating Maintenance Instructions

This research task was performed under the Technology for Readiness and Sustainment (TRS) contract (F33615-99-D-6001) for the Air Force Research Laboratory (AFRL), Sustainment Logistics Branch (HESS) at Wright-Patterson AFB, OH. The period of performance spanned one year starting 29 January 1999. The objective of this task was to develop and demonstrate a framework that can support the automated validation and verification of aircraft maintenance Technical Orders (TOs). The research team examined all stages ofTO generation to determine which tasks most warranted further research. From that investigation, validation and verification of appropriate, safe, and correct procedure steps emerged as the primary research target. This process would be based on available computer-aided design (CAD) data, procedure step ordering from existing sources, and human models. This determination was based on which tasks could yield the greatest impact on the authoring process and offer the greatest potential economic benefits. The team then developed a research roadmap and outlined specific technologies to be addressed in possible subsequent Air Force research tasks. To focus on the potential technology integration of the validation and verification component into existing or future TO generation procedures, we defined a demonstration scenario. Using the Front Uplock Hook assembly from an F/A-18 as the subject, we examined task procedure steps and failures that could be exposed by automated validation tools. These included hazards to personnel, damage to equipment, and incorrect disassembly order. Using the Parameterized Action Representation (PAR) developed on previous projects for actions and equipment behaviors, we characterized procedure steps and their positive and negative consequences. Finally, we illustrated a hypothetical user interface extension to a typical Interactive Electronic Technical Manual (IETM) authoring system to demonstrate how this process might appear to the TO author

Development Of Knowledge-Based Power System Protection Design Courseware

Power system protection is a relatively specialized topic that encompasses a large variety of areas from generator protection at the source side to as far as motor protection at the load end. However, the sources for a complete collection of information on power system protections comprising the generator protection, station bus protection, line protection, transformer protection and motor protection are obviously scattered. Having been in the engineering consultancy business for years, it is realized that finding even a fundamental knowledge of a particular protection scheme in the line protection area in a convenient way is somewhat cumbersome. There isn't any interactive multimedia application software that can offer a complete compilation of topics on various power system protections comprising not only theories but also some pertinent industry application recommendations. It is therefore the objective of the project to develop, using an expert system approach, an interactive multimedia courseware to serve as a computer-based training tool in power system protections by integrating technical theories, industrial application recommendations and some specific simulations by which the user has a wide range of choices for obtaining technical information on power system protection. The method involved in designing the courseware revolves around the approach of using an authoring expert system shell Macromedia Director. It provides the facility of blending the power system protection knowledge domain and interactivity knowledge

Intelligent tutoring systems for systems engineering methodologies

The general goal is to provide the technology required to build systems that can provide intelligent tutoring in IDEF (Integrated Computer Aided Manufacturing Definition Method) modeling. The following subject areas are covered: intelligent tutoring systems for systems analysis methodologies; IDEF tutor architecture and components; developing cognitive skills for IDEF modeling; experimental software; and PC based prototype

Large Language Models for in Situ Knowledge Documentation and Access With Augmented Reality

Augmented reality (AR) has become a powerful tool for assisting operators in complex environments, such as shop floors, laboratories, and industrial settings. By displaying synthetic visual elements anchored in real environments and providing information for specific tasks, AR helps to improve efficiency and accuracy. However, a common bottleneck in these environments is introducing all necessary information, which often requires predefined structured formats and needs more ability for multimodal and Natural Language (NL) interaction. This work proposes a new method for dynamically documenting complex environments using AR in a multimodal, non-structured, and interactive manner. Our method employs Large Language Models (LLMs) to allow experts to describe elements from the real environment in NL and select corresponding AR elements in a dynamic and iterative process. This enables a more natural and flexible way of introducing information, allowing experts to describe the environment in their own words rather than being constrained by a predetermined structure. Any operator can then ask about any aspect of the environment in NL to receive a response and visual guidance from the AR system, thus allowing for a more natural and flexible way of introducing and retrieving information. These capabilities ultimately improve the effectiveness and efficiency of tasks in complex environments

BIM Assisted Design Process Automation for Pre-Engineered Buildings (PEB)

The effective adoption and implementation of Building Information Modeling (BIM) is still challenging for the construction industry. However, studies and reports show a significant increase in the rate of BIM implementation and adoption in mainstream construction activities over the last five years. In contrast, Pre-Engineered Building (PEB) construction, a specialized construction system which provides a very efficient approach for construction of primarily industrial buildings, has not seen the same uptake in BIM implementation and adoption. The thesis reviews the benefits and the main applications of BIM for the PEB industry as well as challenges of its practical implementation. To facilitate the implementation of BIM in the PEB industry, a BIM framework is adapted from Pre-fabrication (Pre-fab) industry and new workflows, process maps, and data-exchange strategies are developed. As the PEB industry traditionally makes significant use of automation in its design and fabrication process, accordingly this work investigates the technical challenges of incorporating automation into the proposed BIM process. Two new BIM concepts, “Planar Concept” and “Floating LOD”, are then developed and implemented as a solution to these challenges. To define the proper input/output criteria for automated BIM design processes, a numerical study was performed to identify an “Optimum LOD”. A software implementation embodying the research outcomes was developed to illustrate the feasibility of the results. Its step-by-step deployment is analyzed and discussed using an example industry PEB design project. Further, the impact of this work is extended by integrating the developed BIM framework and automated design process with wind engineering design activities and tools and procurement systems. The study concludes that the deployment of the proposed BIM framework could significantly address existing issues in project design through to operation processes found in the PEB industry. Also, the results indicate the developed concepts have the potential for supporting the application of automation in the other sectors of the general construction industry. This thesis is written using the Integrated Article format and includes various complementary studies

Augmented Reality in Industry 4.0

Since the origins of Augmented Reality (AR), industry has always been one of its prominent application domains. The recent advances in both portable and wearable AR devices and the new challenges introduced by the fourth industrial revolution (renowned as industry 4.0) further enlarge the applicability of AR to improve the productiveness and to enhance the user experience. This paper provides an overview on the most important applications of AR regarding the industry domain. Key among the issues raised in this paper are the various applications of AR that enhance the user's ability to understand the movement of mobile robot, the movements of a robot arm and the forces applied by a robot. It is recommended that, in view of the rising need for both users and data privacy, technologies which compose basis for Industry 4.0 will need to change their own way of working to embrace data privacy

SEPEC conference proceedings: Hypermedia and Information Reconstruction. Aerospace applications and research directions

Papers presented at the conference on hypermedia and information reconstruction are compiled. The following subject areas are covered: real-world hypermedia projects, aerospace applications, and future directions in hypermedia research and development