Discrete event simulation and virtual reality use in industry: new opportunities and future trends

This paper reviews the area of combined discrete event simulation (DES) and virtual reality (VR) use within industry. While establishing a state of the art for progress in this area, this paper makes the case for VR DES as the vehicle of choice for complex data analysis through interactive simulation models, highlighting both its advantages and current limitations. This paper reviews active research topics such as VR and DES real-time integration, communication protocols, system design considerations, model validation, and applications of VR and DES. While summarizing future research directions for this technology combination, the case is made for smart factory adoption of VR DES as a new platform for scenario testing and decision making. It is put that in order for VR DES to fully meet the visualization requirements of both Industry 4.0 and Industrial Internet visions of digital manufacturing, further research is required in the areas of lower latency image processing, DES delivery as a service, gesture recognition for VR DES interaction, and linkage of DES to real-time data streams and Big Data sets

Contractors as modern Master Builders: Virtual Design and Construction as an enabler of meaningful experiences to project teams for achieving optimized substation management

Effective substation management should include engineering and construction costs. While the construction process has to be methodically planned and sequenced to achieve optimized construction costs, substation designers play a vital role for delivering cost-efficient substations. Integrated design and construction has been proposed as a way to achieve effective project management, which historically viewed, was a responsibility of a “master builder”, thus causing Contractors to identify themselves as “master builders”. As EPC is a highly competitive arena, Contractors are looking for ways to differentiate themselves from their competitors. Some are turning to 3D technologies, while others turn to the design-construction integration. Virtual Master Builder (VMB) supports both 3D technologies and the designconstruction integration. Due to a global shortage of worldwide available expertise, Contractors turn to education and training of their employees. While education aims at providing basic skills, training aims to provide the skill necessary to do the job. This paper examines these basic skills as a part of personal mastery before defining organizational learning as a key organizational competence. Physical Virtuality realm is seen as a fruitful ground for staging of memorable and transformational experiences leading towards achieving “accelerated learning”, and especially 4D models as representations of a “space-time” environment. The project case of Skopje 4 SS 380/110 kV rehabilitation is given as an example of 4D models usage. Project Engineering is seen as a middle ground between engineering and management in order to achieve goals of effective substation management and cost-efficient substation solutions. Project teams are seen as Virtual Design and Construction (VDC) users to achieve these goals

Towards a cyber physical system for personalised and automatic OSA treatment

Obstructive sleep apnea (OSA) is a breathing disorder that takes place in the course of the sleep and is produced by a complete or a partial obstruction of the upper airway that manifests itself as frequent breathing stops and starts during the sleep. The real-time evaluation of whether or not a patient is undergoing OSA episode is a very important task in medicine in many scenarios, as for example for making instantaneous pressure adjustments that should take place when Automatic Positive Airway Pressure (APAP) devices are used during the treatment of OSA. In this paper the design of a possible Cyber Physical System (CPS) suited to real-time monitoring of OSA is described, and its software architecture and possible hardware sensing components are detailed. It should be emphasized here that this paper does not deal with a full CPS, rather with a software part of it under a set of assumptions on the environment. The paper also reports some preliminary experiments about the cognitive and learning capabilities of the designed CPS involving its use on a publicly available sleep apnea database

SISTEMAS DE SIMULACIÓN EN REALIDAD VIRTUAL PARA ENTRENAMIENTO DE SUBESTACIONES ELÉCTRICAS – UN PANORAMA GENERAL (VIRTUAL REALITY SIMULATION SYSTEMS FOR ELECTRICAL SUBSTATION TRAINING - AN OVERVIEW)

Resumen Este trabajo tiene por objetivo la revisión de artículos desarrollados en la última década, en materia de simuladores de subestaciones eléctricas en realidad virtual, con propósitos de entrenamiento laboral y/o pedagógico. Esta revisión permite tener una visión del panorama más reciente, con respecto al tema estudiado, pues no existen revisiones lo suficientemente recientes para considerarlas actuales. Se hace una clasificación de los trabajos a analizar, realizando una búsqueda de trabajos relacionados en la última década, identificación de los más relevantes y lectura a fondo de estos últimos. Se identifican y detallan las características que destacan cono mínimas en los proyectos, la libertad de interacción del usuario, la evaluación de los aprendices, el impacto de la inmersión y los entornos colaborativos. Se discute la importancia de la definición del usuario final, de modo que se tome en cuenta su experiencia, lo cual repercute indiscutiblemente en los resultados finales de aprendizaje. Palabras Claves: Capacitación, entrenamiento, realidad virtual, subestaciones eléctricas. Abstract The purpose of this paper is to review articles developed in the last decade on virtual reality electrical substation simulators for job training and/or pedagogical purposes. This review allows us to have a vision of the most recent panorama, with respect to the subject studied, since there are no reviews recent enough to be considered current. A classification of the works to be analyzed is made, carrying out a search of related works in the last decade, identification of the most relevant ones and in-depth reading of the latter. The characteristics that stand out as minimum in the projects, the user's freedom of interaction, the evaluation of the learners, the impact of immersion and collaborative environments are identified and detailed. The importance of defining the end user is discussed, so that their experience is considered, which undoubtedly has an impact on the final learning results. Keywords: Electrical substations, training, virtual reality

RealTHASC—a cyber-physical XR testbed for AI-supported real-time human autonomous systems collaborations

Today’s research on human-robot teaming requires the ability to test artificial intelligence (AI) algorithms for perception and decision-making in complex real-world environments. Field experiments, also referred to as experiments “in the wild,” do not provide the level of detailed ground truth necessary for thorough performance comparisons and validation. Experiments on pre-recorded real-world data sets are also significantly limited in their usefulness because they do not allow researchers to test the effectiveness of active robot perception and control or decision strategies in the loop. Additionally, research on large human-robot teams requires tests and experiments that are too costly even for the industry and may result in considerable time losses when experiments go awry. The novel Real-Time Human Autonomous Systems Collaborations (RealTHASC) facility at Cornell University interfaces real and virtual robots and humans with photorealistic simulated environments by implementing new concepts for the seamless integration of wearable sensors, motion capture, physics-based simulations, robot hardware and virtual reality (VR). The result is an extended reality (XR) testbed by which real robots and humans in the laboratory are able to experience virtual worlds, inclusive of virtual agents, through real-time visual feedback and interaction. VR body tracking by DeepMotion is employed in conjunction with the OptiTrack motion capture system to transfer every human subject and robot in the real physical laboratory space into a synthetic virtual environment, thereby constructing corresponding human/robot avatars that not only mimic the behaviors of the real agents but also experience the virtual world through virtual sensors and transmit the sensor data back to the real human/robot agent, all in real time. New cross-domain synthetic environments are created in RealTHASC using Unreal Engine™, bridging the simulation-to-reality gap and allowing for the inclusion of underwater/ground/aerial autonomous vehicles, each equipped with a multi-modal sensor suite. The experimental capabilities offered by RealTHASC are demonstrated through three case studies showcasing mixed real/virtual human/robot interactions in diverse domains, leveraging and complementing the benefits of experimentation in simulation and in the real world

Distributed situation awareness: Advances in theory, measurement and application to team work

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Situation Awareness (SA) is critical commodity for teams working in complex sociotechnical systems and is thus a fundamental consideration in collaborative system design and evaluation. Despite this, SA remains predominantly an individual construct, with the majority of models and measures focused on SA from an individual perspective. In comparison, team SA has received much less attention and this thesis argues that further work is required in the area both in relation to the development of theoretical perspectives and of valid measures, and to the development of guidelines for system, training and procedure design. This thesis advances team SA theory and measurement by further investigating a recently proposed model of SA in complex collaborative environments, the Distributed Situation Awareness (DSA) approach, and by testing a new methodology for representing and analysing DSA during real world collaborative activities. A review of SA theory and SA measurement approaches is presented. Following this, the DSA theory and propositional network assessment methodology are outlined and a series of case studies on DSA during real world collaborative activities in the military and civil domains are presented. The findings are subsequently used to explore the concept of DSA and the sub-concepts of compatible and transactive SA. In conclusion, a model of DSA in complex collaborative systems is presented, and a series of system design guidelines for supporting DSA are outlined

Incident Notification Process as BPaaS for Electicity Supply Systems

Business Process Management (BPM) systems have been deployed in many large organizations to improve their business effectiveness and efficiency. Cloud based BPM systems have provided SMEs using BPM in a pay-per-use manner. Previous work has focused on looking at cloud based BPM from the perspectives of distribution of data, activity or/and business engine and related issues, such as scalability of system, security of data, distribution of data and activities. To achieve business agility business process collaboration needs to seamlessly connect local BPM systems and cloud based BPM systems. In this paper we look at BPM in the cloud from a new user perspective, how process models can be handled in the cloud for the fast pace of change of business collaborations. The paper proposes a distribution solution in which at the design time, the shared process model can be discovered from a process repository, and adapted to local needs; at run-time a process is distributed. A real world case is used to explain our design and implementation. Collaborative process for incident notifications is built to work across different organizations

Collaborative, Trust-Based Security Mechanisms for a National Utility Intranet

This thesis investigates security mechanisms for utility control and protection networks using IP-based protocol interaction. It proposes flexible, cost-effective solutions in strategic locations to protect transitioning legacy and full IP-standards architectures. It also demonstrates how operational signatures can be defined to enact organizationally-unique standard operating procedures for zero failure in environments with varying levels of uncertainty and trust. The research evaluates layering encryption, authentication, traffic filtering, content checks, and event correlation mechanisms over time-critical primary and backup control/protection signaling to prevent disruption by internal and external malicious activity or errors. Finally, it shows how a regional/national implementation can protect private communities of interest and foster a mix of both centralized and distributed emergency prediction, mitigation, detection, and response with secure, automatic peer-to-peer notifications that share situational awareness across control, transmission, and reliability boundaries and prevent wide-spread, catastrophic power outages

Secure Control and Operation of Energy Cyber-Physical Systems Through Intelligent Agents

The operation of the smart grid is expected to be heavily reliant on microprocessor-based control. Thus, there is a strong need for interoperability standards to address the heterogeneous nature of the data in the smart grid. In this research, we analyzed in detail the security threats of the Generic Object Oriented Substation Events (GOOSE) and Sampled Measured Values (SMV) protocol mappings of the IEC 61850 data modeling standard, which is the most widely industry-accepted standard for power system automation and control. We found that there is a strong need for security solutions that are capable of defending the grid against cyber-attacks, minimizing the damage in case a cyber-incident occurs, and restoring services within minimal time. To address these risks, we focused on correlating cyber security algorithms with physical characteristics of the power system by developing intelligent agents that use this knowledge as an important second line of defense in detecting malicious activity. This will complement the cyber security methods, including encryption and authentication. Firstly, we developed a physical-model-checking algorithm, which uses artificial neural networks to identify switching-related attacks on power systems based on load flow characteristics. Secondly, the feasibility of using neural network forecasters to detect spoofed sampled values was investigated. We showed that although such forecasters have high spoofed-data-detection accuracy, they are prone to the accumulation of forecasting error. In this research, we proposed an algorithm to detect the accumulation of the forecasting error based on lightweight statistical indicators. The effectiveness of the proposed algorithms was experimentally verified on the Smart Grid testbed at FIU. The test results showed that the proposed techniques have a minimal detection latency, in the range of microseconds. Also, in this research we developed a network-in-the-loop co-simulation platform that seamlessly integrates the components of the smart grid together, especially since they are governed by different regulations and owned by different entities. Power system simulation software, microcontrollers, and a real communication infrastructure were combined together to provide a cohesive smart grid platform. A data-centric communication scheme was selected to provide an interoperability layer between multi-vendor devices, software packages, and to bridge different protocols together