Enhancing depth cues with AR visualization for forklift operation assistance in warehouse.

With warehouse operations contributing to the major part of logistics, architects tend to utilize every inch of the space allocated to maximize the stacking space. Increasing the height of the aisles and narrowing down the aisle-aisle space are major design issues in doing so. Even though forklift manufacturing companies introduced high reach trucks and forklifts for narrow aisles, forklift operators face many issues while working with heavy pallets. This thesis focused on developing a systemthat uses Augmented Reality(AR) to aid forklift operators in performing their pallet racking and pick up tasks. It used AR technology to superimpose virtual cues over the real world specifying the pallets to be picked up and moved and also assist in operating the forklift using depth cues. This aims to increase the productivity of the forklift operators in the warehouse. Depth cues are overlaid on a live video feed from a camera attached to the front of the forklift which was displayed using a laptop to the participants. To evaluate the usability of the system designed, an experiment was conducted and the performance results and the feedback from the participants was evaluated. A remote controlled toy forklift was used to conduct the experiment and a motion tracking system was set-up to track the cab and pallet. Simple pallet handling tasks were designed for the participants and their performance and feedback was collected and analysed. This thesis shows how AR offers a simple and effecient solution for the problems faced by forklift operators while performing pallet handling tasks in warehouse

A CONCEPTUAL FRAMEWORK FOR MOBILE GROUP SUPPORT SYSTEMS

The rapid development of wireless communication and mobile devices has created a great opportunity to support mobile group coordination at a more efficient level than before. This article presents a framework for Mobile Group Support Systems (MGSS) that considers four dimensions: supporting whom, supporting what, where to support and how to support. A good MGSS design should take consideration with the characteristics of each dimension: the system should be able to support mobile users working jointly with members from multiple parties; using available and advanced mobile technology, the system should be able to support context freedom, context dependent, and ad hoc coordination under dynamic, uncertain, frequent disrupting, time and space stretched and fluid context. To meet these requirements, we discuss the issues related to three basic functions of MGSS: mobile communication, group coordination, and context awareness

Opportunities for using eye tracking technology in manufacturing and logistics: Systematic literature review and research agenda

Workers play essential roles in manufacturing and logistics. Releasing workers from routine tasks and enabling them to focus on creative, value-adding activities can enhance their performance and wellbeing, and it is also key to the successful implementation of Industry 4.0. One technology that can help identify patterns of worker-system interaction is Eye Tracking (ET), which is a non-intrusive technology for measuring human eye movements. ET can provide moment-by-moment insights into the cognitive state of the subject during task execution, which can improve our understanding of how humans behave and make decisions within complex systems. It also enables explorations of the subject’s interaction mode with the working environment. Earlier research has investigated the use of ET in manufacturing and logistics, but the literature is fragmented and has not yet been discussed in a literature review yet. This article therefore conducts a systematic literature review to explore the applications of ET, summarise its benefits, and outline future research opportunities of using ET in manufacturing and logistics. We first propose a conceptual framework to guide our study and then conduct a systematic literature search in scholarly databases, obtaining 71 relevant papers. Building on the proposed framework, we systematically review the use of ET and categorize the identified papers according to their application in manufacturing (product development, production, quality inspection) and logistics. Our results reveal that ET has several use cases in the manufacturing sector, but that its application in logistics has not been studied extensively so far. We summarize the benefits of using ET in terms of process performance, human performance, and work environment and safety, and also discuss the methodological characteristics of the ET literature as well as typical ET measures used. We conclude by illustrating future avenues for ET research in manufacturing and logistics

Simulation-Based Countermeasures Towards Accident Prevention : Virtual Reality Utilization in Industrial Processes and Activities

Despite growing industrial interests in fully immersive virtual reality (VR) applications for safety countermeasures, there is scanty research on the subject in the context of accident prevention during manufacturing processes and plant maintenance activities. This dissertation aims to explore and experiment with VR for accident prevention by targeting three workplace safety countermeasures: fire evacuation drills, hazard identification and risk assessments (HIRA), and emergency preparedness and response (EPR) procedures. Drawing on the virtual reality accident causation model (VR-ACM) (i.e., 3D modelling and simulation, accident causation, and safety drills) and the fire evacuation training model, two industrial 3D simulation models were utilized for the immersive assessment and training. These were a lithium-ion battery (LIB) manufacturing factory and a gas power plant (GPP). In total, five studies (publications) were designed to demonstrate the potential of VR in accident prevention during the manufacturing processes and maintenance activities at the facility conceptual stages. Two studies were with the LIB factory simulation to identify inherent hazards and assess risks for redesigning the factory to ensure workplace safety compliance. The other three studies constituted fire hazard identifications, emergency evacuations and hazard control/mitigations during the maintenance activity in the GPP simulation. Both study models incorporated several participants individually immersed in the virtual realm to experience the accident phenomena intuitively. These participants provided feedback for assessing the research objectives. Results of the studies indicated that several inherent hazards in the LIB factory were identified and controlled/mitigated. Secondly, the GPP experiment results suggested that although the maintenance activity in the virtual realm increased the perception of presence, a statistically significant delay was recorded at the pre-movement stage due to the lack of situational safety awareness. Overall, the study demonstrates that participants immersed in a VR plant maintenance activity and manufacturing factory process simulation environments can experience real-time emergency scenarios and conditions necessary for implementing the essential safety countermeasures to prevent accidents.Vaikka kiinnostus virtuaalitodellisuuden (VR) käyttöön turvallisuuden varotoimissa teollisuudessa on kasvanut, tutkimuksia ei ole juurikaan tehty onnettomuuksien ehkäisystä valmistus- ja kunnossapitotoiminnassa. Tämän väitöskirjan tavoitteena on tutkia ja kokeilla VR:ää tapaturmien ehkäisyssä kohdistuen kolmeen työpaikan turvallisuuden varotoimeen: paloharjoitukset, riskien arvioinnit sekä hätätilanteiden valmiusmenettelyt ja toimintasuunnitelmat (EPR). Kokemuksellisessa ja uppouttavassa koulutuksessa hyödynnettiin kahta teollisuuden 3D-simulointimallia, jotka nojautuvat virtuaalitodellisuuden onnettomuuksien aiheutumismalliin (VR-ACM) (eli 3D-mallinnus- ja simulointi, onnettomuussyy- ja turvallisuuskoulutus) sekä paloharjoitusmalliin. Nämä 3D-simulointimallit ovat litiuminoniakkuja (LIB) valmistava tehdas, joka rakennettiin Visual Components 3D-simulointiohjelmistolla (versio 4.0) ja kaasuvoimala (GPP) Unrealin reaaliaikaisella pelimoottorilla (versio 4.2). Yhteensä viisi tutkimusta (julkaisua) suunniteltiin havainnollistamaan VR:n potentiaalia tapaturmien ehkäisyssä valmistusprosessin layout-suunnittelun ja tehtaan konseptivaiheissa tehtävän kunnossapidon aikana. Kaksi tutkimusta tehtiin LIB-tehdassimulaatiolla vaarojen tunnistamiseksi sekä riskien arvioimiseksi. Tutkimukset tehtiin tehtaan uudelleensuunnittelua varten, työturvallisuuden noudattamisen varmistamiseksi. Muut kolme tutkimusta käsittelevät palovaaran tunnistamista, hätäevakuointia ja riskien vähentämistä huoltotoiminnan aikana GPP-simulaatiossa. Molemmissa tutkimusmalleissa oli useita virtuaalimaailmaan uppoutuneita osallistujia, jotka saivat kokea onnettomuudet yksilöllisesti ja intuitiivisesti. Osallistujat antoivat palautetta kokeen jälkeisessä kyselyssä. Kyselyn tuloksien avulla LIB-tehtaassa tunnistettiin ja lievennettiin useita vaaroja. GPP-kokeilun tulokset viittasivat siihen, että vaikka ylläpitotoiminta virtuaalimaailmassa lisäsi teleläsnäoloa, tilastollisesti merkittävä viive kirjattiin liikettä edeltävässä vaiheessa turvallisuustietoisuuden puuteen vuoksi. Kaiken kaikkiaan tutkimus osoittaa, että VR-laitoksen kunnossapitotoimintaan ja tuotantotehtaan prosessisimulaatioympäristöihin uppoutuvat osallistujat voivat kokea reaaliaikaisia hätäskenaarioita ja olosuhteita, jotka ovat välttämättömiä olennaisten turvallisuustoimien toteuttamiseksi.fi=vertaisarvioitu|en=peerReviewed

Augmented reality in support of intelligent manufacturing – A systematic literature review

Industry increasingly moves towards digitally enabled ‘smart factories’ that utilise the internet of things (IoT) to realise intelligent manufacturing concepts like predictive maintenance or extensive machine to machine communication. A core technology to facilitate human integration in such a system is augmented reality (AR), which provides people with an interface to interact with the digital world of a smart factory. While AR is not ready yet for industrial deployment in some areas, it is already used in others. To provide an overview of research activities concerning AR in certain shop floor operations, a total of 96 relevant papers from 2011 to 2018 are reviewed. This paper presents the state of the art, the current challenges, and future directions of manufacturing related AR research through a systematic literature review and a citation network analysis. The results of this review indicate that the context of research concerning AR gets increasingly broader, especially by addressing challenges when implementing AR solutions.No funding was received

Improving Chemical Plant Safety Training Using Virtual Reality

The chemical engineering industry often requires people to work in hazardous environments and to operate complicated equipment which often limits the type of training that be carried out on site. The daily job of chemical plant operators is becoming more demanding due to the increasing plant complexity together with increasing requirements on plant safety, production capacity, product quality and cost effectiveness. The importance of designing systems and environments that are as safe as possible to educate and train personnel is vital for the chemical process industries. Virtual reality offers the potential to expose personnel to hazardous situations in a safe, highly visual and interactive manner. Virtual reality has been proposed as a technological breakthrough that holds the power to facilitate learning. The ability to visualise complex and dynamic systems involving personnel, equipment and layouts during any real operation is a potential advantage of such an approach. Virtual reality and multimedia training is commonly used in many industries, aiding understanding and memory retention and creating a more interactive learning experience. Four desktop virtual reality training environments were developed for this research which highlighted issues related to chemical process dynamic simulation and plant safety. The pump training system is a virtual reality environment, which was built using the SAFE-VR virtual engine, to train personnel to operate two centrifugal pumps. The virtual hazard spotting exercise focuses on improving the users' safety awareness of electrical and occupational hygiene hazards. The virtual boiler plant is a complicated and high detailed virtual training environment, which is characterised by its flexibility and by a real time dynamic simulation of the steam generation chemical process. The virtual flooding and gas absorption experiment was based on an undergraduate laboratory experiment for the Chemical Engineering degree course at the University of Nottingham, focusing primarily on training and safety issues of students using the equipment. The dynamic features of the virtual absorption column simulation give high level of realism in the virtual environment

Improving Chemical Plant Safety Training Using Virtual Reality

The chemical engineering industry often requires people to work in hazardous environments and to operate complicated equipment which often limits the type of training that be carried out on site. The daily job of chemical plant operators is becoming more demanding due to the increasing plant complexity together with increasing requirements on plant safety, production capacity, product quality and cost effectiveness. The importance of designing systems and environments that are as safe as possible to educate and train personnel is vital for the chemical process industries. Virtual reality offers the potential to expose personnel to hazardous situations in a safe, highly visual and interactive manner. Virtual reality has been proposed as a technological breakthrough that holds the power to facilitate learning. The ability to visualise complex and dynamic systems involving personnel, equipment and layouts during any real operation is a potential advantage of such an approach. Virtual reality and multimedia training is commonly used in many industries, aiding understanding and memory retention and creating a more interactive learning experience. Four desktop virtual reality training environments were developed for this research which highlighted issues related to chemical process dynamic simulation and plant safety. The pump training system is a virtual reality environment, which was built using the SAFE-VR virtual engine, to train personnel to operate two centrifugal pumps. The virtual hazard spotting exercise focuses on improving the users' safety awareness of electrical and occupational hygiene hazards. The virtual boiler plant is a complicated and high detailed virtual training environment, which is characterised by its flexibility and by a real time dynamic simulation of the steam generation chemical process. The virtual flooding and gas absorption experiment was based on an undergraduate laboratory experiment for the Chemical Engineering degree course at the University of Nottingham, focusing primarily on training and safety issues of students using the equipment. The dynamic features of the virtual absorption column simulation give high level of realism in the virtual environment