Real time enhancement of operator's ergonomics in physical human - robot collaboration scenarios using a multi-stereo camera system

In collaborative tasks where humans work alongside machines, the robot's movements and behaviour can have a significant impact on the operator's safety, health, and comfort. To address this issue, we present a multi-stereo camera system that continuously monitors the operator's posture while they work with the robot. This system uses a novel distributed fusion approach to assess the operator's posture in real-time and to help avoid uncomfortable or unsafe positions. The system adjusts the robot's movements and informs the operator of any incorrect or potentially harmful postures, reducing the risk of accidents, strain, and musculoskeletal disorders. The analysis is personalized, taking into account the unique anthropometric characteristics of each operator, to ensure optimal ergonomics. The results of our experiments show that the proposed approach leads to improved human body postures and offers a promising solution for enhancing the ergonomics of operators in collaborative tasks

A gaze-contingent framework for perceptually-enabled applications in healthcare

Patient safety and quality of care remain the focus of the smart operating room of the future. Some of the most influential factors with a detrimental effect are related to suboptimal communication among the staff, poor flow of information, staff workload and fatigue, ergonomics and sterility in the operating room. While technological developments constantly transform the operating room layout and the interaction between surgical staff and machinery, a vast array of opportunities arise for the design of systems and approaches, that can enhance patient safety and improve workflow and efficiency. The aim of this research is to develop a real-time gaze-contingent framework towards a "smart" operating suite, that will enhance operator's ergonomics by allowing perceptually-enabled, touchless and natural interaction with the environment. The main feature of the proposed framework is the ability to acquire and utilise the plethora of information provided by the human visual system to allow touchless interaction with medical devices in the operating room. In this thesis, a gaze-guided robotic scrub nurse, a gaze-controlled robotised flexible endoscope and a gaze-guided assistive robotic system are proposed. Firstly, the gaze-guided robotic scrub nurse is presented; surgical teams performed a simulated surgical task with the assistance of a robot scrub nurse, which complements the human scrub nurse in delivery of surgical instruments, following gaze selection by the surgeon. Then, the gaze-controlled robotised flexible endoscope is introduced; experienced endoscopists and novice users performed a simulated examination of the upper gastrointestinal tract using predominately their natural gaze. Finally, a gaze-guided assistive robotic system is presented, which aims to facilitate activities of daily living. The results of this work provide valuable insights into the feasibility of integrating the developed gaze-contingent framework into clinical practice without significant workflow disruptions.Open Acces

a human in the loop cyber physical system for collaborative assembly in smart manufacturing

Abstract Industry 4.0 rose with the introduction of cyber-physical systems (CPS) and Internet of things (IoT) inside manufacturing systems. CPS represent self-controlled physical processes, having tight networking capabilities and efficient interfaces for human interaction. The interactive dimension of CPS reaches its maximum when defined in terms of natural human-machine interfaces (NHMI), i.e., those reducing the technological barriers required for the interaction. This paper presents a NHMI bringing the human decision-making capabilities inside the cybernetic control loop of a smart manufacturing assembly system. The interface allows to control, coordinate and cooperate with an industrial cobot during the task execution

Assessment of Human Performance in Industry 5.0 Research Via Eye-Tracking and Cognitive Biases

Manufacturing assembly is combining previously made components or subassemblies into a final finished product. The assembly process can be manual, hybrid, or fully automated. Human operators who are involved in assembly use their judgment to perform the process. They collaborate with the other work agents such as assembly machines, robots, smart technologies, and computer interfaces. The recent Industrial revolution, Industry 5.0, exploits human expertise in collaboration with efficient and accurate machines. Manufacturing facilities that feature Industry 5.0 work settings require higher expectations, higher accuracy, sustainability solutions, mass customization of products, more human involvement, and digital technologies in smart workstations. Given these features, the cognitive load exerted on human workers in this environment is continuously increasing, leading to the use of cognitive heuristics. Cognitive biases are getting more attention in the cognitive ergonomics field, to help understand the operational behavior of workers. Manufacturing facilities can integrate cognitive assistance systems to work in parallel with physical and sensorial assistance systems. Cognitive assistance systems help toward better work conditions for workers and better overall system performance. This research explores the impact of human thinking style and using a cognitive assistance system on workers\u27 cognitive load, bias-related human performance, and user satisfaction. This research presents the design and experimental implementation of a research framework based on a well-established three-layer model for implementing Industry 5.0 in manufacturing. The research framework was designed to apply the dual-system theory and cognitive assistance in Assembly 5.0. Two experiments are presented to show the effectiveness of the proposed research framework. A cognitive assistance system was designed and compared to a benchmark system from LEGO ® Company. Subjective and objective measures were used to assess the thinking style, cognitive load, bias-related human performance, and user satisfaction in Assembly 5.0. As Industry 5.0 requires higher expectations, higher accuracy, smart workstations, and higher complexity, cognitive assistance systems can reduce the cognitive load and maintain the work efficiency and user satisfaction. Therefore, this work is important to industry to expand the use of cognitive ergonomic tools and employ them for A5.0 workers\u27 benefits

Assessment of Human Performance in Industry 5.0 Research Via Eye-Tracking and Cognitive Biases

Manufacturing assembly is combining previously made components or subassemblies into a final finished product. The assembly process can be manual, hybrid, or fully automated. Human operators who are involved in assembly use their judgment to perform the process. They collaborate with the other work agents such as assembly machines, robots, smart technologies, and computer interfaces. The recent Industrial revolution, Industry 5.0, exploits human expertise in collaboration with efficient and accurate machines. Manufacturing facilities that feature Industry 5.0 work settings require higher expectations, higher accuracy, sustainability solutions, mass customization of products, more human involvement, and digital technologies in smart workstations. Given these features, the cognitive load exerted on human workers in this environment is continuously increasing, leading to the use of cognitive heuristics. Cognitive biases are getting more attention in the cognitive ergonomics field, to help understand the operational behavior of workers. Manufacturing facilities can integrate cognitive assistance systems to work in parallel with physical and sensorial assistance systems. Cognitive assistance systems help toward better work conditions for workers and better overall system performance. This research explores the impact of human thinking style and using a cognitive assistance system on workers\u27 cognitive load, bias-related human performance, and user satisfaction. This research presents the design and experimental implementation of a research framework based on a well-established three-layer model for implementing Industry 5.0 in manufacturing. The research framework was designed to apply the dual-system theory and cognitive assistance in Assembly 5.0. Two experiments are presented to show the effectiveness of the proposed research framework. A cognitive assistance system was designed and compared to a benchmark system from LEGO ® Company. Subjective and objective measures were used to assess the thinking style, cognitive load, bias-related human performance, and user satisfaction in Assembly 5.0. As Industry 5.0 requires higher expectations, higher accuracy, smart workstations, and higher complexity, cognitive assistance systems can reduce the cognitive load and maintain the work efficiency and user satisfaction. Therefore, this work is important to industry to expand the use of cognitive ergonomic tools and employ them for A5.0 workers\u27 benefits

Occupational health and safety issues in human-robot collaboration: State of the art and open challenges

Human-Robot Collaboration (HRC) refers to the interaction of workers and robots in a shared workspace. Owing to the integration of the industrial automation strengths with the inimitable cognitive capabilities of humans, HRC is paramount to move towards advanced and sustainable production systems. Although the overall safety of collaborative robotics has increased over time, further research efforts are needed to allow humans to operate alongside robots, with awareness and trust. Numerous safety concerns are open, and either new or enhanced technical, procedural and organizational measures have to be investigated to design and implement inherently safe and ergonomic automation solutions, aligning the systems performance and the human safety. Therefore, a bibliometric analysis and a literature review are carried out in the present paper to provide a comprehensive overview of Occupational Health and Safety (OHS) issues in HRC. As a result, the most researched topics and application areas, and the possible future lines of research are identified. Reviewed articles stress the central role played by humans during collaboration, underlining the need to integrate the human factor in the hazard analysis and risk assessment. Human-centered design and cognitive engineering principles also require further investigations to increase the worker acceptance and trust during collaboration. Deepened studies are compulsory in the healthcare sector, to investigate the social and ethical implications of HRC. Whatever the application context is, the implementation of more and more advanced technologies is fundamental to overcome the current HRC safety concerns, designing low-risk HRC systems while ensuring the system productivity

Benchmarking of Tools for User Experience Analysis in Industry 4.0

Abstract Industry 4.0 paradigm is based on systems communication and cooperation with each other and with humans in real time to improve process performances in terms of productivity, security, energy efficiency, and cost. Although industrial processes are more and more automated, human performance is still the main responsible for product quality and factory productivity. In this context, understanding how workers interact with production systems and how they experience the factory environment is fundamental to properly model the human interaction and optimize the processes. This research investigates the available technologies to monitor the user experience (UX) and defines a set of tools to be applied in the Industry 4.0 scenario to assure the workers' wellbeing, safety and satisfaction and improve the overall factory performance

Heuristic Theorizing in Software Development: Deriving Design Principles for Smart Glasses-based Systems

Design knowledge on smart glasses-based systems is scarce. Utilizing literature analysis on software development publications, insights from the design and implementation of four smart glasses-based systems and expert interviews, we elicited 16 design principles to provide guidance in the development of future service support systems. Heuristic Theorizing is an abductive Design Science Research method, hitherto far too little known or little noticed, which was applied to conduct the research. We contribute to theory and practice with applicable design principles to support the development of smart glasses-based systems. Phenomena known to have an impact on the adoption of smart glasses are addressed by these design principles

Process management of ergonomic workplace based on augmented reality principles

Ergonomics is an important element of managing performance and productivity in a company. Nowadays, the ergonomic parameters are set in line with the implementation of the Industry 4.0 concept. The paper highlights the link between virtual reality (VR) and augmented reality (AR), when combined with the traditional ergonomic procedure. Automation and digitization contribute to a significant extent to the creation of ergonomic workplaces and the elimination of the negative effects of non-ergonomic workplaces on people. The aim of the paper is to determine the essential elements of the system process approach to ergonomics management. This is achieved through an analysis of the current approaches from Industry 4.0 and a focus on the augmented reality approach. The backbone of the triple combination of "man-machine-environment" determines the ergonomic setting of work and the workplace. Subsequently, the presented case study examines the link between ergonomic workplace principles and data analytics for VR/AR technology. The scientific contribution of the paper lies in the discussion of the case study results, which is beneficial for the ergonomic design of workplaces. © 2022 Jan Holoči, & Felicita Chromjaková, and the Centre of Sociological Research, Poland