Enhancing depth cues with AR visualization for forklift operation assistance in warehouse.

With warehouse operations contributing to the major part of logistics, architects tend to utilize every inch of the space allocated to maximize the stacking space. Increasing the height of the aisles and narrowing down the aisle-aisle space are major design issues in doing so. Even though forklift manufacturing companies introduced high reach trucks and forklifts for narrow aisles, forklift operators face many issues while working with heavy pallets. This thesis focused on developing a systemthat uses Augmented Reality(AR) to aid forklift operators in performing their pallet racking and pick up tasks. It used AR technology to superimpose virtual cues over the real world specifying the pallets to be picked up and moved and also assist in operating the forklift using depth cues. This aims to increase the productivity of the forklift operators in the warehouse. Depth cues are overlaid on a live video feed from a camera attached to the front of the forklift which was displayed using a laptop to the participants. To evaluate the usability of the system designed, an experiment was conducted and the performance results and the feedback from the participants was evaluated. A remote controlled toy forklift was used to conduct the experiment and a motion tracking system was set-up to track the cab and pallet. Simple pallet handling tasks were designed for the participants and their performance and feedback was collected and analysed. This thesis shows how AR offers a simple and effecient solution for the problems faced by forklift operators while performing pallet handling tasks in warehouse

Ground Robotic Hand Applications for the Space Program study (GRASP)

This document reports on a NASA-STDP effort to address research interests of the NASA Kennedy Space Center (KSC) through a study entitled, Ground Robotic-Hand Applications for the Space Program (GRASP). The primary objective of the GRASP study was to identify beneficial applications of specialized end-effectors and robotic hand devices for automating any ground operations which are performed at the Kennedy Space Center. Thus, operations for expendable vehicles, the Space Shuttle and its components, and all payloads were included in the study. Typical benefits of automating operations, or augmenting human operators performing physical tasks, include: reduced costs; enhanced safety and reliability; and reduced processing turnaround time

Annals of Scientific Society for Assembly, Handling and Industrial Robotics 2021

This Open Access proceedings presents a good overview of the current research landscape of assembly, handling and industrial robotics. The objective of MHI Colloquium is the successful networking at both academic and management level. Thereby, the colloquium focuses an academic exchange at a high level in order to distribute the obtained research results, to determine synergy effects and trends, to connect the actors in person and in conclusion, to strengthen the research field as well as the MHI community. In addition, there is the possibility to become acquatined with the organizing institute. Primary audience is formed by members of the scientific society for assembly, handling and industrial robotics (WGMHI)

Enabling technologies and cyber-physical systems for mission-critical scenarios

Programa Oficial de Doutoramento en Tecnoloxías da Información e Comunicacións en Redes Móbiles . 5029P01[Abstract] Reliable transport systems, defense, public safety and quality assurance in the Industry 4.0 are essential in a modern society. In a mission-critical scenario, a mission failure would jeopardize human lives and put at risk some other assets whose impairment or loss would significantly harm society or business results. Even small degradations of the communications supporting the mission could have large and possibly dire consequences. On the one hand, mission-critical organizations wish to utilize the most modern, disruptive and innovative communication systems and technologies, and yet, on the other hand, need to comply with strict requirements, which are very different to those of non critical scenarios. The aim of this thesis is to assess the feasibility of applying emerging technologies like Internet of Things (IoT), Cyber-Physical Systems (CPS) and 4G broadband communications in mission-critical scenarios along three key critical infrastructure sectors: transportation, defense and public safety, and shipbuilding. Regarding the transport sector, this thesis provides an understanding of the progress of communications technologies used for railways since the implantation of Global System for Mobile communications-Railways (GSM-R). The aim of this work is to envision the potential contribution of Long Term Evolution (LTE) to provide additional features that GSM-R would never support. Furthermore, the ability of Industrial IoT for revolutionizing the railway industry and confront today's challenges is presented. Moreover, a detailed review of the most common flaws found in Radio Frequency IDentification (RFID) based IoT systems is presented, including the latest attacks described in the literature. As a result, a novel methodology for auditing security and reverse engineering RFID communications in transport applications is introduced. The second sector selected is driven by new operational needs and the challenges that arise from modern military deployments. The strategic advantages of 4G broadband technologies massively deployed in civil scenarios are examined. Furthermore, this thesis analyzes the great potential for applying IoT technologies to revolutionize modern warfare and provide benefits similar to those in industry. It identifies scenarios where defense and public safety could leverage better commercial IoT capabilities to deliver greater survivability to the warfighter or first responders, while reducing costs and increasing operation efficiency and effectiveness. The last part is devoted to the shipbuilding industry. After defining the novel concept of Shipyard 4.0, how a shipyard pipe workshop works and what are the requirements for building a smart pipe system are described in detail. Furthermore, the foundations for enabling an affordable CPS for Shipyards 4.0 are presented. The CPS proposed consists of a network of beacons that continuously collect information about the location of the pipes. Its design allows shipyards to obtain more information on the pipes and to make better use of it. Moreover, it is indicated how to build a positioning system from scratch in an environment as harsh in terms of communications as a shipyard, showing an example of its architecture and implementation.[Resumen] En la sociedad moderna, los sistemas de transporte fiables, la defensa, la seguridad pública y el control de la calidad en la Industria 4.0 son esenciales. En un escenario de misión crítica, el fracaso de una misión pone en peligro vidas humanas y en riesgo otros activos cuyo deterioro o pérdida perjudicaría significativamente a la sociedad o a los resultados de una empresa. Incluso pequeñas degradaciones en las comunicaciones que apoyan la misión podrían tener importantes y posiblemente terribles consecuencias. Por un lado, las organizaciones de misión crítica desean utilizar los sistemas y tecnologías de comunicación más modernos, disruptivos e innovadores y, sin embargo, deben cumplir requisitos estrictos que son muy diferentes a los relativos a escenarios no críticos. El objetivo principal de esta tesis es evaluar la viabilidad de aplicar tecnologías emergentes como Internet of Things (IoT), Cyber-Physical Systems (CPS) y comunicaciones de banda ancha 4G en escenarios de misión crítica en tres sectores clave de infraestructura crítica: transporte, defensa y seguridad pública, y construcción naval. Respecto al sector del transporte, esta tesis permite comprender el progreso de las tecnologías de comunicación en el ámbito ferroviario desde la implantación de Global System for Mobile communications-Railway (GSM-R). El objetivo de este trabajo es analizar la contribución potencial de Long Term Evolution (LTE) para proporcionar características adicionales que GSM-R nunca podría soportar. Además, se presenta la capacidad de la IoT industrial para revolucionar la industria ferroviaria y afrontar los retos actuales. Asimismo, se estudian con detalle las vulnerabilidades más comunes de los sistemas IoT basados en Radio Frequency IDentification (RFID), incluyendo los últimos ataques descritos en la literatura. Como resultado, se presenta una metodología innovadora para realizar auditorías de seguridad e ingeniería inversa de las comunicaciones RFID en aplicaciones de transporte. El segundo sector elegido viene impulsado por las nuevas necesidades operacionales y los desafíos que surgen de los despliegues militares modernos. Para afrontarlos, se analizan las ventajas estratégicas de las tecnologías de banda ancha 4G masivamente desplegadas en escenarios civiles. Asimismo, esta tesis analiza el gran potencial de aplicación de las tecnologías IoT para revolucionar la guerra moderna y proporcionar beneficios similares a los alcanzados por la industria. Se identifican escenarios en los que la defensa y la seguridad pública podrían aprovechar mejor las capacidades comerciales de IoT para ofrecer una mayor capacidad de supervivencia al combatiente o a los servicios de emergencias, a la vez que reduce los costes y aumenta la eficiencia y efectividad de las operaciones. La última parte se dedica a la industria de construcción naval. Después de definir el novedoso concepto de Astillero 4.0, se describe en detalle cómo funciona el taller de tubería de astillero y cuáles son los requisitos para construir un sistema de tuberías inteligentes. Además, se presentan los fundamentos para posibilitar un CPS asequible para Astilleros 4.0. El CPS propuesto consiste en una red de balizas que continuamente recogen información sobre la ubicación de las tuberías. Su diseño permite a los astilleros obtener más información sobre las tuberías y hacer un mejor uso de las mismas. Asimismo, se indica cómo construir un sistema de posicionamiento desde cero en un entorno tan hostil en términos de comunicaciones, mostrando un ejemplo de su arquitectura e implementación

The Complementarity of Tangible and Paper Interfaces in Tabletop Environments for Collaborative Learning

The current trend in Human-Computer Interaction aims at bridging the gap between the digital and the real world, exploring novel ways to engage users with computational devices. Computers take new forms that are better integrated into our environment and can be embedded in buildings, furniture or clothes. Novel forms of interfaces take advantage of people's intuitive knowledge of everyday objects to offer more direct and natural interactions. Tangible User Interfaces (TUIs) allow users to interact with digital objects through tangible artifacts, building on their rich physical affordances. Paper User Interfaces (PUIs) add digital capabilities to paper documents, synchronizing for instance their content with their digital counterpart. Unique properties of paper are also used to create engaging and intuitive interfaces to computer applications. This dissertation is interested in the complementarity of tangible and paper interfaces in tabletop environments. We introduce the concept of Tangible and Paper Environments (TaPEs) where Interactive Paper Forms (IPFs), a particular type of PUIs based on the paper form metaphor, are used as a complementary interface to a TUI. We evaluate the potential of IPFs to overcome two main shortcomings of TUIs, in terms of scalability and pedagogy. The scalability issue comes from the limited expressiveness of task-specific physical artifacts, which offer rich physical affordances but limit the complexity of applications that can be controlled by a TUI. The pedagogy issue is raised by the lack of consistent evidence regarding the use of physical manipulatives in educational settings, which is one of the main application domain of TUIs. IPFs overcome the scalability issue by offering a set of generic interaction elements that allow TaPEs to cope with applications of any complexity. In a pedagogical setting, IPFs present learners with abstract representation which facilitate understanding by the embodied and concrete representations offered by tangible artifacts. A TaPE, the Tinker Environment, has been developed with two logistics teachers in the context of the Swiss vocational training system. It consists of a warehouse physical small-scale model (TUI) and TinkerSheets, our implementation of IPFs. It aims at helping apprentices understand theoretical concepts presented at schools. We followed a Design-based Research (DBR) approach: ten studies were conducted during the development of the Tinker Environment in authentic classroom settings. Controlled experiments were conducted to address specific questions. v The general research questions concern the respective affordances of paper and tangible components of TaPEs. The analysis is not limited to usability aspects but also considers their impact on group problem-solving activities and their potential in terms of integration of the system in its context of use. A descriptive model is proposed, built around three interaction circles: individual (usability), group (collaboration) and context (integration). Results identify design guidelines that limit the impact of the less direct interaction modality offered by IPFs, allowing TaPEs to overcome the scalability issue while supporting rich interactions. At the group level, observations of groups of apprentices solving problems around the Tinker Environment show that the consistent physical interaction modality offered by TaPEs naturally supports collaborative interactions. Apprentices tend to take implicit roles based on their location around the system. Regarding the context circle, we observed that carefully designed IPFs play the role of bridges between offline and online activities and contribute to a tight integration of the system in a its context (i.e. a classroom). The specific research questions address the potential of the Tinker Environment in this pedagogical context and its appropriation by teachers. The observations conducted with the Tinker Environment show that the warehouse small-scale model reduces the complexity of problems and allows apprentices to engage in meaningful problem-solving activities. Controlled experiments comparing a TUI to a mulitouch interface demonstrate that tangible artifacts lead to a higher learning gain and an increased performance in a problem-solving activity. Collaboration quality and perceived playfulness are also improved. The teacher plays a central role in the use of the environment, guiding apprentices through activities and encouraging reflections during debriefing sessions. The design of IPFs, emphasizing either their interface or document nature, has a strong influence on their ability to support teachers. We finally discuss the two-way adaptation process that took place between teachers and the system during the development of the Tinker Environment