Sensor Characterization and Signal Fusion for InstantEye

The practicality and effectiveness of using a TerraRanger Duo—a parallel sonar and infrared time-of-flight distance sensor—payload for obstacle detection is investigated for use with Physical Science Inc.’s InstantEye drone. A Python program was developed to interface with the serial data output before comparing the sensor’s empirical performance against its data sheet. The two signals from the distinct sensor modules, each with their characterized strengths and weaknesses, were then fused with a Kalman filter. This was further refined by imposing conditional weighting based on the known sensor characteristics. The filter output, with conditional corrections, was able to accurately track a single object’s position and velocity within a maximum range of 14 meters

Mobile-manipulating UAVs for Sensor Installation, Bridge Inspection and Maintenance

A parallel mechanism and smart gripper was designed and mounted on a rotorcraft drone to act as a robotic arm and hand. This empowers the drone to perform aerial manipulation and execute bridge maintenance. Hosing, drilling, and epoxying serve as case studies to test-and-evaluation and verify-and-validate the design. The approach, tasks, and findings are presented and show that the case studies are realizable. Conclusions and recommendations point to employing haptics-based human-in-the-loop approaches that can increase the scope of repair work involved in bridge maintenance

InfoSwarms: Drone Swarms and Information Warfare

Drone swarms, which can be used at sea, on land, in the air, and even in space, are fundamentally information-dependent weapons. No study to date has examined drone swarms in the context of information warfare writ large. This article explores the dependence of these swarms on information and the resultant connections with areas of information warfare—electronic, cyber, space, and psychological—drawing on open-source research and qualitative reasoning. Overall, the article offers insights into how this important emerging technology fits into the broader defense ecosystem and outlines practical approaches to strengthening related information warfare capabilities

Levitating Particle Displays with Interactive Voxels

Levitating objects can be used as the primitives in a new type of display. We present levitating particle displays and show how research into object levitation is enabling a new way of presenting and interacting with information. We identify novel properties of levitating particle displays and give examples of the interaction techniques and applications they allow. We then discuss design challenges for these displays, potential solutions, and promising areas for future research

Systems of Tethered Multicopters: Modeling and Control Design

A class of tethered unmanned aerial vehicles is considered, featuring a chain of multicopter drones tethered one to the other. Differently from previous contributions in the literature, here the tethers are assumed to be elastic and to transfer traction loads only. Moreover, their length can be adjusted through controlled winches installed in the ground station and on each drone. Named systems of tethered multicopters, these devices can be used for a range of applications where both long runtime and good flexibility are required. The paper describes a model of the system, and presents a hierarchical control approach for this class of drones. The proposed control approach is tested through numerical simulations

Methods for autonomous wristband placement with a search-and-rescue aerial manipulator

A new robotic system for Search And Rescue (SAR) operations based on the automatic wristband placement on the victims’ arm, which may provide identification, beaconing and remote sensor readings for continuous health monitoring. This paper focuses on the development of the automatic target localization and the device placement using an unmanned aerial manipulator. The automatic wrist detection and localization system uses an RGB-D camera and a convolutional neural network based on the region faster method (Faster R-CNN). A lightweight parallel delta manipulator with a large workspace has been built, and a new design of a wristband in the form of a passive detachable gripper, is presented, which under contact, automatically attaches to the human, while disengages from the manipulator. A new trajectory planning method has been used to minimize the torques caused by the external forces during contact, which cause attitude perturbations. Experiments have been done to evaluate the machine learning method for detection and location, and for the assessment of the performance of the trajectory planning method. The results show how the VGG-16 neural network provides a detection accuracy of 67.99%. Moreover, simulation experiments have been done to show that the new trajectories minimize the perturbations to the aerial platform.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech

Safety-Aware Human-Robot Collaborative Transportation and Manipulation with Multiple MAVs

Human-robot interaction will play an essential role in various industries and daily tasks, enabling robots to effectively collaborate with humans and reduce their physical workload. Most of the existing approaches for physical human-robot interaction focus on collaboration between a human and a single ground robot. In recent years, very little progress has been made in this research area when considering aerial robots, which offer increased versatility and mobility compared to their grounded counterparts. This paper proposes a novel approach for safe human-robot collaborative transportation and manipulation of a cable-suspended payload with multiple aerial robots. We leverage the proposed method to enable smooth and intuitive interaction between the transported objects and a human worker while considering safety constraints during operations by exploiting the redundancy of the internal transportation system. The key elements of our system are (a) a distributed payload external wrench estimator that does not rely on any force sensor; (b) a 6D admittance controller for human-aerial-robot collaborative transportation and manipulation; (c) a safety-aware controller that exploits the internal system redundancy to guarantee the execution of additional tasks devoted to preserving the human or robot safety without affecting the payload trajectory tracking or quality of interaction. We validate the approach through extensive simulation and real-world experiments. These include as well the robot team assisting the human in transporting and manipulating a load or the human helping the robot team navigate the environment. To the best of our knowledge, this work is the first to create an interactive and safety-aware approach for quadrotor teams that physically collaborate with a human operator during transportation and manipulation tasks.Comment: Guanrui Li and Xinyang Liu contributed equally to this pape