Programming Robots for Activities of Everyday Life

Text-based programming remains a challenge to novice programmers in\ua0all programming domains including robotics. The use of robots is gainingconsiderable traction in several domains since robots are capable of assisting\ua0humans in repetitive and hazardous tasks. In the near future, robots willbe used in tasks of everyday life in homes, hotels, airports, museums, etc.\ua0However, robotic missions have been either predefined or programmed usinglow-level APIs, making mission specification task-specific and error-prone.\ua0To harness the full potential of robots, it must be possible to define missionsfor specific applications domains as needed. The specification of missions of\ua0robotic applications should be performed via easy-to-use, accessible ways, and\ua0at the same time, be accurate, and unambiguous. Simplicity and flexibility in\ua0programming such robots are important, since end-users come from diverse\ua0domains, not necessarily with suffcient programming knowledge.The main objective of this licentiate thesis is to empirically understand the\ua0state-of-the-art in languages and tools used for specifying robot missions byend-users. The findings will form the basis for interventions in developing\ua0future languages for end-user robot programming.During the empirical study, DSLs for robot mission specification were\ua0analyzed through published literature, their websites, user manuals, samplemissions and using the languages to specify missions for supported robots.After extracting data from 30 environments, 133 features were identified.\ua0A feature matrix mapping the features to the environments was developedwith a feature model for robotic mission specification DSLs.Our results show that most end-user facing environments exist in the\ua0education domain for teaching novice programmers and STEM subjects. Mostof the visual languages are developed using Blockly and Scratch libraries.\ua0The end-user domain abstraction needs more work since most of the visualenvironments abstract robotic and programming language concepts but not\ua0end-user concepts. In future works, it is important to focus on the development\ua0of reusable libraries for end-user concepts; and further, explore how end-user\ua0facing environments can be adapted for novice programmers to learn\ua0general programming skills and robot programming in low resource settings\ua0in developing countries, like Uganda

NeBula: Team CoSTAR's robotic autonomy solution that won phase II of DARPA Subterranean Challenge

This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, it presents the techniques utilized within the Tunnel (2019) and Urban (2020) competitions, where CoSTAR achieved second and first place, respectively. We also discuss CoSTAR¿s demonstrations in Martian-analog surface and subsurface (lava tubes) exploration. The paper introduces our autonomy solution, referred to as NeBula (Networked Belief-aware Perceptual Autonomy). NeBula is an uncertainty-aware framework that aims at enabling resilient and modular autonomy solutions by performing reasoning and decision making in the belief space (space of probability distributions over the robot and world states). We discuss various components of the NeBula framework, including (i) geometric and semantic environment mapping, (ii) a multi-modal positioning system, (iii) traversability analysis and local planning, (iv) global motion planning and exploration behavior, (v) risk-aware mission planning, (vi) networking and decentralized reasoning, and (vii) learning-enabled adaptation. We discuss the performance of NeBula on several robot types (e.g., wheeled, legged, flying), in various environments. We discuss the specific results and lessons learned from fielding this solution in the challenging courses of the DARPA Subterranean Challenge competition.The work is partially supported by the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration (80NM0018D0004), and Defense Advanced Research Projects Agency (DARPA)

Flight controller synthesis via deep reinforcement learning

Traditional control methods are inadequate in many deployment settings involving autonomous control of Cyber-Physical Systems (CPS). In such settings, CPS controllers must operate and respond to unpredictable interactions, conditions, or failure modes. Dealing with such unpredictability requires the use of executive and cognitive control functions that allow for planning and reasoning. Motivated by the sport of drone racing, this dissertation addresses these concerns for state-of-the-art flight control by investigating the use of deep artificial neural networks to bring essential elements of higher-level cognition to bear on the design, implementation, deployment, and evaluation of low level (attitude) flight controllers. First, this thesis presents a feasibility analyses and results which confirm that neural networks, trained via reinforcement learning, are more accurate than traditional control methods used by commercial uncrewed aerial vehicles (UAVs) for attitude control. Second, armed with these results, this thesis reports on the development and release of an open source, full solution stack for building neuro-flight controllers. This stack consists of a tuning framework for implementing training environments (GymFC) and firmware for the world’s first neural network supported flight controller (Neuroflight). GymFC’s novel approach fuses together the digital twinning paradigm with flight control training to provide seamless transfer to hardware. Third, to transfer models synthesized by GymFC to hardware, this thesis reports on the toolchain that has been released for compiling neural networks into Neuroflight, which can be flashed to off-the-shelf microcontrollers. This toolchain includes detailed procedures for constructing a multicopter digital twin to allow the research and development community to synthesize flight controllers unique to their own aircraft. Finally, this thesis examines alternative reward system functions as well as changes to the software environment to bridge the gap between simulation and real world deployment environments. The design, evaluation, and experimental work summarized in this thesis demonstrates that deep reinforcement learning is able to be leveraged for the design and implementation of neural network controllers capable not only of maintaining stable flight, but also precision aerobatic maneuvers in real world settings. As such, this work provides a foundation for developing the next generation of flight control systems

Aerial Robotics for Inspection and Maintenance

Aerial robots with perception, navigation, and manipulation capabilities are extending the range of applications of drones, allowing the integration of different sensor devices and robotic manipulators to perform inspection and maintenance operations on infrastructures such as power lines, bridges, viaducts, or walls, involving typically physical interactions on flight. New research and technological challenges arise from applications demanding the benefits of aerial robots, particularly in outdoor environments. This book collects eleven papers from different research groups from Spain, Croatia, Italy, Japan, the USA, the Netherlands, and Denmark, focused on the design, development, and experimental validation of methods and technologies for inspection and maintenance using aerial robots

A framework for adoption of drones in the Dominican Republic construction industry

A thesis submitted in partial fulfilment of the requirements of the University of Wolverhampton for the degree of Doctor of Philosophy.There is a severe problem in developing countries in whether or not adopt technologies for facilitating daily tasks. It is happening mostly in sectors with low skills employees as the construction industry. The adoption of technologies in developing countries is a challenge that affect health, economy, and consciousness advancement. Furthermore, the scepticism in the what, how, and why the effectiveness of certain technologies, as drones, difficult the cost-benefit of the decision-making process for organisations in developing countries. This cost-benefit decision, involved in the cases of UAS applications, covers the regulatory and practical implications that are barriers in developed countries. But, in developing one, seems to have another set of barriers that should be investigate in-depth. Therefore, the aim of this research is to develop an ontology for public, private, and non-profit organisations that explain the epistemological implications in the implementation of Unmanned Aerial Systems for the Construction Industry in the Dominican Republic. The study approaches an iterative strategy of interviewing 24 participants in a semi-structured format. Then, the Nvivo 2020 software was used to identify cases utilising ground theory coding, thematic and content analysis. Later, the root cause reasons and challenges of implementing UAS were identified utilising Interpretative Structured Method (ISM) and their sub analyses. 5 Cases of studies were presented (real estate, construction, infrastructure, urban development, and disaster management) to illustrate the drone operations. The findings reveal that a hybrid management adoption approach have been the most suitable with drones in the country. The root cause of drone implementation and its barriers were cost reduction and reactive cultural respectively. Strategic and operational ontologies for UAS skill programs, understanding of UAS outcomes, and Building Information Modelling integration were developed in order to focus efforts on developing drones for cargo, assisting humans, and digitalisation. Mandates are recommended for policy makers as drones for digitalisation initiates digital workflows towards BIM. Other scenarios should be considering scenarios where autonomous aerial operations affect safety in future operations. Furthermore, recommendations on legal and standards should be updated in order to allow UAS outcomes as law acceptable. Further works are recommended in decentralised systems, artificial intelligence, and drone applications.Ministry of Higher Education, Science and Technology

Feasibility Study to Determine the Economic and Operational Benefits of Utilizing Unmanned Aerial Vehicles (UAVs)

This project explored the feasibility of using Unmanned Aerial Systems (UASs) in Georgia Department of Transportation (GDOT) operations. The research team conducted 24 interviews with personnel in four GDOT divisions. Interviews focused on (1) the basic goals of the operators in each division, (2) their major decisions for accomplishing those goals, and (3) the information requirements for each decision. Following an interview validation process, a set of UASs design characteristics that fulfill user requirements of each previously identified division was developed. A “House of Quality” viewgraph was chosen to capture the relationships between GDOT tasks and potential UAS aiding those operations. As a result, five reference systems are proposed. The UAS was broken into three components: vehicle, control station, and system. This study introduces a variety of UAS applications in traffic management, transportation and construction disciplines related to DOTs, such as the ability to get real time, digital photographs/videos of traffic scenes, providing a "bird’s eye view" that was previously only available with the assistance of a manned aircraft, integrating aerial data into GDOT drawing software programs, and dealing with restricted or complicated access issues when terrain, area, or the investigated object make it difficult for GDOT personnel to conduct a task. The results of this study could lead to further research on design, development, and field-testing of UAVs for applications identified as beneficial to the Department.Georgia Department of Transportatio

UAV or Drones for Remote Sensing Applications in GPS/GNSS Enabled and GPS/GNSS Denied Environments

The design of novel UAV systems and the use of UAV platforms integrated with robotic sensing and imaging techniques, as well as the development of processing workflows and the capacity of ultra-high temporal and spatial resolution data, have enabled a rapid uptake of UAVs and drones across several industries and application domains.This book provides a forum for high-quality peer-reviewed papers that broaden awareness and understanding of single- and multiple-UAV developments for remote sensing applications, and associated developments in sensor technology, data processing and communications, and UAV system design and sensing capabilities in GPS-enabled and, more broadly, Global Navigation Satellite System (GNSS)-enabled and GPS/GNSS-denied environments.Contributions include:UAV-based photogrammetry, laser scanning, multispectral imaging, hyperspectral imaging, and thermal imaging;UAV sensor applications; spatial ecology; pest detection; reef; forestry; volcanology; precision agriculture wildlife species tracking; search and rescue; target tracking; atmosphere monitoring; chemical, biological, and natural disaster phenomena; fire prevention, flood prevention; volcanic monitoring; pollution monitoring; microclimates; and land use;Wildlife and target detection and recognition from UAV imagery using deep learning and machine learning techniques;UAV-based change detection