Earthmoving construction automation with military applications: Past, present and future

© ISARC 2018 - 35th International Symposium on Automation and Robotics in Construction and International AEC/FM Hackathon: The Future of Building Things. All rights reserved. Amongst increasing innovations in frontier engineering sciences, the advancements in Robotic and Autonomous Systems (RAS) has brought about a new horizon in construction applications. There is evidence of the increasing interest in RAS technologies in the civil construction sector being reflected in construction efforts of many military forces. In particular, Army or ground-based forces are frequently called upon to conduct construction tasks as part of military operations, tasks which could be partially or fully aided by the employment of RAS technologies. Along with recent advances in the Internet of Things (IoT) and cyber-physical system infrastructure, it is essential to examine the current maturity, technical feasibility, and affordability, as well as the challenges and future directions of the adoption and application of RAS to military construction. This paper presents a comprehensive survey and provides a contemporary and industry-independent overview on the state-of-the-art of earthmoving construction automation used in defence, spanning current world’s best practice through to that which is predicted over the coming years

Learning and Reacting with Inaccurate Prediction: Applications to Autonomous Excavation

Motivated by autonomous excavation, this work investigates solutions to a class of problem where disturbance prediction is critical to overcoming poor performance of a feedback controller, but where the disturbance prediction is intrinsically inaccurate. Poor feedback controller performance is related to a fundamental control problem: there is only a limited amount of disturbance rejection that feedback compensation can provide. It is known, however, that predictive action can improve the disturbance rejection of a control system beyond the limitations of feedback. While prediction is desirable, the problem in excavation is that disturbance predictions are prone to error due to the variability and complexity of soil-tool interaction forces. This work proposes the use of iterative learning control to map the repetitive components of excavation forces into feedforward commands. Although feedforward action shows useful to improve excavation performance, the non-repetitive nature of soil-tool interaction forces is a source of inaccurate predictions. To explicitly address the use of imperfect predictive compensation, a disturbance observer is used to estimate the prediction error. To quantify inaccuracy in prediction, a feedforward model of excavation disturbances is interpreted as a communication channel that transmits corrupted disturbance previews, for which metrics based on the sensitivity function exist. During field trials the proposed method demonstrated the ability to iteratively achieve a desired dig geometry, independent of the initial feasibility of the excavation passes in relation to actuator saturation. Predictive commands adapted to different soil conditions and passes were repeated autonomously until a pre-specified finish quality of the trench was achieved. Evidence of improvement in disturbance rejection is presented as a comparison of sensitivity functions of systems with and without the use of predictive disturbance compensation

Technologies for safe and resilient earthmoving operations: A systematic literature review

Resilience engineering relates to the ability of a system to anticipate, prepare, and respond to predicted and unpredicted disruptions. It necessitates the use of monitoring and object detection technologies to ensure system safety in excavation systems. Given the increased investment and speed of improvement in technologies, it is necessary to review the types of technology available and how they contribute to excavation system safety. A systematic literature review was conducted which identified and classified the existing monitoring and object detection technologies, and introduced essential enablers for reliable and effective monitoring and object detection systems including: 1) the application of multisensory and data fusion approaches, and 2) system-level application of technologies. This study also identified the developed functionalities for accident anticipation, prevention and response to safety hazards during excavation, as well as those that facilitate learning in the system. The existing research gaps and future direction of research have been discussed

Parallel Mining Operating Systems: From Digital Twins to Mining Intelligence

With the rapid development and modernization requirement of global coal industry, there is an emerging need for intelligent and unmanned mining systems. In this paper, the Intelligent Mining Operating System (IMOS) is proposed and developed, based on the parallel management and control of mining operating infrastructure that integrates the intelligent mining theory, the ACP-based (Artificial societies, Computational experiments, Parallel execution) parallel intelligence approaches, and the new generation of artificial intelligence (AI) technologies. To satisfy the intelligent and unmanned demand of open-pit mines, the IMOS architecture is developed by integrating the theory of digital quadruplets. The main subsystems and functions of IMOS are elaborated in detail, including a single-vehicle operating subsystem, multi-vehicle collaboration subsystem, vehicle-road collaboration subsystem, unmanned intelligent subsystem, dispatch management subsystem, parallel management and control subsystem, supervisory subsystem, remote takeover subsystem, and communication subsystem. The IMOS presented in this paper is the first integrated solution for intelligent and unmanned mines in China, and has been implemented over ten main open pits in the past few years. Its deployment and utilization will effectively improve the production efficiency and safety level of open-pit mines, promote the construction of ecological mines, and bring great significance to the realization of sustainable mining development

Fuzzy Controlled Hydraulic Excavator with Model Parameter Uncertainty

The hydraulic actuated excavator, being a non-linear mobile machine, encounters many uncertainties. There are uncertainties in the hydraulic system in addition to the uncertain nature of the load. The simulation results obtained in this study show that there is a need for intelligent control of such machines and in particular interval type-2 fuzzy controller is most suitable for minimizing the position error of a typical excavator’s bucket under load variations. We consider the model parameter uncertainties such as hydraulic fluid leakage and friction. These are uncertainties which also depend up on the temperature and alter bulk modulus and viscosity of the hydraulic fluid. Such uncertainties together with the load variations cause chattering of the bucket position. The interval type-2 fuzzy controller effectively eliminates the chattering and manages to control the end-effecter (bucket) position with positional error in the order of few millimeters

A survey of robot manipulation in contact

In this survey, we present the current status on robots performing manipulation tasks that require varying contact with the environment, such that the robot must either implicitly or explicitly control the contact force with the environment to complete the task. Robots can perform more and more manipulation tasks that are still done by humans, and there is a growing number of publications on the topics of (1) performing tasks that always require contact and (2) mitigating uncertainty by leveraging the environment in tasks that, under perfect information, could be performed without contact. The recent trends have seen robots perform tasks earlier left for humans, such as massage, and in the classical tasks, such as peg-in-hole, there is a more efficient generalization to other similar tasks, better error tolerance, and faster planning or learning of the tasks. Thus, in this survey we cover the current stage of robots performing such tasks, starting from surveying all the different in-contact tasks robots can perform, observing how these tasks are controlled and represented, and finally presenting the learning and planning of the skills required to complete these tasks

Understanding AI Application Dynamics in Oil and Gas Supply Chain Management and Development: A Location Perspective

The purpose of this paper is to gain a better understanding of Artificial Intelligence (AI) application dynamics in the oil and gas supply chain. A location perspective is used to explore the opportunities and challenges of specific AI technologies from upstream to downstream of the oil and gas supply chain. A literature review approach is adopted to capture representative research along these locations. This was followed by descriptive and comparative analysis for the reviewed literature. Results from the conducted analysis revealed important insights about AI implementation dynamics in the oil and gas industry. Furthermore, various recommendations for technology managers, policymakers, practitioners, and industry leaders in the oil and gas industry to ensure successful AI implementation were outlined. Doi: 10.28991/HIJ-SP2022-03-01 Full Text: PD

Dragline excavation simulation, real-time terrain recognition and object detection

The contribution of coal to global energy is expected to remain above 30% through 2030. Draglines are the preferred excavation equipment in most surface coal mines. Recently, studies toward dragline excavation efficiency have focused on two specific areas. The first area is dragline bucket studies, where the goal is to develop new designs which perform better than conventional buckets. Drawbacks in the current approach include operator inconsistencies and the inability to physically test every proposed design. Previous simulation models used Distinct Element Methods (DEM) but they over-predict excavation forces by 300% to 500%. In this study, a DEM-based simulation model has been developed to predict bucket payloads within a 16.55% error. The excavation model includes a novel method for calibrating formation parameters. The method combines DEM-based tri-axial material testing with the XGBoost machine learning algorithm to achieve prediction accuracies of between 80.6% and 95.54%. The second area is dragline vision studies towards efficient dragline operation. Current dragline vision models use image segmentation methods that are neither scalable nor multi-purpose. In this study, a scalable and multi-purpose vision model has been developed for draglines using Convolutional Neural Networks. This vision system achieves an 87.32% detection rate, 80.9% precision and 91.3% recall performance across multiple operation tasks. The main novelty of this research includes the bucket payload prediction accuracy, formation parameter calibration and the vision system accuracy, precision and recall performance toward improving dragline operating efficiencies --Abstract, page iii