Detection and Tracking of Pedestrians Using Doppler LiDAR

Pedestrian detection and tracking is necessary for autonomous vehicles and traffic manage- ment. This paper presents a novel solution to pedestrian detection and tracking for urban scenarios based on Doppler LiDAR that records both the position and velocity of the targets. The workflow consists of two stages. In the detection stage, the input point cloud is first segmented to form clus- ters, frame by frame. A subsequent multiple pedestrian separation process is introduced to further segment pedestrians close to each other. While a simple speed classifier is capable of extracting most of the moving pedestrians, a supervised machine learning-based classifier is adopted to detect pedestrians with insignificant radial velocity. In the tracking stage, the pedestrian’s state is estimated by a Kalman filter, which uses the speed information to estimate the pedestrian’s dynamics. Based on the similarity between the predicted and detected states of pedestrians, a greedy algorithm is adopted to associate the trajectories with the detection results. The presented detection and tracking methods are tested on two data sets collected in San Francisco, California by a mobile Doppler LiDAR system. The results of the pedestrian detection demonstrate that the proposed two-step classifier can improve the detection performance, particularly for detecting pedestrians far from the sensor. For both data sets, the use of Doppler speed information improves the F1-score and the recall by 15% to 20%. The subsequent tracking from the Kalman filter can achieve 83.9–55.3% for the multiple object tracking accuracy (MOTA), where the contribution of the speed measurements is secondary and insignificant

Flow-Bounded Velocity Controller for Hydraulic Bulldozers

The bulldozer is a mobile earthmoving machine with a differentially steered mobile base and an onboard manipulator used for soil cutting and transportation. Grading the ground to match a desired contour is an end-effector path-following task, with required joint rates dependent on mobile base motion. The offline planning of travel velocity profiles that respect the available hydraulic flowrate limits is difficult due to uncertainties in the machine–soil interactions. Hence, we propose a flow-bounded velocity controller enabling accurate automatic grading with online velocity scaling. The capacity of hydrostatic transmission and manipulator actuators, as well as the desired velocity, are considered when deciding the commanded velocity reference for the mobile base. Our dynamic simulation results show that, with the proposed controller, a desired ground profile is cut accurately when the machine operates at its performance limits. Comparison to constant velocity driving shows that errors in blade positioning are reduced dramatically. Constant velocity selected to keep the flow within limits results in longer completion times compared to our solution, making it more time optimal. Furthermore, the rpm of the diesel engine can be reduced to save fuel without compromising control performance.publishedVersionPeer reviewe

A Review on IoT Deep Learning UAV Systems for Autonomous Obstacle Detection and Collision Avoidance

[Abstract] Advances in Unmanned Aerial Vehicles (UAVs), also known as drones, offer unprecedented opportunities to boost a wide array of large-scale Internet of Things (IoT) applications. Nevertheless, UAV platforms still face important limitations mainly related to autonomy and weight that impact their remote sensing capabilities when capturing and processing the data required for developing autonomous and robust real-time obstacle detection and avoidance systems. In this regard, Deep Learning (DL) techniques have arisen as a promising alternative for improving real-time obstacle detection and collision avoidance for highly autonomous UAVs. This article reviews the most recent developments on DL Unmanned Aerial Systems (UASs) and provides a detailed explanation on the main DL techniques. Moreover, the latest DL-UAV communication architectures are studied and their most common hardware is analyzed. Furthermore, this article enumerates the most relevant open challenges for current DL-UAV solutions, thus allowing future researchers to define a roadmap for devising the new generation affordable autonomous DL-UAV IoT solutions.Xunta de Galicia; ED431C 2016-045Xunta de Galicia; ED431C 2016-047Xunta de Galicia; , ED431G/01Centro Singular de Investigación de Galicia; PC18/01Agencia Estatal de Investigación de España; TEC2016-75067-C4-1-

Towards Semi-Autonomous Control of Heavy-Duty Tracked Earth-Moving Mobile Manipulators : Use Case: The Bulldozer

A mobile manipulator (MM) comprises a manipulator attached to a mobile base, making it capable of manipulation tasks in large workspaces. In the field of construction, heavy-duty MMs are extensively used for soil excavation at construction sites. One such machine is the bulldozer, which is widely used because of its robustness and maneuverability. With its onboard blade, the bulldozer shapes terrain and transports soil material by pushing it. However, operating the blade with joysticks to accurately shape the terrain surface and moving material productively are difficult tasks that require extensive training and experience. Automating the motion of the blade, therefore, has the potential to reduce skill requirements, improve productivity, and reduce operators’ workloads. This thesis studies and develops methods for the semi-autonomous control of a bulldozer to increase surface quality and earthmoving productivity. These goals were reflected in the main research problems (RPs). Furthermore, as bulldozers drive over the terrain shape generated by the blade, the RPs are coupled because earthmoving productivity is partially dependent on surface quality. The RPs and their coupling were addressed in four publications by coordinating the mobile base and manipulator control and by using the surrounding terrain shape in automatic blade motion reference computations. Challenges to automatic control emerge from the tracked mobile platform driving on rough terrain while the manipulator tool interacts with the soil. It is shown in the first two publications that coordinating the control of the MM mobile base and blade manipulator subsystems can improve surface quality and productivity by temporarily slowing down the machine when the required manipulator joint rates increase or when the tractive performance reduces. The third publication showed that feedforward–feedback control of the blade manipulator can be used on a real-world bulldozer for accurate terrain shaping. The thesis work culminates in the final publication with an experimental implementation of a semi-autonomous blade control system that continuously maps the worksite terrain and uses it to compute the required blade motion

Value creation with digital twins : application-oriented conceptual framework and case study

The internet of things, digital twins of smart connected products, and thereby enabled smart services are topics of great interest and have been gaining traction for many years. However, many questions concerning the application-oriented usage of digital twins still need to be scrutinized. Therefore, this paper examines the question of an application-oriented framework for value creation with digital twins using design science research approaches. A conceptual reference framework is presented based on earlier research and iteratively developed within workshops with three companies. The framework incorporates primary dimensions of external and internal value creation and data resources. Further, it discusses the product life cycle, the real-world counterpart, value creation in the ecosystem, and the generational aspect of the digital twins. Furthermore, applying the framework to a use case with an industrial research partner helps to show the contributions to the industrial sector. The framework provides utility to practitioners as a means of creating a common sense in interdisciplinary teams, communicating digital twin projects to internal and external stakeholders, and as a toolbox for specific challenges concerning digital twins. In addition, the framework distinguishes itself from existing approaches by including the service ecosystem and its actors while considering the principles of product life cycle management. Therefore, using the framework in other use cases will test the approach on different industries and products. Furthermore, there is a need to develop approaches for implementing and developing an existing case

Life Cycle Engineering 4.0: A Proposal to Conceive Manufacturing Systems for Industry 4.0 Centred on the Human Factor (DfHFinI4.0)

Engineering 4.0 environments are characterised by the digitisation, virtualisation, and connectivity of products, processes, and facilities composed of reconfigurable and adaptive socio-technical cyber-physical manufacturing systems (SCMS), in which Operator 4.0 works in real time in VUCA (volatile, uncertain, complex and ambiguous) contexts and markets. This situation gives rise to the interest in developing a framework for the conception of SCMS that allows the integration of the human factor, management, training, and development of the competencies of Operator 4.0 as fundamental aspects of the aforementioned system. The present paper is focused on answering how to conceive the adaptive manufacturing systems of Industry 4.0 through the operation, growth, and development of human talent in VUCA contexts. With this objective, exploratory research is carried, out whose contribution is specified in a framework called Design for the Human Factor in Industry 4.0 (DfHFinI4.0). From among the conceptual frameworks employed therein, the connectivist paradigm, Ashby's law of requisite variety and Vigotsky's activity theory are taken into consideration, in order to enable the affective-cognitive and timeless integration of the human factor within the SCMS. DfHFinI4.0 can be integrated into the life cycle engineering of the enterprise reference architectures, thereby obtaining manufacturing systems for Industry 4.0 focused on the human factor. The suggested framework is illustrated as a case study for the Purdue Enterprise Reference Architecture (PERA) methodology, which transforms it into PERA 4.0

Maintenance Management of Wind Turbines

“Maintenance Management of Wind Turbines” considers the main concepts and the state-of-the-art, as well as advances and case studies on this topic. Maintenance is a critical variable in industry in order to reach competitiveness. It is the most important variable, together with operations, in the wind energy industry. Therefore, the correct management of corrective, predictive and preventive politics in any wind turbine is required. The content also considers original research works that focus on content that is complementary to other sub-disciplines, such as economics, finance, marketing, decision and risk analysis, engineering, etc., in the maintenance management of wind turbines. This book focuses on real case studies. These case studies concern topics such as failure detection and diagnosis, fault trees and subdisciplines (e.g., FMECA, FMEA, etc.) Most of them link these topics with financial, schedule, resources, downtimes, etc., in order to increase productivity, profitability, maintainability, reliability, safety, availability, and reduce costs and downtime, etc., in a wind turbine. Advances in mathematics, models, computational techniques, dynamic analysis, etc., are employed in analytics in maintenance management in this book. Finally, the book considers computational techniques, dynamic analysis, probabilistic methods, and mathematical optimization techniques that are expertly blended to support the analysis of multi-criteria decision-making problems with defined constraints and requirements