Novel Validation Techniques for Autonomous Vehicles

L'abstract è presente nell'allegato / the abstract is in the attachmen

Novel Validation Techniques for Autonomous Vehicles

The automotive industry is facing challenges in producing electrical, connected, and autonomous vehicles. Even if these challenges are, from a technical point of view, independent from each other, the market and regulatory bodies require them to be developed and integrated simultaneously. The development of autonomous vehicles implies the development of highly dependable systems. This is a multidisciplinary activity involving knowledge from robotics, computer science, electrical and mechanical engineering, psychology, social studies, and ethics. Nowadays, many Advanced Driver Assistance Systems (ADAS), like Emergency Braking System, Lane Keep Assistant, and Park Assist, are available. Newer luxury cars can drive by themselves on highways or park automatically, but the end goal is to develop completely autonomous driving vehicles, able to go by themselves, without needing human interventions in any situation. The more vehicles become autonomous, the greater the difficulty in keeping them reliable. It enhances the challenges in terms of development processes since their misbehaviors can lead to catastrophic consequences and, differently from the past, there is no more a human driver to mitigate the effects of erroneous behaviors. Primary threats to dependability come from three sources: misuse from the drivers, design systematic errors, and random hardware failures. These safety threats are addressed under various aspects, considering the particular type of item to be designed. In particular, for the sake of this work, we analyze those related to Functional Safety (FuSa), viewed as the ability of a system to react on time and in the proper way to the external environment. From the technological point of view, these behaviors are implemented by electrical and electronic items. Various standards to achieve FuSa have been released over the years. The first, released in 1998, was the IEC 61508. Its last version is the one released in 2010. This standard defines mainly: • a Functional Safety Management System (FSMS); • methods to determine a Safety Integrated Level (SIL); • methods to determine the probability of failures. To adapt the IEC61508 to the automotive industry’s peculiarity, a newer standard, the ISO26262, was released in 2011 then updated in 2018. This standard provides guidelines about FSMS, called in this case Safety Lifecycle, describing how to develop software and hardware components suitable for functional safety. It also provides a different way to compute the SIL, called in this case Automotive SIL (ASIL), allowing us to consider the average driver’s abilities to control the vehicle in case of failures. Moreover, it describes a way to determine the probability of random hardware failures through Failure Mode, Effects, and Diagnostic Analysis (FMEDA). This dissertation contains contributions to three topics: • random hardware failures mitigation; • improvementoftheISO26262HazardAnalysisandRiskAssessment(HARA); • real-time verification of the embedded software. As the main contribution of this dissertation, I address the safety threats due to random hardware failures (RHFs). For this purpose, I propose a novel simulation-based approach to aid the Failure Mode, Effects, and Diagnostic Analysis (FMEDA) required by the ISO26262 standard. Thanks to a SPICE-level model of the item, and the adoption of fault injection techniques, it is possible to simulate its behaviors obtaining useful information to classify the various failure modes. The proposed approach evolved from a mere simulation of the item, allowing only an item-level failure mode classification up to a vehicle-level analysis. The propagation of the failure modes’ effects on the whole vehicle enables us to assess the impacts on the vehicle’s drivability, improving the quality of the classifications. It can be advantageous where it is difficult to predict how the item-level misbehaviors propagate to the vehicle level, as in the case of a virtual differential gear or the mobility system of a robot. It has been chosen since it can be considered similar to the novel light vehicles, such as electric scooters, that are becoming more and more popular. Moreover, my research group has complete access to its design since it is realized by our university’s DIANA students’ team. When a SPICE-level simulation is too long to be performed, or it is not possible to develop a complete model of the item due to intellectual property protection rules, it is possible to aid this process through behavioral models of the item. A simulation of this kind has been performed on a mobile robotic system. Behavioral models of the electronic components were used, alongside mechanical simulations, to assess the software failure mitigation capabilities. Another contribution has been obtained by modifying the main one. The idea was to make it possible to aid also the Hazard Analysis and Risk Assessment (HARA). This assessment is performed during the concept phase, so before starting to design the item implementation. Its goal is to determine the hazards involved in the item functionality and their associated levels of risk. The end goal of this phase is a list of safety goals. For each one of these safety goals, an ASIL has to be determined. Since HARA relies only on designers expertise and knowledge, it lacks in objectivity and repeatability. Thanks to the simulation results, it is possible to predict the effects of the failures on the vehicle’s drivability, allowing us to improve the severity and controllability assessment, thus improving the objectivity. Moreover, since simulation conditions can be stored, it is possible, at any time, to recheck the results and to add new scenarios, improving the repeatability. The third group of contributions is about the real-time verification of embedded software. Through Hardware-In-the-Loop (HIL), a software integration verification has been performed to test a fundamental automotive component, mixed-criticality applications, and multi-agent robots. The first of these contributions is about real-time tests on Body Control Modules (BCM). These modules manage various electronic accessories in the vehicle’s body, like power windows and mirrors, air conditioning, immobilizer, central locking. The main characteristics of BCMs are the communications with other embedded computers via the car’s vehicle bus (Controller Area Network) and to have a high number (hundreds) of low-speed I/Os. As the second contribution, I propose a methodology to assess the error recovery system’s effects on mixed-criticality applications regarding deadline misses. The system runs two tasks: a critical airplane longitudinal control and a non-critical image compression algorithm. I start by presenting the approach on a benchmark application containing an instrumented bug into the lower criticality task; then, we improved it by injecting random errors inside the lower criticality task’s memory space through a debugger. In the latter case, thanks to the HIL, it is possible to pause the time domain simulation when the debugger operates and resume it once the injection is complete. In this way, it is possible to interact with the target without interfering with the simulation results, combining a full control of the target with an accurate time-domain assessment. The last contribution of this third group is about a methodology to verify, on multi-agent robots, the synchronization between two agents in charge to move the end effector of a delta robot: the correct position and speed of the end effector at any time is strongly affected by a loss of synchronization. The last two contributions may seem unrelated to the automotive industry, but interest in these applications is gaining. Mixed-criticality systems allow reducing the number of ECUs inside cars (for cost reduction), while the multi-agent approach is helpful to improve the cooperation of the connected cars with respect to other vehicles and the infrastructure. The fourth contribution, contained in the appendix, is about a machine learning application to improve the social acceptance of autonomous vehicles. The idea is to improve the comfort of the passengers by recognizing their emotions. I started with the idea to modify the vehicle’s driving style based on a real-time emotions recognition system but, due to the difficulties of performing such operations in an experimental setup, I move to analyze them offline. The emotions are determined on volunteers’ facial expressions recorded while viewing 3D representa- tions showing different calibrations. Thanks to the passengers’ emotional responses, it is possible to choose the better calibration from the comfort point of view

Integration of fault tolerance and hardware redundancy techniques into the design of mobile platforms

This work addresses the development of a fault-tolerant mobile platform. Fault-tolerant mechanical system design is an emerging technology that attempts to build highly reliable systems by incorporating hardware and software architectures. For this purpose, previous work in fault-tolerant were reviewed. Alternate architectures were evaluated to maximize the fault tolerance capabilities of the driving and steering systems of a mobile platform. The literature review showed that most of the research work on fault tolerance has been done in the area of kinematics and control systems of robotic arms. Therefore, hardware redundancy and fault tolerance in mobile robots is an area to be researched. The prototype constructed as part of this work demonstrated basic principles and uses of a fault-tolerant mechanism, and is believed to be the first such system in its class. It is recommended that different driving and steering architectures, and the fault-tolerant controllers\u27 performance be tested on this prototype

Realization and Lateral Stable Workspace Analysis of an Axially Symmetric Scalable Hexapod Robot

The maintenance and inspection of societal structures and equipment such as skyscrapers, bridges, and ship hulls are important to maintaining a safe lifestyle. Improper maintanance and delayed inspection can lead to catastrophic failure. In lieu of placing humans in potential harm, mobile robotic machining systems can be used to enable remote repair and maintenance within constrictive, hazardous, and inaccessible environments. Due to their intrinsic high mobility and 6-DOF control, hexapod walking robots are a salient solution to mobile machining. However, the static structure of traditional hexapod robots can be rather limiting when attempting to traverse over irregular terrain or manipulating objects. This research realizes a new scalable hexapod robot and analyzes the lateral stable workspace of the robot under different external loading conditions. The scalable design allows the robot to extend its legs which enhances the workspace and improves stability while manuevering through constrictive and irregular terrain. The design incorporates two additional prismatic joints into the legs of the traditional hexapod robot design providing a compact, rigid, and efficient design. The electronic printed circuit boards were designed and assembled in-house. A distributed control architecture was implemented to off-load low-level leg control to dedicated leg controllers. An analysis on the lateral stable workspace of the scalable hexapod robot under different external loading conditions is presented. A dynamic stable workspace criterion is derived. The stable workspace criterion provides a metric for comparing stable workspaces between hexapod robots with different configurations. Multiple simulations and physical experiments were conducted to demonstrate the advantages of a scalability in hexapod designs

A Tread/Limb/Serpentine Hybrid Robot: Toward Hypermobility in Deconstructed Environments

According to the Red Cross, an average of over 600 disasters and 100,000 associated deaths occur annually throughout the world. This frequency of disasters strains an already overburdened disaster response effort. In the first 48 hours of a rescue operation, it is estimated that a responder will get less than three hours of continuous sleep as they need to work at full force to set up the operation and begin work in the field. This leads to sleep deprivation during the most critical time for search and rescue of victims. Therefore, robots are greatly needed as a force multiplier in USAR response to reduce some of the burden and workload placed on the human rescue workers to make for a more efficient and effective response

Development of An In Vivo Robotic Camera for Dexterous Manipulation and Clear Imaging

Minimally invasive surgeriy (MIS) techniques are becoming more popular as replacements for traditional open surgeries. These methods benefit patients with lowering blood loss and post-operative pain, reducing recovery period and hospital stay time, decreasing surgical area scarring and cosmetic issues, and lessening the treatment costs, hence greater patient satisfaction would be earned. Manipulating surgical instruments from outside of abdomen and performing surgery needs precise hand-eye coordination which is provided by insertable cameras. The traditional MIS insertable cameras suffer from port complexity and reduced manipulation dexterity, which leads to defection in Hand-eye coordination and surgical flow. Fully insertable robotic camera systems emerged as a promising solution in MIS. Implementing robotic camera systems faces multiple challenges in fixation, manipulation, orientation control, tool-tissue interaction, in vivo illumination and clear imaging.In this dissertation a novel actuation and control mechanism is developed and validated for an insertable laparoscopic camera. This design uses permanent magnets and coils as force/torque generators in an external control unit to manipulate an in vivo camera capsule. The motorless design of this capsule reduces the, wight, size and power consumption of the driven unit. In order to guarantee the smooth motion of the camera inside the abdominal cavity, an interaction force control method was proposed and validated.Optimizing the system\u27s design, through minimizing the control unit size and power consumption and extending maneuverability of insertable camera, was achieved by a novel transformable design, which uses a single permanent magnet in the control unit. The camera robot uses a permanent magnet as fixation and translation unit, and two embedded motor for tilt motion actuation, as well as illumination actuation. Transformable design provides superior imaging quality through an optimized illumination unit and a cleaning module. The illumination module uses freeform optical lenses to control light beams from the LEDs to achieve optimized illumination over surgical zone. The cleaning module prevents lens contamination through a pump actuated debris prevention system, while mechanically wipes the lens in case of contamination. The performance of transformable design and its modules have been assessed experimentally

Nonlinear Modeling and Control of Driving Interfaces and Continuum Robots for System Performance Gains

With the rise of (semi)autonomous vehicles and continuum robotics technology and applications, there has been an increasing interest in controller and haptic interface designs. The presence of nonlinearities in the vehicle dynamics is the main challenge in the selection of control algorithms for real-time regulation and tracking of (semi)autonomous vehicles. Moreover, control of continuum structures with infinite dimensions proves to be difficult due to their complex dynamics plus the soft and flexible nature of the manipulator body. The trajectory tracking and control of automobile and robotic systems requires control algorithms that can effectively deal with the nonlinearities of the system without the need for approximation, modeling uncertainties, and input disturbances. Control strategies based on a linearized model are often inadequate in meeting precise performance requirements. To cope with these challenges, one must consider nonlinear techniques. Nonlinear control systems provide tools and methodologies for enabling the design and realization of (semi)autonomous vehicle and continuum robots with extended specifications based on the operational mission profiles. This dissertation provides an insight into various nonlinear controllers developed for (semi)autonomous vehicles and continuum robots as a guideline for future applications in the automobile and soft robotics field. A comprehensive assessment of the approaches and control strategies, as well as insight into the future areas of research in this field, are presented.First, two vehicle haptic interfaces, including a robotic grip and a joystick, both of which are accompanied by nonlinear sliding mode control, have been developed and studied on a steer-by-wire platform integrated with a virtual reality driving environment. An operator-in-the-loop evaluation that included 30 human test subjects was used to investigate these haptic steering interfaces over a prescribed series of driving maneuvers through real time data logging and post-test questionnaires. A conventional steering wheel with a robust sliding mode controller was used for all the driving events for comparison. Test subjects operated these interfaces for a given track comprised of a double lane-change maneuver and a country road driving event. Subjective and objective results demonstrate that the driver’s experience can be enhanced up to 75.3% with a robotic steering input when compared to the traditional steering wheel during extreme maneuvers such as high-speed driving and sharp turn (e.g., hairpin turn) passing. Second, a cellphone-inspired portable human-machine-interface (HMI) that incorporated the directional control of the vehicle as well as the brake and throttle functionality into a single holistic device will be presented. A nonlinear adaptive control technique and an optimal control approach based on driver intent were also proposed to accompany the mechatronic system for combined longitudinal and lateral vehicle guidance. Assisting the disabled drivers by excluding extensive arm and leg movements ergonomically, the device has been tested in a driving simulator platform. Human test subjects evaluated the mechatronic system with various control configurations through obstacle avoidance and city road driving test, and a conventional set of steering wheel and pedals were also utilized for comparison. Subjective and objective results from the tests demonstrate that the mobile driving interface with the proposed control scheme can enhance the driver’s performance by up to 55.8% when compared to the traditional driving system during aggressive maneuvers. The system’s superior performance during certain vehicle maneuvers and approval received from the participants demonstrated its potential as an alternative driving adaptation for disabled drivers. Third, a novel strategy is designed for trajectory control of a multi-section continuum robot in three-dimensional space to achieve accurate orientation, curvature, and section length tracking. The formulation connects the continuum manipulator dynamic behavior to a virtual discrete-jointed robot whose degrees of freedom are directly mapped to those of a continuum robot section under the hypothesis of constant curvature. Based on this connection, a computed torque control architecture is developed for the virtual robot, for which inverse kinematics and dynamic equations are constructed and exploited, with appropriate transformations developed for implementation on the continuum robot. The control algorithm is validated in a realistic simulation and implemented on a six degree-of-freedom two-section OctArm continuum manipulator. Both simulation and experimental results show that the proposed method could manage simultaneous extension/contraction, bending, and torsion actions on multi-section continuum robots with decent tracking performance (e.g. steady state arc length and curvature tracking error of 3.3mm and 130mm-1, respectively). Last, semi-autonomous vehicles equipped with assistive control systems may experience degraded lateral behaviors when aggressive driver steering commands compete with high levels of autonomy. This challenge can be mitigated with effective operator intent recognition, which can configure automated systems in context-specific situations where the driver intends to perform a steering maneuver. In this article, an ensemble learning-based driver intent recognition strategy has been developed. A nonlinear model predictive control algorithm has been designed and implemented to generate haptic feedback for lateral vehicle guidance, assisting the drivers in accomplishing their intended action. To validate the framework, operator-in-the-loop testing with 30 human subjects was conducted on a steer-by-wire platform with a virtual reality driving environment. The roadway scenarios included lane change, obstacle avoidance, intersection turns, and highway exit. The automated system with learning-based driver intent recognition was compared to both the automated system with a finite state machine-based driver intent estimator and the automated system without any driver intent prediction for all driving events. Test results demonstrate that semi-autonomous vehicle performance can be enhanced by up to 74.1% with a learning-based intent predictor. The proposed holistic framework that integrates human intelligence, machine learning algorithms, and vehicle control can help solve the driver-system conflict problem leading to safer vehicle operations

Advanced Mobile Robotics: Volume 3

Mobile robotics is a challenging field with great potential. It covers disciplines including electrical engineering, mechanical engineering, computer science, cognitive science, and social science. It is essential to the design of automated robots, in combination with artificial intelligence, vision, and sensor technologies. Mobile robots are widely used for surveillance, guidance, transportation and entertainment tasks, as well as medical applications. This Special Issue intends to concentrate on recent developments concerning mobile robots and the research surrounding them to enhance studies on the fundamental problems observed in the robots. Various multidisciplinary approaches and integrative contributions including navigation, learning and adaptation, networked system, biologically inspired robots and cognitive methods are welcome contributions to this Special Issue, both from a research and an application perspective

Truck Differential and Rear Axle Modeling

Physical modeling of the driveline is crucial in many areas within the commercial vehicle industries. To have an accurate model helps the understanding of physical phenomena and is important when performing computational tests and when designing, for example, traction controllers. The differential gear is often modeled as simple as possible, neglecting more complex behaviour. The main goal with this thesis is to create a model of the differential that takes into account some of these neglected properties. To be able to test and observe the behaviour of the differential, a complete driveline is modeled, extending from the engine to the wheels. The driveline model is then validated using existing measurement data. The results from the tests performed on the model show that there are minor differences on the wheel velocities if the differential is modeled using a more physical approach. Especially the differential behaviour have been shown to accurately describe some of the important features, improving model usability. Implementation of a more complex differential model depends on the area of usage of the model. In addition to driveline modeling, a novel traction controller has been developed and implemented, using the model developed. The controller has shown interesting features such as constraints and prediction, however, further investigations are required to achieve desired performance