803 research outputs found

    Application of reinforcement learning in robotic disassembly operations

    Get PDF
    Disassembly is a key step in remanufacturing. To increase the level of automation in disassembly, it is necessary to use robots that can learn to perform new tasks by themselves rather than having to be manually reprogrammed every time there is a different job. Reinforcement Learning (RL) is a machine learning technique that enables the robots to learn by trial and error rather than being explicitly programmed. In this thesis, the application of RL to robotic disassembly operations has been studied. Firstly, a literature review on robotic disassembly and the application of RL in contact-rich tasks has been conducted in Chapter 2. To physically implement RL in robotic disassembly, the task of removing a bolt from a door chain lock has been selected as a case study, and a robotic training platform has been built for this implementation in Chapter 3. This task is chosen because it can demonstrate the capabilities of RL to pathfinding and dealing with reaction forces without explicitly specifying the target coordinates or building a force feedback controller. The robustness of the learned policies against the imprecision of the robot is studied by a proposed method to actively lower the precision of the robots. It has been found that the robot can learn successfully even when the precision is lowered to as low as ±0.5mm. This work also investigates whether learned policies can be transferred among robots with different precisions. Experiments have been performed by training a robot with a certain precision on a task and replaying the learned skills on a robot with different precision. It has been found that skills learned by a low-precision robot can perform better on a robot with higher precision, and skills learned by a high-precision robot have worse performance on robots with lower precision, as it is suspected that the policies trained on high-precision robots have been overfitted to the precise robots. In Chapter 4, the approach of using a digital-twin-assisted simulation-to-reality transfer to accelerate the learning performance of the RL has been investigated. To address the issue of identifying the system parameters, such as the stiffness and damping of the contact models, that are difficult to measure directly but are critical for building the digital twins of the environments, system identification method is used to minimise the discrepancy between the response generated from the physical and digital environments by using the Bees Algorithm. It is found that the proposed method effectively increases RL's learning performance. It is also found that it is possible to have worse performance with the sim-to-real transfer if the reality gap is not effectively addressed. However, increasing the size of the dataset and optimisation cycles have been demonstrated to reduce the reality gap and lead to successful sim-to-real transfers. Based on the training task described in Chapters 4 and 5, a full factorial study has been conducted to identify patterns when selecting the appropriate hyper-parameters when applying the Deep Deterministic Policy Gradient (DDPG) algorithm to the robotic disassembly task. Four hyper-parameters that directly influence the decision-making Artificial Neural Network (ANN) update have been chosen for the study, with three levels assigned to each hyper-parameter. After running 241 simulations, it is found that for this particular task, the learning rates of the actor and critic networks are the most influential hyper-parameters, while the batch size and soft update rate have relatively limited influence. Finally, the thesis is concluded in Chapter 6 with a summary of findings and suggested future research directions

    Machine Learning Meets Advanced Robotic Manipulation

    Full text link
    Automated industries lead to high quality production, lower manufacturing cost and better utilization of human resources. Robotic manipulator arms have major role in the automation process. However, for complex manipulation tasks, hard coding efficient and safe trajectories is challenging and time consuming. Machine learning methods have the potential to learn such controllers based on expert demonstrations. Despite promising advances, better approaches must be developed to improve safety, reliability, and efficiency of ML methods in both training and deployment phases. This survey aims to review cutting edge technologies and recent trends on ML methods applied to real-world manipulation tasks. After reviewing the related background on ML, the rest of the paper is devoted to ML applications in different domains such as industry, healthcare, agriculture, space, military, and search and rescue. The paper is closed with important research directions for future works

    Evaluating EEG–EMG Fusion-Based Classification as a Method for Improving Control of Wearable Robotic Devices for Upper-Limb Rehabilitation

    Get PDF
    Musculoskeletal disorders are the biggest cause of disability worldwide, and wearable mechatronic rehabilitation devices have been proposed for treatment. However, before widespread adoption, improvements in user control and system adaptability are required. User intention should be detected intuitively, and user-induced changes in system dynamics should be unobtrusively identified and corrected. Developments often focus on model-dependent nonlinear control theory, which is challenging to implement for wearable devices. One alternative is to incorporate bioelectrical signal-based machine learning into the system, allowing for simpler controller designs to be augmented by supplemental brain (electroencephalography/EEG) and muscle (electromyography/EMG) information. To extract user intention better, sensor fusion techniques have been proposed to combine EEG and EMG; however, further development is required to enhance the capabilities of EEG–EMG fusion beyond basic motion classification. To this end, the goals of this thesis were to investigate expanded methods of EEG–EMG fusion and to develop a novel control system based on the incorporation of EEG–EMG fusion classifiers. A dataset of EEG and EMG signals were collected during dynamic elbow flexion–extension motions and used to develop EEG–EMG fusion models to classify task weight, as well as motion intention. A variety of fusion methods were investigated, such as a Weighted Average decision-level fusion (83.01 ± 6.04% accuracy) and Convolutional Neural Network-based input-level fusion (81.57 ± 7.11% accuracy), demonstrating that EEG–EMG fusion can classify more indirect tasks. A novel control system, referred to as a Task Weight Selective Controller (TWSC), was implemented using a Gain Scheduling-based approach, dictated by external load estimations from an EEG–EMG fusion classifier. To improve system stability, classifier prediction debouncing was also proposed to reduce misclassifications through filtering. Performance of the TWSC was evaluated using a developed upper-limb brace simulator. Due to simulator limitations, no significant difference in error was observed between the TWSC and PID control. However, results did demonstrate the feasibility of prediction debouncing, showing it provided smoother device motion. Continued development of the TWSC, and EEG–EMG fusion techniques will ultimately result in wearable devices that are able to adapt to changing loads more effectively, serving to improve the user experience during operation

    Improving Automated Operations of Heavy-Duty Manipulators with Modular Model-Based Control Design

    Get PDF
    The rapid development of robotization and automation in mobile working machines aims to increase productivity and safety in many industrial sectors. In heavy-duty applications, hydraulically actuated manipulators are the common solution due to their large power-to-weight ratio. As hydraulic systems can exhibit nonlinear dynamic behavior, automated operations with closed-loop control become challenging. In industrial applications, the dexterity of operations for manipulators is ensured by providing interfaces to equip product variants with diïŹ€erent tool attachments. By considering these domain-speciïŹc tool attachments for heavy-duty hydraulic manipulators (HHMs), the autonomous robotic operating development for all product variants might be a time-consuming process. This thesis aims to develop a modular nonlinear model-based (NMB) control method for HHMs to enable systematic NMB model reuse and control system modularity across diïŹ€erent HHM product variants with actuators and tool attachments. Equally importantly, the properties of NMB control are used to improve the high-performance control for multi degrees-of-freedom robotic HHMs, as rigorously stability-guaranteed control systems have been shown to provide superior performance. To achieve these objectives, four research problems (RPs) on HHM controls are addressed. The RPs are focused on damping control methods in underactuated tool attachments, compensating for static actuator nonlinearities, and, equally signiïŹcantly, improving overall control performance. The fourth RP is introduced for hydraulic series elastic actuators (HSEAs) in HHM applications, which can be regarded as supplementing NMB control with the aim of improving force controllability. Six publications are presented to investigate the RPs in this thesis. The control development focus was on modular NMB control design for HHMs equipped with diïŹ€erent actuators and tool attachments consisting of passive and actuated joints. The designed control methods were demonstrated on a full-size HHM and a novel HSEA concept in a heavy-duty experimental setup. The results veriïŹed that modular control design for HHM systems can be used to decrease the modiïŹcations required to use the manipulator with diïŹ€erent tool attachments and ïŹ‚oating-base environments

    Development of Motion Control Systems for Hydraulically Actuated Cranes with Hanging Loads

    Get PDF
    Automation has been used in industrial processes for several decades to increase efficiency and safety. Tasks that are either dull, dangerous, or dirty can often be performed by machines in a reliable manner. This may provide a reduced risk to human life, and will typically give a lower economic cost. Industrial robots are a prime example of this, and have seen extensive use in the automotive industry and manufacturing plants. While these machines have been employed in a wide variety of industries, heavy duty lifting and handling equipment such as hydraulic cranes have typically been manually operated. This provides an opportunity to investigate and develop control systems to push lifting equipment towards the same level of automation found in the aforementioned industries. The use of winches and hanging loads on cranes give a set of challenges not typically found on robots, which requires careful consideration of both the safety aspect and precision of the pendulum-like motion. Another difference from industrial robots is the type of actuation systems used. While robots use electric motors, the cranes discussed in this thesis use hydraulic cylinders. As such, the dynamics of the machines and the control system designmay differ significantly. In addition, hydraulic cranes may experience significant deflection when lifting heavy loads, arising from both structural flexibility and the compressibility of the hydraulic fluid. The work presented in this thesis focuses on motion control of hydraulically actuated cranes. Motion control is an important topic when developing automation systems, as moving from one position to another is a common requirement for automated lifting operations. A novel path controller operating in actuator space is developed, which takes advantage of the load-independent flow control valves typically found on hydraulically actuated cranes. By operating in actuator space the motion of each cylinder is inherently minimized. To counteract the pendulum-like motion of the hanging payload, a novel anti-swing controller is developed and experimentally verified. The anti-swing controller is able to suppress the motion from the hanging load to increase safety and precision. To tackle the challenges associated with the flexibility of the crane, a deflection compensator is developed and experimentally verified. The deflection compensator is able to counteract both the static deflection due to gravity and dynamic de ection due to motion. Further, the topic of adaptive feedforward control of pressure compensated cylinders has been investigated. A novel adaptive differential controller has been developed and experimentally verified, which adapts to system uncertainties in both directions of motion. Finally, the use of electro-hydrostatic actuators for motion control of cranes has been investigated using numerical time domain simulations. A novel concept is proposed and investigated using simulations.publishedVersio

    Engineering for a changing world: 60th Ilmenau Scientific Colloquium, Technische UniversitÀt Ilmenau, September 04-08, 2023 : programme

    Get PDF
    In 2023, the Ilmenau Scientific Colloquium is once more organised by the Department of Mechanical Engineering. The title of this year’s conference “Engineering for a Changing World” refers to limited natural resources of our planet, to massive changes in cooperation between continents, countries, institutions and people – enabled by the increased implementation of information technology as the probably most dominant driver in many fields. The Colloquium, supplemented by workshops, is characterised but not limited to the following topics: – Precision engineering and measurement technology Nanofabrication – Industry 4.0 and digitalisation in mechanical engineering – Mechatronics, biomechatronics and mechanism technology – Systems engineering – Productive teaming - Human-machine collaboration in the production environment The topics are oriented on key strategic aspects of research and teaching in Mechanical Engineering at our university

    Surgical Subtask Automation for Intraluminal Procedures using Deep Reinforcement Learning

    Get PDF
    Intraluminal procedures have opened up a new sub-field of minimally invasive surgery that use flexible instruments to navigate through complex luminal structures of the body, resulting in reduced invasiveness and improved patient benefits. One of the major challenges in this field is the accurate and precise control of the instrument inside the human body. Robotics has emerged as a promising solution to this problem. However, to achieve successful robotic intraluminal interventions, the control of the instrument needs to be automated to a large extent. The thesis first examines the state-of-the-art in intraluminal surgical robotics and identifies the key challenges in this field, which include the need for safe and effective tool manipulation, and the ability to adapt to unexpected changes in the luminal environment. To address these challenges, the thesis proposes several levels of autonomy that enable the robotic system to perform individual subtasks autonomously, while still allowing the surgeon to retain overall control of the procedure. The approach facilitates the development of specialized algorithms such as Deep Reinforcement Learning (DRL) for subtasks like navigation and tissue manipulation to produce robust surgical gestures. Additionally, the thesis proposes a safety framework that provides formal guarantees to prevent risky actions. The presented approaches are evaluated through a series of experiments using simulation and robotic platforms. The experiments demonstrate that subtask automation can improve the accuracy and efficiency of tool positioning and tissue manipulation, while also reducing the cognitive load on the surgeon. The results of this research have the potential to improve the reliability and safety of intraluminal surgical interventions, ultimately leading to better outcomes for patients and surgeons

    An Application of Modified T2FHC Algorithm in Two-Link Robot Controller

    Get PDF
    Parallel robotic systems have shown their advantages over the traditional serial robots such as high payload capacity, high speed, and high precision. Their applications are widespread from transportation to manufacturing fields. Therefore, most of the recent studies in parallel robots focus on finding the best method to improve the system accuracy. Enhancing this metric, however, is still the biggest challenge in controlling a parallel robot owing to the complex mathematical model of the system. In this paper, we present a novel solution to this problem with a Type 2 Fuzzy Coherent Controller Network (T2FHC), which is composed of a Type 2 Cerebellar Model Coupling Controller (CMAC) with its fast convergence ability and a Brain Emotional Learning Controller (BELC) using the Lyaponov-based weight updating rule. In addition, the T2FHC is combined with a surface generator to increase the system flexibility. To evaluate its applicability in real life, the proposed controller was tested on a Quanser 2-DOF robot system in three case studies: no load, 180 g load and 360 g load, respectively. The results showed that the proposed structure achieved superior performance compared to those of available algorithms such as CMAC and Novel Self-Organizing Fuzzy CMAC (NSOF CMAC). The Root Mean Square Error (RMSE) index of the system that was 2.20E-06 for angle A and 2.26E-06 for angle B and the tracking error that was -6.42E-04 for angle A and 2.27E-04 for angle B demonstrate the good stability and high accuracy of the proposed T2FHC. With this outstanding achievement, the proposed method is promising to be applied to many applications using nonlinear systems

    Safe navigation and human-robot interaction in assistant robotic applications

    Get PDF
    L'abstract Ăš presente nell'allegato / the abstract is in the attachmen
    • 

    corecore