Direct Trajectory Optimization of Free-Floating Space Manipulator for Reducing Spacecraft Variation

This letter investigates the direct trajectory optimization of the free-floating space manipulator (FFSM). The main purpose is to plan the joint space trajectories to reduce the spacecraft motion due to the joint rotation during the FFSM performing tasks. To improve the calculation efficiency, the adaptive Radau pseudospectral method (A-RPM) is applied to discretize the system dynamics and transform the formulated optimal problem into a nonlinear programming problem (NLP). By adaptively subdividing the current segment and assigning collocation points according to the solution error, high-degree interpolation polynomials are avoided. To verify the effectiveness of the proposed method, a ground micro-gravity platform of the FFSM system is designed by using the air-bearing technique, on which experiments are carried out. The results show that the variation of the base spacecraft is dramatically reduced if the joints rotate along the optimized trajectories. Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Learning & Autonomous Contro

Secure Control for Cyber-Physical Systems under Malicious Attacks

This article investigates the secure control problem for cyber-physical systems when the malicious data are injected into the cyber realm, which directly connects to the actuators. Based on moving target defense (MTD) and reinforcement learning, we propose a novel proactive and reactive defense control scheme. First, the system (A,B) is modeled as a switching system consisting of several controllable pairs (A,Bl) to facilitate the construction of the MTD control scheme. The controllable pairs (A,Bl) can be altered to update system dynamics under certain unpredictable switching probabilities for each subsystem, which can prevent the adversaries from effective attacks. Second, both attack detection and isolation schemes are designed to accurately locate and exclude the compromised actuators from a switching sequence. Third, a reinforcement learning algorithm based on the zero-sum game theory is proposed to design the defense control scheme when there exist no controllable subsystems to switch. To demonstrate the effectiveness of the defense control scheme, a three-tank system under unknown cyber attacks is illustrated.Accepted Author ManuscriptRobot Dynamic

Deep reinforcement learning control approach to mitigating actuator attacks

This paper investigates the deep reinforcement learning based secure control problem for cyber–physical systems (CPS) under false data injection attacks. We describe the CPS under attacks as a Markov decision process (MDP), based on which the secure controller design for CPS under attacks is formulated as an action policy learning using data. Rendering the soft actor–critic learning algorithm, a Lyapunov-based soft actor–critic learning algorithm is proposed to offline train a secure policy for CPS under attacks. Different from the existing results, not only the convergence of the learning algorithm but the stability of the system using the learned policy is proved, which is quite important for security and stability-critical applications. Finally, both a satellite attitude control system and a robot arm system are used to show the effectiveness of the proposed scheme, and comparisons between the proposed learning algorithm and the classical PD controller are also provided to demonstrate the advantages of the control algorithm designed in this paper.Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Robot Dynamic

Model-Based Control for Soft Robots With System Uncertainties and Input Saturation

Model-based strategies are a promising solution to the grand challenge of equipping continuum soft robots with motor intelligence. However, finite-dimensional models of these systems are inherently inaccurate, thus posing pressing robustness concerns. Moreover, the actuation space of soft robots is usually limited. This article aims at solving both these challenges by proposing a robust model-based strategy for the shape control of soft robots with system uncertainty and input saturation. The proposed architecture is composed of two key components. First, we propose an observer that estimates deviations between the theoretical model and the soft robot, ensuring that the estimation error converges to zero within finite time. Second, we introduce a sliding mode controller to regulate the soft robot shape while fulfilling saturation constraints. This controller uses the observer's output to compensate for the deviations between the real system and the established model. We prove the convergence of the closed-loop with theoretical analysis and the method's effectiveness with simulations and experiments.Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Learning & Autonomous Contro