타이어 모델을 사용한 자율 드리프트 주행 제어 설계 및 분석

학위논문 (석사)-- 서울대학교 대학원 : 공과대학 기계항공공학부, 2019. 2. 이동준.본 논문에서는 Wheeled Mobile Robot(WMR)의자율드리프트 드라이빙 컨트롤러를 디자인 하고 분석하며, 이를 상용 프로그램인 CarSim을 사용한 시뮬레이션을 통하여 알고리즘을 검증 한다. 첫째로, WMR의 다이나믹스와 타이어 모델을 정의 하고, 이러한 모델로 인한 제약 사항에 대하여 논의한다. 다음으로, 사람의 관점에서 드리프트 드라이빙을 분석하고, 드리프트 드라이빙 제어기의 제어 목적을 정의한다. (차량의 방향과 요 각속도를 제어한다.) 드리프트 드라이빙 제어기는 고-레벨 제어, 목표 값을 찾기 위한 최적화 그리고 고-게인 제어로 구성된다. 다음으로, 제어하지 않는 속도에 대한 분석을 진행하였다. 마지막으로 제안한 알고리즘을 CarSim 시뮬 레이터를 이용하여 검증하였다. 정상 상태의 드리프트 시뮬레이션 결과와, 헤어핀 경로에 대한 드리프트 시뮬레이션 결과를 제시 한다.Control design and analysis of Wheeled Mobile Robot(WMR) autonomous drift-driving and the simulation experiment using the CarSim simulator are presented and the analysis of the controller proceeds. We first introduce WMR dynamics, tire model and problem formulation of the WMR. We then design drift-driving control using human strategy (control side slip angle and yaw rate). The drift-driving control consists of high-level control, optimization to find desired control input and high-gain control. We analyze the uncontrolled velocity dynamics and stability of the controller. The CarSim simulation results of drift-driving on steady-state equilibriums and the hairpin path with the desired yaw rate are provided.List of Figures - v List of Tables - vi Abbreviations - vii 1 Introduction - 1 1.1 Motivation and related works . . . . . . . . . . . . . . . . . . . . 1 1.2 Contribution of this work . . . . . . . . . . . . . . . . . . . . . . 3 2 System Modeling - 5 2.1 Model dynamics . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2.2 Tire model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 2.3 Problemformulation . . . . . . . . . . . . . . . . . . . . . . . . . 9 3 Drift-Driving Control Design - 10 3.1 High-level control . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 3.2 Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 3.3 High-gain control . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 4 Analysis of Control - 17 4.1 Internal dynamics . . . . . . . . . . . . . . . . . . . . . . . . . . 17 4.2 Stability analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 5 Simulation Results - 25 5.1 Simulation setup . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 5.2 Steady-state drift-driving . . . . . . . . . . . . . . . . . . . . . . 27 5.3 Hairpin turn drift-driving . . . . . . . . . . . . . . . . . . . . . . 33 6 Conclusion and Future Work - 40 6.1 Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 6.2 Future work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41Maste

분산형 통신 및 구동부족 로봇시스템 을 위한 분할기법 기반의 반자율 원격제어 프레임워크 개발

학위논문 (박사)-- 서울대학교 대학원 : 공과대학 기계항공공학부, 2018. 2. 이동준.The framework of stable bilateral teleoperation has been well established during decades. However, the standard bilateral teleoperation framework could be a baseline for a successful telerobotics but not sufficient for real-application because they usually concentrate on only the bilateral stability. The least considered in the previous research is how to apply a complex robot systems such as multiple mobile robots or a large degree of freedom mobile manipulators for real applications. The main challenges of teleoperation of complex robotic systems in real-world are to achieve two different control objectives (i.e., follow the human command and the coordination/ stabilization of the internal movement) of the slave robots simultaneously, while providing intuitive information about the complicated features of the system. In this thesis, we develop decomposition-based semi-autonomous teleoperation framework for robotic systems which have distributed communication and underactuation property, consisting of three steps: 1) decomposition step, where the human command is defined, and the robotic system is split into the command tracking space and its orthogonal complement (i.e., internal motion)2) control design of the slave robot, in which we design the slave controller for human command tracking and stabilization/coordination of internal motion spaceand 3) feedback interface design, through which we propose a multi-modal feedback interface (for example, visual and haptic) designed with the consideration of the task and the characteristics of the system. Among numerous types of robots, in this thesis, we focus on two types of robotic systems: 1) multiple nonholonomic wheeled mobile robots (WMRs) with distributed communication requirement and 2) manipulator-stage over vertical flexible beam which is under-actuated system. The proposed framework is applied to both case step by step and perform experiments and human subject study to verify/demonstrate the proposed framework for both cases. For distributed WMRs, we consider the scenario that a single user remotely operates a platoon of nonholonomic WMRs that distributively communicate each other in unknown environment. For this, in decomposition step, we utilize nonholonomic passive decomposition to split the platoon kinematics into that of the formation-keeping aspect and the collective tele-driving aspect. Next, in control design step, we design the controls for these two aspects individually and distribute them into each WMR while fully incorporating their nonholonomic constraint and distribution requirement. Finally, in the step of feedback interface design, we also propose a novel predictive display, which, by providing the user with the estimated current and predicted future pose informations of the platoon and future possibility of collision while fully incorporating the uncertainty inherent to the distribution, can significantly enhance the tele-driving performance and easiness of the platoon. The second part is the manipulator-stage over vertical flexible beam which is under-actuated system. Here, the human command defines the desired motion of the end-effector (or the manipulator), and the vibration of the beam should be subdued at the same time. Thus, at the first step, we utilize the passive decomposition to split the dynamics into manipulator motion space and its orthogonal complement, in which we design the control for the suppression of the vibration. For human command tracking, we design the passivity-based control, and, for the suppression of the vibration, we propose two controls: LQR-based control and nonlinear control based on Lyapunov function analysis. Finally, visuo-haptic feedback interface is preliminarily designed for successful peg-in-hole tasks.1 Introduction 1 1.1 Background and Contribution 1 1.2 Related Works 4 1.2.1 Related Works on Distributed Systems 5 1.2.2 Related Works on Manipulator-Stage System 6 1.3 Outline 6 2 Preliminary 7 2.1 Passive Decomposition 7 2.1.1 Basic Notations and Properties of Standard Passive Decomposition 7 2.1.2 Nonholonomic Passive Decomposition 9 3 Semi-Autonomous Teleoperation of Nonholonomic Wheeled Mobile Robots with Distributed Communication 11 3.1 Distributed Control Design 11 3.1.1 Nonholonomic Passive Decomposition 11 3.1.2 Control Design and Distribution 19 3.2 Distributed Pose Estimation 25 3.2.1 EKF Pose Estimation of Leader WMR 25 3.2.2 EKF Pose Estimation of Follower WMRs 28 3.3 Predictive Display for Distributed Robots Teleoperation 29 3.3.1 Estimation Propagation 31 3.3.2 Prediction Propagation 34 3.4 Experiments 38 3.4.1 Test Setup 38 3.4.2 Performance Experiment 39 3.4.3 Teleoperation Experiment with Predictive Display 40 3.4.4 Human Subject Study 44 4 Semi-Autonomous Teleoperatoin of Stage-Manipulator System on Flexible Vertical Beam 49 4.1 System Modeling 49 4.1.1 System Description 49 4.1.2 Assumed Mode Shapes 51 4.1.3 Exact Solution under Given Boundary Conditions 51 4.1.4 Euler-Lagrangian Equation 61 4.2 LQR-based Control Design 62 4.2.1 Passive Decomposition 63 4.2.2 Vibration Suppression Control Design 64 4.2.3 Joint Tracking Control Design 66 4.3 Lyapunov-based Control Design 68 4.3.1 Twice Passive Decomposition for Input Coupling 69 4.3.2 Interconnected System Description 70 4.3.3 Passivity-based Manipulator Motion Control 74 4.3.4 Dissipative Control for Vibration Suppression 74 4.4 Experiments 78 4.4.1 Test Setup 78 4.4.2 Joint Tracking and Vibration Suppression Experiment 81 4.4.3 Comparison Experiment between the LQR and the Nonlinear Control 82 5 Conclusion 83 5.1 Summary 83 5.2 Future Works 83 A Appendix 85 A.1 Internal Wrench Representation 85Docto

Advanced teleoperation and control system for industrial robots based on augmented virtuality and haptic feedback

There are some industrial tasks that are still mainly performed manually by human workers due to their complexity, which is the case of surface treatment operations (such as sanding, deburring, finishing, grinding, polishing, etc.) used to repair defects. This work develops an advanced teleoperation and control system for industrial robots in order to assist the human operator to perform the mentioned tasks. On the one hand, the controlled robotic system provides strength and accuracy, holding the tool, keeping the right tool orientation and guaranteeing a smooth approach to the workpiece. On the other hand, the advanced teleoperation provides security and comfort to the user when performing the task. In particular, the proposed teleoperation uses augmented virtuality (i.e., a virtual world that includes non-modeled real-world data) and haptic feedback to provide the user an immersive virtual experience when remotely teleoperating the tool of the robot system to treat arbitrary regions of the workpiece surface. The method is illustrated with a car body surface treatment operation, although it can be easily extended to other surface treatment applications or even to other industrial tasks where the human operator may benefit from robotic assistance. The effectiveness of the proposed approach is shown with several experiments using a 6R robotic arm. Moreover, a comparison of the performance obtained manually by an expert and that obtained with the proposed method has also been conducted in order to show the suitability of the proposed approach

Development and evaluation of mixed reality-enhanced robotic systems for intuitive tele-manipulation and telemanufacturing tasks in hazardous conditions

In recent years, with the rapid development of space exploration, deep-sea discovery, nuclear rehabilitation and management, and robotic-assisted medical devices, there is an urgent need for humans to interactively control robotic systems to perform increasingly precise remote operations. The value of medical telerobotic applications during the recent coronavirus pandemic has also been demonstrated and will grow in the future. This thesis investigates novel approaches to the development and evaluation of a mixed reality-enhanced telerobotic platform for intuitive remote teleoperation applications in dangerous and difficult working conditions, such as contaminated sites and undersea or extreme welding scenarios. This research aims to remove human workers from the harmful working environments by equipping complex robotic systems with human intelligence and command/control via intuitive and natural human-robot- interaction, including the implementation of MR techniques to improve the user's situational awareness, depth perception, and spatial cognition, which are fundamental to effective and efficient teleoperation. The proposed robotic mobile manipulation platform consists of a UR5 industrial manipulator, 3D-printed parallel gripper, and customized mobile base, which is envisaged to be controlled by non-skilled operators who are physically separated from the robot working space through an MR-based vision/motion mapping approach. The platform development process involved CAD/CAE/CAM and rapid prototyping techniques, such as 3D printing and laser cutting. Robot Operating System (ROS) and Unity 3D are employed in the developing process to enable the embedded system to intuitively control the robotic system and ensure the implementation of immersive and natural human-robot interactive teleoperation. This research presents an integrated motion/vision retargeting scheme based on a mixed reality subspace approach for intuitive and immersive telemanipulation. An imitation-based velocity- centric motion mapping is implemented via the MR subspace to accurately track operator hand movements for robot motion control, and enables spatial velocity-based control of the robot tool center point (TCP). The proposed system allows precise manipulation of end-effector position and orientation to readily adjust the corresponding velocity of maneuvering. A mixed reality-based multi-view merging framework for immersive and intuitive telemanipulation of a complex mobile manipulator with integrated 3D/2D vision is presented. The proposed 3D immersive telerobotic schemes provide the users with depth perception through the merging of multiple 3D/2D views of the remote environment via MR subspace. The mobile manipulator platform can be effectively controlled by non-skilled operators who are physically separated from the robot working space through a velocity-based imitative motion mapping approach. Finally, this thesis presents an integrated mixed reality and haptic feedback scheme for intuitive and immersive teleoperation of robotic welding systems. By incorporating MR technology, the user is fully immersed in a virtual operating space augmented by real-time visual feedback from the robot working space. The proposed mixed reality virtual fixture integration approach implements hybrid haptic constraints to guide the operator’s hand movements following the conical guidance to effectively align the welding torch for welding and constrain the welding operation within a collision-free area. Overall, this thesis presents a complete tele-robotic application space technology using mixed reality and immersive elements to effectively translate the operator into the robot’s space in an intuitive and natural manner. The results are thus a step forward in cost-effective and computationally effective human-robot interaction research and technologies. The system presented is readily extensible to a range of potential applications beyond the robotic tele- welding and tele-manipulation tasks used to demonstrate, optimise, and prove the concepts

Advances in Human-Robot Interaction

Rapid advances in the field of robotics have made it possible to use robots not just in industrial automation but also in entertainment, rehabilitation, and home service. Since robots will likely affect many aspects of human existence, fundamental questions of human-robot interaction must be formulated and, if at all possible, resolved. Some of these questions are addressed in this collection of papers by leading HRI researchers

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 12th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2020, held in Leiden, The Netherlands, in September 2020. The 60 papers presented in this volume were carefully reviewed and selected from 111 submissions. The were organized in topical sections on haptic science, haptic technology, and haptic applications. This year's focus is on accessibility

Mobile Robots Navigation

Mobile robots navigation includes different interrelated activities: (i) perception, as obtaining and interpreting sensory information; (ii) exploration, as the strategy that guides the robot to select the next direction to go; (iii) mapping, involving the construction of a spatial representation by using the sensory information perceived; (iv) localization, as the strategy to estimate the robot position within the spatial map; (v) path planning, as the strategy to find a path towards a goal location being optimal or not; and (vi) path execution, where motor actions are determined and adapted to environmental changes. The book addresses those activities by integrating results from the research work of several authors all over the world. Research cases are documented in 32 chapters organized within 7 categories next described

The Benefits of Haptic Feedback in Mobile Phone Camera

Communication is basically the act of transferring information from one place to another. Feedback is a system where the reaction or response of the receiver arrives at the sender after he/she has interpreted the message. Feedback is inevitably essential to make two way communications effective. In fact, without feedback communication remains incomplete. At times, feedback could be verbal such as written and oral. Then in some cases, it could be nonverbal. Feedback is mainly a response from your audiences; it allows you to evaluate the effectiveness of your message. In fact research shows that the majority of the messages that have been sent are nonverbal and the ability to understand and use nonverbal communication is powerful tools that will help people connect with each other. As well as communication where nonverbal shows much more impressive, a sense of touch as known as haptics plays an important role in our new phase of technology. It is the science of applying touch sensation and control to interaction with computer applications by using special input/output devices. It gives users a slight jolt of energy at the point of touch, providing instant sensory feedback, while reducing the audio, visual or audio-visual demand. Haptic technology is an evolutionary step into interacting with objects as an extension of our mind and allows for more socially appropriate and subtle interaction. In this thesis, the benefits of haptic feedback in a mobile phone camera are explored and compared to the existing feedback mechanisms. Discovering expectations from users and gathering ideas in order to improve user experience in haptic feedback of a mobile phone camera will be the main focus as well as to understand “What make end users to use or not to use mobile phone camera?” and “What qualities of haptics could be used in the design of the user interface for mobile phone camera?”. Depending on the settings and the quality of the mobile phones, the feedback from the camera can affect the user experience in many ways. I believe that to improve the existing feedback by applying haptic output such as a vibration or a vibrotactile signal may also considerably improve the user experience. Because haptic feedback is a new technology and proved to be efficient, to apply it to the mobile phone camera feedback should provide better support for users when compared to the existing feedback signals, which are audio and visual only. One of the main objectives was to analyze the users’ needs and expectations regarding the mobile phone camera haptic feedback and applications in various types of difficult situations and challenges users have encountered. Therefore, a user study was done at the beginning of the thesis work. Its aim was to get general results, which can be applied to haptic interaction on the mobile phone camera in order to improve existing applications and help easing users in their photo taking activities with their mobile phone camera. In addition, the results are considered to provide input for further studies as well as to offer concrete input to the development of a prototype