Cognitive Reasoning for Compliant Robot Manipulation

Physically compliant contact is a major element for many tasks in everyday environments. A universal service robot that is utilized to collect leaves in a park, polish a workpiece, or clean solar panels requires the cognition and manipulation capabilities to facilitate such compliant interaction. Evolution equipped humans with advanced mental abilities to envision physical contact situations and their resulting outcome, dexterous motor skills to perform the actions accordingly, as well as a sense of quality to rate the outcome of the task. In order to achieve human-like performance, a robot must provide the necessary methods to represent, plan, execute, and interpret compliant manipulation tasks. This dissertation covers those four steps of reasoning in the concept of intelligent physical compliance. The contributions advance the capabilities of service robots by combining artificial intelligence reasoning methods and control strategies for compliant manipulation. A classification of manipulation tasks is conducted to identify the central research questions of the addressed topic. Novel representations are derived to describe the properties of physical interaction. Special attention is given to wiping tasks which are predominant in everyday environments. It is investigated how symbolic task descriptions can be translated into meaningful robot commands. A particle distribution model is used to plan goal-oriented wiping actions and predict the quality according to the anticipated result. The planned tool motions are converted into the joint space of the humanoid robot Rollin' Justin to perform the tasks in the real world. In order to execute the motions in a physically compliant fashion, a hierarchical whole-body impedance controller is integrated into the framework. The controller is automatically parameterized with respect to the requirements of the particular task. Haptic feedback is utilized to infer contact and interpret the performance semantically. Finally, the robot is able to compensate for possible disturbances as it plans additional recovery motions while effectively closing the cognitive control loop. Among others, the developed concept is applied in an actual space robotics mission, in which an astronaut aboard the International Space Station (ISS) commands Rollin' Justin to maintain a Martian solar panel farm in a mock-up environment. This application demonstrates the far-reaching impact of the proposed approach and the associated opportunities that emerge with the availability of cognition-enabled service robots

A Terradynamics of Legged Locomotion on Granular Media

The theories of aero- and hydrodynamics predict animal movement and device design in air and water through the computation of lift, drag, and thrust forces. Although models of terrestrial legged locomotion have focused on interactions with solid ground, many animals move on substrates that flow in response to intrusion. However, locomotor-ground interaction models on such flowable ground are often unavailable. We developed a force model for arbitrarily-shaped legs and bodies moving freely in granular media, and used this "terradynamics" to predict a small legged robot's locomotion on granular media using various leg shapes and stride frequencies. Our study reveals a complex but generic dependence of stresses in granular media on intruder depth, orientation, and movement direction and gives insight into the effects of leg morphology and kinematics on movement

Avoin ja yleispätevä numeeriseen ohjaukseen ja konenäköteknologioihin pohjautuva maksupäätteiden automaattisen hyväksymistestausympäristön arkkitehtuuri

Software testing is a crucial part of modern software development and it is commonly accepted fact that the earlier software defects and errors are found, the lower the cost of correcting those will be. Early detection of errors also increases the possibility to correct them properly. Acceptance testing is a process of comparing the developed program to the initial requirements. Acceptance testing of a system should be executed in an environment as similar as possible to the production environment of the final product. This master's thesis will discuss how to address these in automated acceptance testing environment of payment terminal software. This master's thesis will discuss the theories related to software testing, testing of embedded systems and the challenges related to the topic. Master's thesis will present an architecture for automated acceptance testing of payment terminals including the needed hardware and software.Ohjelmistotestaus on tärkeä osa modernia ohjelmistotuotantoa ja on yleisesti tunnustettu, että mitä aiemmin virheet ohjelmistosta löytyvät, sitä edullisempaa niiden korjaaminen tulee olemaan. Aikainen virheiden havaitseminen myös edesauttaa virheiden perusteellista ja laadukasta korjaamista. Hyväksymistestaus on ohjelmistotestauksen vaihe, jossa kehitettyä ohjelmistoa verrataan alkuperäisiin ohjelmistovaatimuksiin. Ohjelmiston hyväksymistestaus tulisi suorittaa lopullista tuotantoympäristöä mahdollisimman hyvin vastaavassa ympäristössä. Tämä diplomityö käsittelee näitä ohjeistuksia maksupäätteiden automaattisen hyväksymistestauksen ympäristössä. Tämä diplomityö käsittelee ohjelmistotestaukseen liittyvää teoriaa, sulautettujen järjestelmien testausta sekä aiheeseen liittyviä haasteita. Lisäksi diplomityö esittelee ympäristön maksupäätteiden automaattiseen hyväksymistestaukseen ja käsittelee siihen tarvittuja ohjelmistoja ja fyysisiä komponentteja

A Soft Multiple-Degree of Freedom Load Cell Based on The Hall Effect

The goal of this thesis is to develop a soft multiple-degree-of-freedom (multi-DOF) load cell that is robust and light weight for use in robotics applications to sense three axes of force and a single axis of torque. The displacement of the magnet within the elastomer changes the magnetic flux density which is sensed by two 3-axis Hall effect sensors. Experimental measurements of magnetic flux density within the area of interest were used to formulate analytic expressions that relate magnet field strength to the position of the magnet. The displacement and orientation measurement and the material properties of the elastomer are used to calibrate and calculate the applied load. The ability to measure 3-DOF force and axial torque was evaluated with combined loading applied by a robotic arm (KUKA, LBR r820 iiwa). The decoupled results show the 4-DOF load cell was able to distinguish 3-axis force and 1-axis torque with 6.9% averaged error for normal force, 4.3% and 2.6% for shear force in the X and Y axis and 8.6% for the torque. The results show good accuracy for a soft multi-axis sensor that would be applicable in many robotic applications where high accuracy is not required

Development of An In Vivo Robotic Camera for Dexterous Manipulation and Clear Imaging

Minimally invasive surgeriy (MIS) techniques are becoming more popular as replacements for traditional open surgeries. These methods benefit patients with lowering blood loss and post-operative pain, reducing recovery period and hospital stay time, decreasing surgical area scarring and cosmetic issues, and lessening the treatment costs, hence greater patient satisfaction would be earned. Manipulating surgical instruments from outside of abdomen and performing surgery needs precise hand-eye coordination which is provided by insertable cameras. The traditional MIS insertable cameras suffer from port complexity and reduced manipulation dexterity, which leads to defection in Hand-eye coordination and surgical flow. Fully insertable robotic camera systems emerged as a promising solution in MIS. Implementing robotic camera systems faces multiple challenges in fixation, manipulation, orientation control, tool-tissue interaction, in vivo illumination and clear imaging.In this dissertation a novel actuation and control mechanism is developed and validated for an insertable laparoscopic camera. This design uses permanent magnets and coils as force/torque generators in an external control unit to manipulate an in vivo camera capsule. The motorless design of this capsule reduces the, wight, size and power consumption of the driven unit. In order to guarantee the smooth motion of the camera inside the abdominal cavity, an interaction force control method was proposed and validated.Optimizing the system\u27s design, through minimizing the control unit size and power consumption and extending maneuverability of insertable camera, was achieved by a novel transformable design, which uses a single permanent magnet in the control unit. The camera robot uses a permanent magnet as fixation and translation unit, and two embedded motor for tilt motion actuation, as well as illumination actuation. Transformable design provides superior imaging quality through an optimized illumination unit and a cleaning module. The illumination module uses freeform optical lenses to control light beams from the LEDs to achieve optimized illumination over surgical zone. The cleaning module prevents lens contamination through a pump actuated debris prevention system, while mechanically wipes the lens in case of contamination. The performance of transformable design and its modules have been assessed experimentally

Biological, simulation, and robotic studies to discover principles of swimming within granular media

The locomotion of organisms whether by running, flying, or swimming is the result of multiple degree-of-freedom nervous and musculoskeletal systems interacting with an environment that often flows and deforms in response to movement. A major challenge in biology is to understand the locomotion of organisms that crawl or burrow within terrestrial substrates like sand, soil, and muddy sediments that display both solid and fluid-like behavior. In such materials, validated theories such as the Navier-Stokes equations for fluids do not exist, and visualization techniques (such as particle image velocimetry in fluids) are nearly nonexistent. In this dissertation we integrated biological experiment, numerical simulation, and a physical robot model to reveal principles of undulatory locomotion in granular media. First, we used high speed x-ray imaging techniques to reveal how a desert dwelling lizard, the sandfish, swims within dry granular media without limb use by propagating a single period sinusoidal traveling wave along its body, resulting in a wave efficiency, the ratio of its average forward speed to wave speed, of approximately 0.5. The wave efficiency was independent of the media preparation (loosely and tightly packed). We compared this observation against two complementary modeling approaches: a numerical model of the sandfish coupled to a discrete particle simulation of the granular medium, and an undulatory robot which was designed to swim within granular media. We used these mechanical models to vary the ratio of undulation amplitude (A) to wavelength (λ) and demonstrated that an optimal condition for sand-swimming exists which results from competition between A and λ. The animal simulation and robot model, predicted that for a single period sinusoidal wave, maximal speed occurs for A/ λ = 0.2, the same kinematics used by the sandfish. Inspired by the tapered head shape of the sandfish lizard, we showed that the lift forces and hence vertical position of the robot as it moves forward within granular media can be varied by designing an appropriate head shape and controlling its angle of attack, in a similar way to flaps or wings moving in fluids. These results support the biological hypotheses which propose that morphological adaptations of desert dwelling organisms aid in their subsurface locomotion. This work also demonstrates that the discovery of biological principles of high performance locomotion within sand can help create the next generation of biophysically inspired robots that could explore potentially hazardous complex flowing environments.PhDCommittee Chair: Daniel I. Goldman; Committee Member: Hang Lu; Committee Member: Jeanette Yen; Committee Member: Shella Keilholz; Committee Member: Young-Hui Chan