Skinner operant conditioning model and robot bionic self-learning control

Fuzzy Skinner Operant Conditioning Automaton (FSOCA) sastavljen je na temelju Operant Conditioning mehanizma primjenom teorije neizrazitih skupova. Osnovno obilježje automata FSOCA je sljedeće: neizraziti rezultati stanja pomoću Gausove funkcije koriste se kao skupovi neizrazitog stanja; neizrazita pravila preslikavanja (fuzzy mapping rules) kod fuzzy-conditioning-operacije zamjenjuju stohastičke "conditioning-operant" skupove preslikavanja. Stoga se automat FSOCA može koristiti za opisivanje, simuliranje i dizajniranje raznih samo-organizirajućih radnji fuzzy nesigurnog sustava. Automat FSOCA najprije usvaja online algoritam grupiranja (clustering) u svrhu podjele ulaznog prostora (input space) te koristi intenzitet pobude pravila preslikavanja kako bi odlučio treba li generirati novo pravilo preslikavanja da bi broj pravila preslikavanja bio ekonomičan. Dizajnirani FSOCA automat primijenjen je za reguliranje balansiranja gibanja robota s dva kotača. Kako se učenje nastavlja, odabrana vjerojatnoća fuzzy operanta koji optimalno slijedi postepeno će se povećavati, entropijsko djelovanje fuzzy operanta će se postepeno smanjivati pa će se automatski generirati i izbrisati neizrazita pravila preslikavanja. Nakon otprilike sedamnaest krugova obuke, odabrane vjerojatnosti neizrazitog posljedičnog optimalnog operanta postupno teže prema jednoj, entropija djelovanja neizrazitog operanta postupno se smanjuje i broj neizrazitih pravila preslikavanja postaje optimalan. Tako robot postupno uči vještinu balansiranja gibanja.A Fuzzy Skinner Operant Conditioning Automaton (FSOCA) is constructed based on Operant Conditioning Mechanism with Fuzzy Set theory. The main character of FSOCA automaton is: the fuzzed results of state by Gaussian function are used as fuzzy state sets; the fuzzy mapping rules of fuzzy-conditioning-operation replace the stochastic "conditioning-operant" mapping sets. So the FSOCA automaton can be used to describe, simulate and design various self-organization actions of a fuzzy uncertain system. The FSOCA automaton firstly adopts online clustering algorithm to divide the input space and uses the excitation intensity of mapping rule to decide whether a new mapping rule needs to be generated in order to ensure that the number of mapping rules is economical. The designed FSOCA automaton is applied to motion balanced control of two-wheeled robot. With the learning proceeding, the selected probability of the optimal consequent fuzzy operant will gradually increase, the fuzzy operant action entropy will gradually decrease and the fuzzy mapping rules will automatically be generated and deleted. After about seventeen rounds of training, the selected probabilities of fuzzy consequent optimal operant gradually tend to one, the fuzzy operant action entropy gradually tends to minimum and the number of fuzzy mapping rules is optimum. So the robot gradually learns the motion balance skill

A proposal for two wheeled autonomous robot

Cílem této diplomové práce je navrhnout autonomního dvoukolového balančního robota s diferenciálním podvozkem. Tento typ robota je vhodný zejména do menších prostor, kde vynikají jeho manévrovací schopnosti. Při návrhu robota tohoto typu je nutné vzít do úvahy několik kritérií, jako jsou provozní podmínky, materiál, velikost a hmotnost robota a také zvolit vhodný hardware a senzory. Součástí práce je kromě návrhu a konstrukce hardware a šasi robota také vývoj a implementace autonomního vyvažovacího řídicího systému.The goal of this diploma thesis is a proposal of autonomous two wheeled balancing robot, differentially driven. This kind of robot is especially suitable in confined space, where it can utilize its maneuver skills. Many criteria as operational conditions, materials, size and weight of the robot, suitable hardware and sensors must to be considered, when designing the robot. Development and implementation of autonomous balancing control system is also part of the thesis.