Skinner operant conditioning model and robot bionic self-learning control

Fuzzy Skinner Operant Conditioning Automaton (FSOCA) sastavljen je na temelju Operant Conditioning mehanizma primjenom teorije neizrazitih skupova. Osnovno obilježje automata FSOCA je sljedeće: neizraziti rezultati stanja pomoću Gausove funkcije koriste se kao skupovi neizrazitog stanja; neizrazita pravila preslikavanja (fuzzy mapping rules) kod fuzzy-conditioning-operacije zamjenjuju stohastičke "conditioning-operant" skupove preslikavanja. Stoga se automat FSOCA može koristiti za opisivanje, simuliranje i dizajniranje raznih samo-organizirajućih radnji fuzzy nesigurnog sustava. Automat FSOCA najprije usvaja online algoritam grupiranja (clustering) u svrhu podjele ulaznog prostora (input space) te koristi intenzitet pobude pravila preslikavanja kako bi odlučio treba li generirati novo pravilo preslikavanja da bi broj pravila preslikavanja bio ekonomičan. Dizajnirani FSOCA automat primijenjen je za reguliranje balansiranja gibanja robota s dva kotača. Kako se učenje nastavlja, odabrana vjerojatnoća fuzzy operanta koji optimalno slijedi postepeno će se povećavati, entropijsko djelovanje fuzzy operanta će se postepeno smanjivati pa će se automatski generirati i izbrisati neizrazita pravila preslikavanja. Nakon otprilike sedamnaest krugova obuke, odabrane vjerojatnosti neizrazitog posljedičnog optimalnog operanta postupno teže prema jednoj, entropija djelovanja neizrazitog operanta postupno se smanjuje i broj neizrazitih pravila preslikavanja postaje optimalan. Tako robot postupno uči vještinu balansiranja gibanja.A Fuzzy Skinner Operant Conditioning Automaton (FSOCA) is constructed based on Operant Conditioning Mechanism with Fuzzy Set theory. The main character of FSOCA automaton is: the fuzzed results of state by Gaussian function are used as fuzzy state sets; the fuzzy mapping rules of fuzzy-conditioning-operation replace the stochastic "conditioning-operant" mapping sets. So the FSOCA automaton can be used to describe, simulate and design various self-organization actions of a fuzzy uncertain system. The FSOCA automaton firstly adopts online clustering algorithm to divide the input space and uses the excitation intensity of mapping rule to decide whether a new mapping rule needs to be generated in order to ensure that the number of mapping rules is economical. The designed FSOCA automaton is applied to motion balanced control of two-wheeled robot. With the learning proceeding, the selected probability of the optimal consequent fuzzy operant will gradually increase, the fuzzy operant action entropy will gradually decrease and the fuzzy mapping rules will automatically be generated and deleted. After about seventeen rounds of training, the selected probabilities of fuzzy consequent optimal operant gradually tend to one, the fuzzy operant action entropy gradually tends to minimum and the number of fuzzy mapping rules is optimum. So the robot gradually learns the motion balance skill

Considerations in designing a cybernetic simple 'learning' model; and an overview of the problem of modelling learning

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Learning is viewed as a central feature of living systems and must be manifested in any artifact that claims to exhibit general intelligence. The central aims of the thesis are twofold: (1) - To review and critically assess the empirical and theoretical aspects of learning as have been addressed in a multitude of disciplines, with the aim of extracting fundamental features and elements. (2) - To develop a more systematic approach to the cybernetic modelling of learning than has been achieved hitherto. In pursuit of aim (1) above the following discussions are included: Historical and Philosophical backgrounds; Natural learning, both physiological and psychological aspects; Hierarchies of learning identified in the evolutionary, functional and developmental senses; An extensive section on the general problem of modelling of learning and the formal tools, is included as a link between aims (1) and (2). Following this a systematic and historically oriented study of cybernetic and other related approaches to the problem of modelling of learning is presented. This then leads to the development of a state-of-the-art general purpose experimental cybernetic learning model. The programming and use of this model is also fully described, including an elaborate scheme for the manifestation of simple learning

Adaptive networks for robotics and the emergence of reward anticipatory circuits

Currently the central challenge facing evolutionary robotics is to determine how best to extend the range and complexity of behaviour supported by evolved neural systems. Implicit in the work described in this thesis is the idea that this might best be achieved through devising neural circuits (tractable to evolutionary exploration) that exhibit complementary functional characteristics. We concentrate on two problem domains; locomotion and sequence learning. For locomotion we compare the use of GasNets and other adaptive networks. For sequence learning we introduce a novel connectionist model inspired by the role of dopamine in the basal ganglia (commonly interpreted as a form of reinforcement learning). This connectionist approach relies upon a new neuron model inspired by notions of energy efficient signalling. Two reward adaptive circuit variants were investigated. These were applied respectively to two learning problems; where action sequences are required to take place in a strict order, and secondly, where action sequences are robust to intermediate arbitrary states. We conclude the thesis by proposing a formal model of functional integration, encompassing locomotion and sequence learning, extending ideas proposed by W. Ross Ashby. A general model of the adaptive replicator is presented, incoporating subsystems that are tuned to continuous variation and discrete or conditional events. Comparisons are made with Ross W. Ashby's model of ultrastability and his ideas on adaptive behaviour. This model is intended to support our assertion that, GasNets (and similar networks) and reward adaptive circuits of the type presented here, are intrinsically complementary. In conclusion we present some ideas on how the co-evolution of GasNet and reward adaptive circuits might lead us to significant improvements in the synthesis of agents capable of exhibiting complex adaptive behaviour

Aerospace Medicine and Biology: A cumulative index to a continuing bibliography

This publication is a cumulative index to the abstracts contained in Supplements 138 through 149 of AEROSPACE MEDICINE AND BIOLOGY: A CONTINUING BIBLIOGRAPHY. It includes three indexes -- subject, personal author, and corporate source

Psychotropes: Models of Authorship, Psychopathology, and Molecular Politics in Aldous Huxley and Philip K. Dick

Among the so-called “anti-psychiatrists” of the 1960s and ‘70s, it was Félix Guattari who first identified that psychiatry had undergone a “molecular revolution.” It was in fact in a book titled Molecular Revolutions, published in 1984, that Guattari proposed that psychotherapy had become, in the de¬cades following the Second World War, far less personal and increasingly alienating. The newly “molecular” practices of psychiatry, Guattari mourned, had served only to fundamentally distance both patients and practitioners from their own minds; they had largely restricted our access, he suggested, to human subjectivity and consciousness. This thesis resumes Guattari’s work on the “molecular” model of the subject. Extending on Guattari’s various “schizoanalytic metamodels” of hu¬man consciousness and ontology, it rigorously meditates on a simple ques¬tion: Should we now accept the likely finding that there is no neat, singular, reductive, utilitarian, or unifying “model” for thinking about the human subject, and more specifically the human “author”? Part 1 of this thesis carefully examines a range of psychoanalytic, psychi¬atric, philosophical, and biomedical models of the human. It studies and re¬formulates each of them in turn and, all the while, returns to a fundamental position: that no single model, nor combination of them, will suffice. What part 1 seeks to demonstrate, then, is that envisioning these models as differ¬ent attempts to “know” the human is fruitless—a futile game. Instead, these models should be understood in much the same way as literary critics treat literary commonplaces or topoi; they are akin, I argue, to what Deleuze and Guattari called “images of thought.” In my terminology, they are “psycho¬tropes”: images with their own particular symbolic and mythical functions. Having thus developed a range of theoretical footholds in part 1, part 2 of the thesis—beginning in chapter 4—will put into practice the work of this first part. It will do so by examining various representations of authorship by two authors in particular: Aldous Huxley and Philip K. Dick. This part will thus demonstrate how these author figures function as “psychoactive scriv¬eners”: they are fictionalising philosophers who both produce and quarrel with an array of paradigmatic psychotropes, disputing those of others and inventing their own to substitute for them. More than this, however, the second part offers a range of detailed and original readings of these authors’s psychobiographies; it argues that even individual authors such as Huxley and Dick can be seen as “psychotropic.” It offers, that is, a series of broad-ranging and speculative explanations for the ideas and themes that appear in their works—explanations rooted in the theoretical work of the first part. Finally, this thesis concludes by reaffirming the importance of these authors’s narcoliteratures—both for present-day and future literary studies, and beyond. For while Huxley and Dick allow us to countenance afresh the range of failures in the history and philosophy of science, they also prom¬ise to instruct us—and instruct science—about the ways in which we might move beyond our received mimetic models of the human

Aerospace medicine and biology: A continuing bibliography with indexes (supplement 376)

This bibliography lists 265 reports, articles and other documents introduced into the NASA Scientific and Technical Information System during Jun. 1993. Subject coverage includes: aerospace medicine and physiology, life support systems and man/system technology, protective clothing, exobiology and extraterrestrial life, planetary biology, and flight crew behavior and performance

Using MapReduce Streaming for Distributed Life Simulation on the Cloud

Distributed software simulations are indispensable in the study of large-scale life models but often require the use of technically complex lower-level distributed computing frameworks, such as MPI. We propose to overcome the complexity challenge by applying the emerging MapReduce (MR) model to distributed life simulations and by running such simulations on the cloud. Technically, we design optimized MR streaming algorithms for discrete and continuous versions of Conway’s life according to a general MR streaming pattern. We chose life because it is simple enough as a testbed for MR’s applicability to a-life simulations and general enough to make our results applicable to various lattice-based a-life models. We implement and empirically evaluate our algorithms’ performance on Amazon’s Elastic MR cloud. Our experiments demonstrate that a single MR optimization technique called strip partitioning can reduce the execution time of continuous life simulations by 64%. To the best of our knowledge, we are the first to propose and evaluate MR streaming algorithms for lattice-based simulations. Our algorithms can serve as prototypes in the development of novel MR simulation algorithms for large-scale lattice-based a-life models.https://digitalcommons.chapman.edu/scs_books/1014/thumbnail.jp

Aerospace medicine and biology: A cumulative index to the continuing bibliography of the 1973 issues

A cumulative index to the abstracts contained in Supplements 112 through 123 of Aerospace Medicine and Biology A Continuing Bibliography is presented. It includes three indexes: subject, personal author, and corporate source

Aerospace Medicine and Biology - A continuing bibliography with indexes

Annotated bibliography and indexes on aerospace medicine and biological effect