Robust data assimilation in river flow and stage estimation based on multiple imputation particle filter

In this paper, new method is proposed for a more robust Data Assimilation (DA) design of the river flow and stage estimation. By using the new sets of data that are derived from the incorporated Multi Imputation Particle Filter (MIPF) in the DA structure, the proposed method is found to have overcome the issue of missing observation data and contributed to a better estimation process. The convergence analysis of the MIPF is discussed and shows that the number of the particles and imputation influence the ability of this method to perform estimation. The simulation results of the MIPF demonstrated the superiority of the proposed approach when being compared to the Extended Kalman Filter (EKF) and Particle Filter (PF)

Evolutionary Robotics

info:eu-repo/semantics/publishedVersio

Hierarchical evolution of robotic controllers for complex tasks

Abstract—In this paper, we demonstrate how an artificial neural network (ANN) based controller can be synthesized for a complex task through hierarchical evolution and composition of behaviors. We demonstrate the approach in a task in which an e-puck robot has to find and rescue a teammate. The robot starts in a room with obstacles and the teammate is located in a double T-maze connected to the room. We divide the rescue task into different sub-tasks: (i) exit the room and enter the double T-maze, (ii) solve the maze to find the teammate, and (iii) guide the teammate safely to the initial room. We evolve controllers for each sub-task, and we combine the resulting controllers in a bottom-up fashion through additional evolutionary runs. We conduct evolution offline, in simulation, and we evaluate the best performing controller on real robotic hardware. The controller achieved a task completion rate of more than 90 % both in simulation and on real robotic hardware. I

Pemahaman pelajar tingkatan lima katering terhadap bab kaedah memasak dalam mata pelajaran teknologi katering

Bab Kaedah Memasak merupakan salah satu bab yang penting dalam mata pelajaran Teknologi Katering. Faktor terpenting adalah memastikan pelajar menguasai serta memahami konsepnya adalah melalui proses pengajaran dan pembelajaran yang betul. Tinjauan awal di Sekolah Menengah Teknik yang menawarkan Kursus Katering, menunjukkan bahawa kebanyakan pelajar sukar untuk menguasai dan memahami bab tersebut. Berdasarkan hasil tinjauan , pengkaji ingin mengenalpasti pemasalahan dalam memahami bab tersebut. Di samping itu juga, pengkaji ingin mengenalpasti adakah pencapaian pelajar dalam PMR, minat, motivasi dan gaya pembelajaran mempengaruhi pemahaman pelajar, Kajian rintis telah dilakukan terhadap 10 orang responden dengan nilai alpha 0.91. Ini menunjukkan kebolehpercayaan terhadap kajian di jalankan adalah tinggi. Responden adalah terdiri daripada 30 orang pelajar Tingkatan Lima (ERT) Sekolah Menengah Teknik Muar, Johor. Keputusan skor min keseluruhan menunjukkan pelajar berminat dan mempunyai motivasi ynag baik dalam bidang ini. Namun begitu, gaya pembelajaran yang diamalkan tidak sesuai dan antara pemyebab wujudnya pemasalahan dalam memahami bab Kaedah Memasak. Ujian kolerasi menunjukkan bahawa tidak terdapat sebarang hubungan signifikan antara pencapaian PMR pelajar dengan pemahaman bab tersebut. Sementara minat, motivasi dan gaya pembelajaran membuktikan ada hubungan signifikan dengan pemahaman pelajar dalam bab Kaedah Memasak

Engineering evolutionary control for real-world robotic systems

Evolutionary Robotics (ER) is the field of study concerned with the application of evolutionary computation to the design of robotic systems. Two main issues have prevented ER from being applied to real-world tasks, namely scaling to complex tasks and the transfer of control to real-robot systems. Finding solutions to complex tasks is challenging for evolutionary approaches due to the bootstrap problem and deception. When the task goal is too difficult, the evolutionary process will drift in regions of the search space with equally low levels of performance and therefore fail to bootstrap. Furthermore, the search space tends to get rugged (deceptive) as task complexity increases, which can lead to premature convergence. Another prominent issue in ER is the reality gap. Behavioral control is typically evolved in simulation and then only transferred to the real robotic hardware when a good solution has been found. Since simulation is an abstraction of the real world, the accuracy of the robot model and its interactions with the environment is limited. As a result, control evolved in a simulator tends to display a lower performance in reality than in simulation. In this thesis, we present a hierarchical control synthesis approach that enables the use of ER techniques for complex tasks in real robotic hardware by mitigating the bootstrap problem, deception, and the reality gap. We recursively decompose a task into sub-tasks, and synthesize control for each sub-task. The individual behaviors are then composed hierarchically. The possibility of incrementally transferring control as the controller is composed allows transferability issues to be addressed locally in the controller hierarchy. Our approach features hybridity, allowing different control synthesis techniques to be combined. We demonstrate our approach in a series of tasks that go beyond the complexity of tasks where ER has been successfully applied. We further show that hierarchical control can be applied in single-robot systems and in multirobot systems. Given our long-term goal of enabling the application of ER techniques to real-world tasks, we systematically validate our approach in real robotic hardware. For one of the demonstrations in this thesis, we have designed and built a swarm robotic platform, and we show the first successful transfer of evolved and hierarchical control to a swarm of robots outside of controlled laboratory conditions.A Robótica Evolutiva (RE) é a área de investigação que estuda a aplicação de computação evolutiva na conceção de sistemas robóticos. Dois principais desafios têm impedido a aplicação da RE em tarefas do mundo real: a dificuldade em solucionar tarefas complexas e a transferência de controladores evoluídos para sistemas robóticos reais. Encontrar soluções para tarefas complexas é desafiante para as técnicas evolutivas devido ao bootstrap problem e à deception. Quando o objetivo é demasiado difícil, o processo evolutivo tende a permanecer em regiões do espaço de procura com níveis de desempenho igualmente baixos, e consequentemente não consegue inicializar. Por outro lado, o espaço de procura tende a enrugar à medida que a complexidade da tarefa aumenta, o que pode resultar numa convergência prematura. Outro desafio na RE é a reality gap. O controlo robótico é tipicamente evoluído em simulação, e só é transferido para o sistema robótico real quando uma boa solução tiver sido encontrada. Como a simulação é uma abstração da realidade, a precisão do modelo do robô e das suas interações com o ambiente é limitada, podendo resultar em controladores com um menor desempenho no mundo real. Nesta tese, apresentamos uma abordagem de síntese de controlo hierárquica que permite o uso de técnicas de RE em tarefas complexas com hardware robótico real, mitigando o bootstrap problem, a deception e a reality gap. Decompomos recursivamente uma tarefa em sub-tarefas, e sintetizamos controlo para cada subtarefa. Os comportamentos individuais são então compostos hierarquicamente. A possibilidade de transferir o controlo incrementalmente à medida que o controlador é composto permite que problemas de transferibilidade possam ser endereçados localmente na hierarquia do controlador. A nossa abordagem permite o uso de diferentes técnicas de síntese de controlo, resultando em controladores híbridos. Demonstramos a nossa abordagem em várias tarefas que vão para além da complexidade das tarefas onde a RE foi aplicada. Também mostramos que o controlo hierárquico pode ser aplicado em sistemas de um robô ou sistemas multirobô. Dado o nosso objetivo de longo prazo de permitir o uso de técnicas de RE em tarefas no mundo real, concebemos e desenvolvemos uma plataforma de robótica de enxame, e mostramos a primeira transferência de controlo evoluído e hierárquico para um exame de robôs fora de condições controladas de laboratório.This work has been supported by the Portuguese Foundation for Science and Technology (Fundação para a Ciência e Tecnologia) under the grants SFRH/BD/76438/2011, EXPL/EEI-AUT/0329/2013, and by Instituto de Telecomunicações under the grant UID/EEA/50008/2013

Aprendizado Autônomo Para Robôs Móveis Baseado em Emoções Artificiais

Especialistas da área de neurofisiologia têm proposto a consideração dos sentimentos como parte dos processos cognitivos, e não de uma alma imaterial: tem sido defendido que as emoções não devem mais ser entendidas como opostas às decisões inteligentes, mas sim como parte e elemento decisivo para estas. Consequentemente se tornaram defensáveis a introdução de emoções artificiais no aprendizado de agentes artificiais, bem como a construção de modelos homeostáticos computacionais para estes. Nesta dissertação são relatados experimentos sobre uma arquitetura de controle baseado em comportamento e fundamentada sobre a simulação de processos hormonais e emocionais. São apresentadas e discutidas a arquitetura e modificações sobre esta, ou seja, a separação, da estrutura de aprendizado baseado em emoções, em diferentes redes neurais artificiais, uma rede para cada emoção. Os resultados mostraram que é razoável considerar modelos computacionais para processos emocionais que possam sustentar seleção de comportamento autônomo inteligente

Computational aspects of cellular intelligence and their role in artificial intelligence.

The work presented in this thesis is concerned with an exploration of the computational aspects of the primitive intelligence associated with single-celled organisms. The main aim is to explore this Cellular Intelligence and its role within Artificial Intelligence. The findings of an extensive literature search into the biological characteristics, properties and mechanisms associated with Cellular Intelligence, its underlying machinery - Cell Signalling Networks and the existing computational methods used to capture it are reported. The results of this search are then used to fashion the development of a versatile new connectionist representation, termed the Artificial Reaction Network (ARN). The ARN belongs to the branch of Artificial Life known as Artificial Chemistry and has properties in common with both Artificial Intelligence and Systems Biology techniques, including: Artificial Neural Networks, Artificial Biochemical Networks, Gene Regulatory Networks, Random Boolean Networks, Petri Nets, and S-Systems. The thesis outlines the following original work: The ARN is used to model the chemotaxis pathway of Escherichia coli and is shown to capture emergent characteristics associated with this organism and Cellular Intelligence more generally. The computational properties of the ARN and its applications in robotic control are explored by combining functional motifs found in biochemical network to create temporal changing waveforms which control the gaits of limbed robots. This system is then extended into a complete control system by combining pattern recognition with limb control in a single ARN. The results show that the ARN can offer increased flexibility over existing methods. Multiple distributed cell-like ARN based agents termed Cytobots are created. These are first used to simulate aggregating cells based on the slime mould Dictyostelium discoideum. The Cytobots are shown to capture emergent behaviour arising from multiple stigmergic interactions. Applications of Cytobots within swarm robotics are investigated by applying them to benchmark search problems and to the task of cleaning up a simulated oil spill. The results are compared to those of established optimization algorithms using similar cell inspired strategies, and to other robotic agent strategies. Consideration is given to the advantages and disadvantages of the technique and suggestions are made for future work in the area. The report concludes that the Artificial Reaction Network is a versatile and powerful technique which has application in both simulation of chemical systems, and in robotic control, where it can offer a higher degree of flexibility and computational efficiency than benchmark alternatives. Furthermore, it provides a tool which may possibly throw further light on the origins and limitations of the primitive intelligence associated with cells

On cognition, adaptation and homeostasis : analysis and synthesis of bio-inspired computational tools applied to robot autonomous navigation

Orientadores: Fernando Jose Von Zuben, Patricia Amancio VargasDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia Eletrica e de ComputaçãoResumo: Este trabalho tem como objetivos principais estudar, desenvolver e aplicar duas ferramentas computacionais bio-inspiradas em navegação autônoma de robôs. A primeira delas é representada pelos Sistemas Classificadores com Aprendizado, sendo que utilizou-se uma versão da proposta original, baseada em energia, e uma versão baseada em precisão. Adicionalmente, apresenta-se uma análise do processo de evolução das regras de inferência e da população final obtida. A segunda ferramenta trata de um modelo denominado sistema homeostático artificial evolutivo, composto por duas redes neurais artificiais recorrentes do tipo NSGasNets e um sistema endócrino artificial. O ajuste dos parâmetros do sistema é feito por meio de evolução, reduzindo-se a necessidade de codificação e parametrização a priori. São feitas análises de suas peculiaridades e de sua capacidade de adaptação. A motivação das duas propostas está no emprego conjunto de evolução e aprendizado, etapas consideradas fundamentais para a síntese de sistemas complexos adaptativos e modelagem computacional de processos cognitivos. Os experimentos visando validar as propostas envolvem simulação computacional em ambientes virtuais e implementações em um robô real do tipo Khepera II.Abstract: The objectives of this work are to study, develop and apply two bio-inspired computational tools in robot autonomous navigation. The first tool is represented by Learning Classifier Systems, using the strength-based and the accuracy-based models. Additionally, the rule evolution mechanisms and the final evolved populations are analyzed. The second tool is a model called evolutionary artificial homeostatic system, composed of two NSGasNet recurrent artificial neural networks and an artificial endocrine system. The parameters adjustment is made by means of evolution, reducing the necessity of a priori coding and parametrization. Analysis of the system's peculiarities and its adaptation capability are made. The motivation of both proposals is on the concurrent use of evolution and learning, steps considered fundamental for the synthesis of complex adaptive systems and the computational modeling of cognitive processes. The experiments, which aim to validate both proposals, involve computational simulation in virtual environments and implementations on real Khepera II robots.MestradoEngenharia de ComputaçãoMestre em Engenharia Elétric

Towards the evolution of an artificial homeostatic system

This paper presents an artificial homeostatic system (AHS) devoted to the autonomous navigation of mobile robots, with emphasis on neuro-endocrine interactions. The AHS is composed of two modules, each one associated with a particular reactive task and both implemented using an extended version of the GasNet neural model, denoted spatially unconstrained GasNet model or simply non-spatial GasNet (NS-GasNet). There is a coordination system, which is responsible for the specific role of each NSGasNet at a given operational condition. The switching among the NSGasNets is implemented as an artificial endocrine system (AES), which is based on a system of coupled nonlinear difference equations. The NSGasNets are synthesized by means of an evolutionary algorithm. The obtained neuro-endocrine controller is adopted in simulated and real benchmark applications, and the additional flexibility provided by the use of NSGasNet, together with the existence of an automatic coordination system, guides to convincing levels of performance. © 2008 IEEE.40234030Haykin, S., (1999) Neural Networks: A Comprehensive Foundation, , Prentice Hall, 2nd editionNeal, M., Timmis, J., Timidity: A useful mechanism for robot control (2003) Informatica, 7, pp. 197-203P. A. Vargas, R. C. Moioli, L, N. Castro, J. Timmis, M, Neal, and F.J. Von Zuben. Artificial homeostatic system: a novel approach. In Proceedings of the VIIIth European Conference on Artificial Life, 2005Besendovsky, H.O., Del Rey, A., Immune-neuro-endocrine interactions: Facts and hypotheses (1996) Endocrine Reviews, 17, pp. 64-102Levine, D.S., (1998) Explorations in Common Sense and Common Nonsense, , http://www.uta.edu/psychology/faculty/levine/EBOOK/index.htm, On-line bookCannon, W.B., Organization for physiological homeostasis (1929) Physiological Review, 9, pp. 399-431Pfeifer, R., Scheier, C., (1999) Understanding Intelligence, , MIT PressAshby, W.R., (1960) Design for a Brain: The Origin of Adaptive Behaviour, , London: Chapman and HallDi Paolo, E.A., Homeostatic adaptation to inversion of the visual field and other sensorimotor disruptions (2000) From Animals to Animals, Proc. of the Sixth International Conference on the Simulation of Adaptive Behavior, SAB'2000, pp. 440-449. , MIT PressHarvey, I., Homeostasis and rein control: From daisyworld to active perception (2004) Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems, ALIFE9, , MIT PressWelch, R.B., Research on adaptation to rearranged vision (1974) Perception, 3, pp. 367-392(1984) Sensory Experience, Adaptation and Perception: A Festschrift for ho Kohler, , L. Spillman and B. Wooten, editors, Lawrence ErlbaumHoinville, T., Hnaff, P., Comparative study of two homeostatic mechanisms in evolved neural controllers for legged locomotion (2004) Proccedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and SystemsMcClintic, J.R., (1975) Basic Anatomy and Physiology of the Human Body, , J. Wiley & SonsPurves, W.K., Heller, H.C., Orians, G.H., Sadava, D., Life: The Science of Biology (2001) IE-Macmillan UK, , 6th editionTimmis, J., Neal, M., Once More Unto the Breach: Towards Artificial Homeostasis (2004) Recent Developments in Biologically Inspired Computing, pp. 340-366. , L. N. de Castro and F. J. Von Zuben editors, Idea Group Inc. Chapter XIVNolfi, S., Floreano, D., (2004) Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines, , MIT PressJakobi, N., Evolutionary robotics and the radical envelope of noise hypothesis (1998) Adaptive Behaviour, 6, pp. 325-368Jakobi, N., Running across the reality gap: Octopod locomotion evolved in a minimal simulation (1998) Evolutionary Robotics: First European Workshop, EvoRobot98, pp. 39-58. , Husbands, P. and Meyer, J.-A, editors, Springer-VerlagRumelhart, D.E., McClelland, J.L., Parallel Distributed Processing: Explorations in the Microstructure of Cognition (1986) Foundations, 1. , and The PDP Research Group, The MIT PressMcClelland, J.L., Rumelhart, D.E., Parallel Distributed Processing: Explorations in the Microsiructure of Cognition (1986) Psychological and Biological Models, 2. , and The PDF Research Group, The MTT PressChurchland, P., Sejnowski, T.J., (1994) The Computational Brain, , MTT PressO'Reilly, R.C., Munakata, Y., (2000) Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain, , MIT PressDayan, P., Abbot, L.F., (2001) Theoretical Neuroscience: Computational and Mathematical Modelling of Neural Systems, , MIT PressHusbands, P., Smith, T., Jakobi, N., OShea, M., Better living through chemistry: Evolving GasNets for robot control (1998) Connection Science, 10, pp. 185-210Vargas, P.A., Di Paolo, E.A., Husbands, P., Preliminary investigations on the evolvability of a non-spatial GasNet model (2007) Proceedings of the 9th European Conference on Artificial life ECAL 2007, , Springer-VerlagYao, X., Evolving artificial neural networks (1999) Proceedings of the IEEE, 87, pp. 1423-1447Yao, X., Liu, Y., Fast evolution strategies (1997) Control Cybern, 26, pp. 467-496Fogel, D.B., Fogel, L.J., Porto, V.W., Evolving neural networks (1990) Biological Cybern, 63, pp. 487-493Whitley, D., Starkweather, T., Bogart, C., Genetic algorithms and neural networks: Optimizing connections and connectivity (1990) Parallel Compute, 14, pp. 347-361Husbands, P., Evolving robot behaviours with diffusing gas networks (1998) Evolutionary Robotics: First European Workshop, EvoRobot98, pp. 71-86. , Springer-VerlagSmith, T.M.C., (2002) The Evolvability of Artificial Neural Networks for Robot Control, , PhD thesis, CCNR, Department of Informatics, University of Sussex, UKPhilippides, A., Husbands, P., Smith, T., O'Shea, M., Flexible couplings: Diffusing neuromodulators and adaptive robotics (2005) Artificial Life, 11, pp. 139-160KTEAM, S.A., (2007), http://www.k-team.comStorm, T., Kiks, a Khepera simulator for Matlab 5.3 and 6.0, , http://theodor.zoomin.se/index/2866.htmlCollins, R., Jefferson, D., Selection in massively parallel genetic algorithms (1991) Proccedings of the Fourth Intl Conf. on Genetic Algorithms, ICGA-91, pp. 249-256. , Morgan KaufmannHillis, W.D., Co-evolving parasites improve simulated evolution as an optimization procedure (1990) Physica D, 42, pp. 228-23