협업 로봇을 위한 서비스 기반과 모델 기반의 소프트웨어 개발 방법론

학위논문(박사)--서울대학교 대학원 :공과대학 전기·컴퓨터공학부,2020. 2. 하순회.가까운 미래에는 다양한 로봇이 다양한 분야에서 하나의 임무를 협력하여 수행하는 모습은 흔히 볼 수 있게 될 것이다. 그러나 실제로 이러한 모습이 실현되기에는 두 가지의 어려움이 있다. 먼저 로봇을 운용하기 위한 소프트웨어를 명세하는 기존 연구들은 대부분 개발자가 로봇의 하드웨어와 소프트웨어에 대한 지식을 알고 있는 것을 가정하고 있다. 그래서 로봇이나 컴퓨터에 대한 지식이 없는 사용자들이 여러 대의 로봇이 협력하는 시나리오를 작성하기는 쉽지 않다. 또한, 로봇의 소프트웨어를 개발할 때 로봇의 하드웨어의 특성과 관련이 깊어서, 다양한 로봇의 소프트웨어를 개발하는 것도 간단하지 않다. 본 논문에서는 상위 수준의 미션 명세와 로봇의 행위 프로그래밍으로 나누어 새로운 소프트웨어 개발 프레임워크를 제안한다. 또한, 본 프레임워크는 크기가 작은 로봇부터 계산 능력이 충분한 로봇들이 서로 군집을 이루어 미션을 수행할 수 있도록 지원한다. 본 연구에서는 로봇의 하드웨어나 소프트웨어에 대한 지식이 부족한 사용자도 로봇의 동작을 상위 수준에서 명세할 수 있는 스크립트 언어를 제안한다. 제안하는 언어는 기존의 스크립트 언어에서는 지원하지 않는 네 가지의 기능인 팀의 구성, 각 팀의 서비스 기반 프로그래밍, 동적으로 모드 변경, 다중 작업(멀티 태스킹)을 지원한다. 우선 로봇은 팀으로 그룹 지을 수 있고, 로봇이 수행할 수 있는 기능을 서비스 단위로 추상화하여 새로운 복합 서비스를 명세할 수 있다. 또한 로봇의 멀티 태스킹을 위해 '플랜' 이라는 개념을 도입하였고, 복합 서비스 내에서 이벤트를 발생시켜서 동적으로 모드가 변환할 수 있도록 하였다. 나아가 여러 로봇의 협력이 더욱 견고하고, 유연하고, 확장성을 높이기 위해, 군집 로봇을 운용할 때 로봇이 임무를 수행하는 도중에 문제가 생길 수 있으며, 상황에 따라 로봇을 동적으로 다른 행위를 수행할 수 있다고 가정한다. 이를 위해 동적으로도 팀을 구성할 수 있고, 여러 대의 로봇이 하나의 서비스를 수행하는 그룹 서비스를 지원하고, 일대 다 통신과 같은 새로운 기능을 스크립트 언어에 반영하였다. 따라서 확장된 상위 수준의 스크립트 언어는 비전문가도 다양한 유형의 협력 임무를 쉽게 명세할 수 있다. 로봇의 행위를 프로그래밍하기 위해 다양한 소프트웨어 개발 프레임워크가 연구되고 있다. 특히 재사용성과 확장성을 중점으로 둔 연구들이 최근 많이 사용되고 있지만, 대부분의 이들 연구는 리눅스 운영체제와 같이 많은 하드웨어 자원을 필요로 하는 운영체제를 가정하고 있다. 또한, 프로그램의 분석 및 성능 예측 등을 고려하지 않기 때문에, 자원 제약이 심한 크기가 작은 로봇의 소프트웨어를 개발하기에는 어렵다. 그래서 본 연구에서는 임베디드 소프트웨어를 설계할 때 쓰이는 정형적인 모델을 이용한다. 이 모델은 정적 분석과 성능 예측이 가능하지만, 로봇의 행위를 표현하기에는 제약이 있다. 그래서 본 논문에서 외부의 이벤트에 의해 수행 중간에 행위를 변경하는 로봇을 위해 유한 상태 머신 모델과 데이터 플로우 모델이 결합하여 동적 행위를 명세할 수 있는 확장된 모델을 적용한다. 그리고 딥러닝과 같이 계산량을 많이 필요로 하는 응용을 분석하기 위해, 루프 구조를 명시적으로 표현할 수 있는 모델을 제안한다. 마지막으로 여러 로봇의 협업 운용을 위해 로봇 사이에 공유되는 정보를 나타내기 위해 두 가지 모델을 사용한다. 먼저 중앙에서 공유 정보를 관리하기 위해 라이브러리 태스크라는 특별한 태스크를 통해 공유 정보를 나타낸다. 또한, 로봇이 자신의 정보를 가까운 로봇들과 공유하기 위해 멀티캐스팅을 위한 새로운 포트를 추가한다. 이렇게 확장된 정형적인 모델은 실제 로봇 코드로 자동 생성되어, 소프트웨어 설계 생산성 및 개발 효율성에 이점을 가진다. 비전문가가 명세한 스크립트 언어는 정형적인 태스크 모델로 변환하기 위해 중간 단계인 전략 단계를 추가하였다. 제안하는 방법론의 타당성을 검증하기 위해, 시뮬레이션과 여러 대의 실제 로봇을 이용한 협업하는 시나리오에 대해 실험을 진행하였다.In the near future, it will be common that a variety of robots are cooperating to perform a mission in various fields. There are two software challenges when deploying collaborative robots: how to specify a cooperative mission and how to program each robot to accomplish its mission. In this paper, we propose a novel software development framework that separates mission specification and robot behavior programming, which is called service-oriented and model-based (SeMo) framework. Also, it can support distributed robot systems, swarm robots, and their hybrid. For mission specification, a novel scripting language is proposed with the expression capability. It involves team composition and service-oriented behavior specification of each team, allowing dynamic mode change of operation and multi-tasking. Robots are grouped into teams, and the behavior of each team is defined with a composite service. The internal behavior of a composite service is defined by a sequence of services that the robots will perform. The notion of plan is applied to express multi-tasking. And the robot may have various operating modes, so mode change is triggered by events generated in a composite service. Moreover, to improve the robustness, scalability, and flexibility of robot collaboration, the high-level mission scripting language is extended with new features such as team hierarchy, group service, one-to-many communication. We assume that any robot fails during the execution of scenarios, and the grouping of robots can be made at run-time dynamically. Therefore, the extended mission specification enables a casual user to specify various types of cooperative missions easily. For robot behavior programming, an extended dataflow model is used for task-level behavior specification that does not depend on the robot hardware platform. To specify the dynamic behavior of the robot, we apply an extended task model that supports a hybrid specification of dataflow and finite state machine models. Furthermore, we propose a novel extension to allow the explicit specification of loop structures. This extension helps the compute-intensive application, which contains a lot of loop structures, to specify explicitly and analyze at compile time. Two types of information sharing, global information sharing and local knowledge sharing, are supported for robot collaboration in the dataflow graph. For global information, we use the library task, which supports shared resource management and server-client interaction. On the other hand, to share information locally with near robots, we add another type of port for multicasting and use the knowledge sharing technique. The actual robot code per robot is automatically generated from the associated task graph, which minimizes the human efforts in low-level robot programming and improves the software design productivity significantly. By abstracting the tasks or algorithms as services and adding the strategy description layer in the design flow, the mission specification is refined into task-graph specification automatically. The viability of the proposed methodology is verified with preliminary experiments with three cooperative mission scenarios with heterogeneous robot platforms and robot simulator.Chapter 1. Introduction 1 1.1 Motivation 1 1.2 Contribution 7 1.3 Dissertation Organization 9 Chapter 2. Background and Existing Research 11 2.1 Terminologies 11 2.2 Robot Software Development Frameworks 25 2.3 Parallel Embedded Software Development Framework 31 Chapter 3. Overview of the SeMo Framework 41 3.1 Motivational Examples 45 Chapter 4. Robot Behavior Programming 47 4.1 Related works 48 4.2 Model-based Task Graph Specification for Individual Robots 56 4.3 Model-based Task Graph Specification for Cooperating Robots 70 4.4 Automatic Code Generation 74 4.5 Experiments 78 Chapter 5. High-level Mission Specification 81 5.1 Service-oriented Mission Specification 82 5.2 Strategy Description 93 5.3 Automatic Task Graph Generation 96 5.4 Related works 99 5.5 Experiments 104 Chapter 6. Conclusion 114 6.1 Future Research 116 Bibliography 118 Appendices 133 요약 158Docto

Organická paměť v embryonálním vývoji

Předložená disertační práce se zabývá tématem organické paměti, její definicí a funkcí, a stejně tak i jejími pojetími z různých historických hledisek. Užívám pojem "organické paměti" ve vztahu k autorům, kteří se tímto tématem již dříve zabývali (Elsasser 1987, Otis 1994, Barbieri 2003) a dále i jako pojem, který představuje paměť jinou než neuronovou/mozkovou. Obecné metafory paměti (v tomto případě paměti neuronové) jsou zásadně spojeny s pojmy jako úložiště, matice či místo. Pro spíše materialisticky založená pojetí paměti je navíc příznačné, že různé stavy jako emoce či vlastnosti mysli mohou být konkrétně lokalizovány v mozku. Na druhou stranu někteří filosofové popisovali paměť jako primárně časovou entitu bez konkrétní závislosti na hmotě či místě. Otázka organické paměti byla živá již v biologii 19. století, spojena především s filosofií lamarkismu (Hering 1870, Haeckel 1876, Butler 1910). Představy o organické paměti se v té době pohybovaly mezi vitalistickými a spíše materialistickými koncepcemi: v těch prvních byly buňkám či částečkám paměti přisuzovány psychologické atributy; ty druhé byly založeny na fyzikální či karteziánské doktríně a popisovaly paměť jako lokalizovatelné úložiště stop či fyzikálních vln. Nejdeterminističtější koncepce paměti jsou zakořeněny v metafoře počítače, i...The submitted thesis deals with the topic of organic memory, its definition and function, as well as its conceptions from various historical points of view. I use the term "organic memory" in respect to some authors who have previously dealt with this subject (Elsasser 1987, Otis 1994, Barbieri 2003) and also as a term by which to represent a kind of memory distinct from neuronal/cerebral memory. The general memory metaphors (in the case of neuronal memory) are essentially connected with terms such as storage, matrix, or place. For rather materialistic conception of memory, it is also symptomatic that different states such as emotions or mental faculties can be concretely localized in the brain tissue. On the contrary, some philosophers described memory as a primarily temporal entity without connection to place or matter. The question of organic memory was already vivid in 19th century biology, linked to Lamarckian philosophy (Hering 1870, Haeckel 1876, Butler 1910). The organic memory ideas floundered between vitalistic and rather materialistic conceptions: the first attributed some psychological features to cells or memory particles; the second was based on physics or in Cartesian doctrine, and described memory as essentially localized as a kind of storage of traces or patterns of physical waves....Katedra filosofie a dějin přírodních vědDepartment of Philosophy and History of SciencePřírodovědecká fakultaFaculty of Scienc

Foundations of Trusted Autonomy

Trusted Autonomy; Automation Technology; Autonomous Systems; Self-Governance; Trusted Autonomous Systems; Design of Algorithms and Methodologie

Foundations of Software Science and Computation Structures

This open access book constitutes the proceedings of the 24th International Conference on Foundations of Software Science and Computational Structures, FOSSACS 2021, which was held during March 27 until April 1, 2021, as part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2021. The conference was planned to take place in Luxembourg and changed to an online format due to the COVID-19 pandemic. The 28 regular papers presented in this volume were carefully reviewed and selected from 88 submissions. They deal with research on theories and methods to support the analysis, integration, synthesis, transformation, and verification of programs and software systems

Drama, a connectionist model for robot learning: experiments on grounding communication through imitation in autonomous robots

The present dissertation addresses problems related to robot learning from demonstra¬ tion. It presents the building of a connectionist architecture, which provides the robot with the necessary cognitive and behavioural mechanisms for learning a synthetic lan¬ guage taught by an external teacher agent. This thesis considers three main issues: 1) learning of spatio-temporal invariance in a dynamic noisy environment, 2) symbol grounding of a robot's actions and perceptions, 3) development of a common symbolic representation of the world by heterogeneous agents.We build our approach on the assumption that grounding of symbolic communication creates constraints not only on the cognitive capabilities of the agent but also and especially on its behavioural capacities. Behavioural skills, such as imitation, which allow the agent to co-ordinate its actionn to that of the teacher agent, are required aside to general cognitive abilities of associativity, in order to constrain the agent's attention to making relevant perceptions, onto which it grounds the teacher agent's symbolic expression. In addition, the agent should be provided with the cognitive capacity for extracting spatial and temporal invariance in the continuous flow of its perceptions. Based on this requirement, we develop a connectionist architecture for learning time series. The model is a Dynamical Recurrent Associative Memory Architecture, called DRAMA. It is a fully connected recurrent neural network using Hebbian update rules. Learning is dynamic and unsupervised. The performance of the architecture is analysed theoretically, through numerical simulations and through physical and simulated robotic experiments. Training of the network is computationally fast and inexpensive, which allows its implementation for real time computation and on-line learning in a inexpensive hardware system. Robotic experiments are carried out with different learning tasks involving recognition of spatial and temporal invariance, namely landmark recognition and prediction of perception-action sequence in maze travelling.The architecture is applied to experiments on robot learning by imitation. A learner robot is taught by a teacher agent, a human instructor and another robot, a vocabulary to describe its perceptions and actions. The experiments are based on an imitative strategy, whereby the learner robot reproduces the teacher's actions. While imitating the teacher's movements, the learner robot makes similar proprio and exteroceptions to those of the teacher. The learner robot grounds the teacher's words onto the set of common perceptions they share. We carry out experiments in simulated and physical environments, using different robotic set-ups, increasing gradually the complexity of the task. In a first set of experiments, we study transmission of a vocabulary to designate actions and perception of a robot. Further, we carry out simulation studies, in which we investigate transmission and use of the vocabulary among a group of robotic agents. In a third set of experiments, we investigate learning sequences of the robot's perceptions, while wandering in a physically constrained environment. Finally, we present the implementation of DRAMA in Robota, a doll-like robot, which can imitate the arms and head movements of a human instructor. Through this imitative game, Robota is taught to perform and label dance patterns. Further, Robota is taught a basic language, including a lexicon and syntactical rules for the combination of words of the lexicon, to describe its actions and perception of touch onto its body

Freedom of Excellence: A Thomistic View of Free Will and its relationship to the Contemporary Free Will Debate

This thesis puts into dialog contemporary views of human freedom with Servais Pinckaers Thomistic view of freedom, a freedom rooted in virtue. His freedom of excellence enlarges the focus from the role of volition in a single atomic human act to include the effects arising from the integration of that act and subsequent acts changing the very being of the individual. We demonstrate that Aquinas’ view of the relationship between the will and the intellect possesses a complex interplay which extends to the habits, inclinations and finally the virtues. We review the philosophical landscape with particular emphasis on libertarian and compatibilist theories, both of which rely on a purely materialistic and deterministic metaphysical framing. We survey the neuroscience evidence such as Libet’s experiment and Tse’s criterial causation formulations, including Douglas Hofstadter’s simulation proposals from the field computer science and the implications of developments in chaos theory. We argue that contemporary approaches have been undermined by the abandonment of the metaphysics of man’s final ends, the felt need to maintain a false homage to an exclusively materialistic basis to man’s being, and the failure to fully assimilate the fundamental limitations of the concept of determinism. We conclude that the role of freedom with those decisions most central and most important to us as human beings is incompatible with either a libertarian or compatibilist theory but is at the core of the concerns of freedom of excellence and is compatible with current understanding of the physical universe and the neurosciences. This freedom is to be found in the virtues we acquire in part as gifts, and then practice in our daily life. Therein lies the true locus of freedom. Included as an appendix is a review of the scholarly literature on the development of the concept of the will from Socrates to Maximus the Confessor, and an appendix that provides an introduction to the mathematics of chaos with its implication for determinism

Fractal architecture for 'leagile' networked enterprises.

The manufacturing environment and markets in recent times are becoming increasingly dynamic, diverse and unpredictable, due mainly to fast evolution of products and technology, erratic customer behaviour and high consumerism and an increasingly shorter lead-time. The burden of the impact falls on organisational structures built on centralized, rigid manufacturing architecture, because they cannot cope or adapt to the highly uncertain or unpredictable nature of the market. Enterprises who wish to survive these challenges need to rethink their business and manufacturing models, and most importantly reinvent their tactical, operational and organizational formulas to leverage their strategic long term visions.Newer manufacturing systems to curb the effects of this upheaval have to promote an entirely decentralised, flexible, distributed, configurable and adaptable architecture to ameliorate this condition. Many philosophies are proposed and studied towards planning, monitoring, and controlling the 21st century manufacturing system. These include - Bionic manufacturing system (BMS), Holonic manufacturing system (HMS), Fractal manufacturing system (FrMS), Responsive manufacturing etc.This research program focuses on the FrMS, which has vast conceptual advantageous features among these new philosophies, but its implementation has proved very difficult. FrMS is based on autonomous, cooperating, self-similar agent called fractal that has the capability of perceiving, adapting and evolving with respect to its partners and environment. The fractal manufacturing configuration uses self regulating, organisational work groups, each with identical goals and within its own area of competence to build up an integrated, holistic network system of companies. This network yields constant improvement as well as continuous checks and balances through self-organising control loops. The study investigates and identifies the nature, characteristic features and feasibility of this system in comparison to traditional approaches with a detailed view to maximising the logistical attribute of lean manufacturing system and building a framework for 'leagile' (an integration of lean and agile solutions) networked capabilities. It explores and establishes the structural characteristic potentials of Fractal Manufacturing Partnership (FMP), a hands-on collaboration between enterprises and their key suppliers, where the latter become assemblers of their components while co-owning the enterprise's facility, to create and achieve high level of responsiveness. It is hoped that this architecture will drive and harness the evolution from a vertically integrated company, to a network of integrated, leaner core competencies needed to tackle and weather the storm of the 21st century manufacturing system

Programming Languages and Systems

This open access book constitutes the proceedings of the 29th European Symposium on Programming, ESOP 2020, which was planned to take place in Dublin, Ireland, in April 2020, as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2020. The actual ETAPS 2020 meeting was postponed due to the Corona pandemic. The papers deal with fundamental issues in the specification, design, analysis, and implementation of programming languages and systems

Salford postgraduate annual research conference (SPARC) 2012 proceedings

These proceedings bring together a selection of papers from the 2012 Salford Postgraduate Annual Research Conference (SPARC). They reflect the breadth and diversity of research interests showcased at the conference, at which over 130 researchers from Salford, the North West and other UK universities presented their work. 21 papers are collated here from the humanities, arts, social sciences, health, engineering, environment and life sciences, built environment and business

Automated Reasoning

This volume, LNAI 13385, constitutes the refereed proceedings of the 11th International Joint Conference on Automated Reasoning, IJCAR 2022, held in Haifa, Israel, in August 2022. The 32 full research papers and 9 short papers presented together with two invited talks were carefully reviewed and selected from 85 submissions. The papers focus on the following topics: Satisfiability, SMT Solving,Arithmetic; Calculi and Orderings; Knowledge Representation and Jutsification; Choices, Invariance, Substitutions and Formalization; Modal Logics; Proofs System and Proofs Search; Evolution, Termination and Decision Prolems. This is an open access book