Reinforcement Learning

Brains rule the world, and brain-like computation is increasingly used in computers and electronic devices. Brain-like computation is about processing and interpreting data or directly putting forward and performing actions. Learning is a very important aspect. This book is on reinforcement learning which involves performing actions to achieve a goal. The first 11 chapters of this book describe and extend the scope of reinforcement learning. The remaining 11 chapters show that there is already wide usage in numerous fields. Reinforcement learning can tackle control tasks that are too complex for traditional, hand-designed, non-learning controllers. As learning computers can deal with technical complexities, the tasks of human operators remain to specify goals on increasingly higher levels. This book shows that reinforcement learning is a very dynamic area in terms of theory and applications and it shall stimulate and encourage new research in this field

Development of novel backscatter communication systems using a multi-hop framework and distributed beamforming

The goal of this thesis it to develop a wireless networking framework for battery-free devices based on passive, backscatter communication. In contrast to traditional, active communication systems, where the radio signal has to be generated using large amount of energy from batteries, the passive systems reflect the RF signal. The information is encoded by modulating the reflected signal, which consumes significantly less energy than active transmission. The existing passive, backscatter systems have limited communication capabilities. For example, the Radio Frequency Identification (RFID) systems support short-distance, direct communication between active reader and passive tags. The communication range is limited due to power and sensitivity limitations of transmitters and receivers respectively. Moreover, in contrast to a multi-hop ad hoc and sensor networks, the traditional backscatter systems limit themselves to a single-hop topology due to limited capabilities of passive tags and different challenges in passive communication. Existing literature lacks of understanding how such multi-hop, passive, and asymmetric networks can be realized and what are their theoretical limits. This thesis aims at understanding the communication and coverage challenge in backscatter systems and addressing them through: (a) a distributed beamforming that increases the transmission range to a specific tag/location (PAPER I), and (b) a multi-hop framework for the backscatter communication that increases effective communication range (PAPER II). The proposed beamforming methodology employs spatially distributed, passive scattering devices located between transmitter and receiver to increase the RF signal strength. The theoretical limits of such scheme are analyzed mathematically and in simulations with two beamforming approaches being proposed. Furthermore, a novel architecture is proposed for multi-hop backscatter-based networking for a passive RF communication that is not currently present. The paper presents the generic analysis of the system capabilities and demonstrates the feasibility of such multi-hop network. Furthermore, the connectivity models are studied in terms of k-connectivity of such a network of tags --Abstract, page iv

Telecommunications Networks

This book guides readers through the basics of rapidly emerging networks to more advanced concepts and future expectations of Telecommunications Networks. It identifies and examines the most pressing research issues in Telecommunications and it contains chapters written by leading researchers, academics and industry professionals. Telecommunications Networks - Current Status and Future Trends covers surveys of recent publications that investigate key areas of interest such as: IMS, eTOM, 3G/4G, optimization problems, modeling, simulation, quality of service, etc. This book, that is suitable for both PhD and master students, is organized into six sections: New Generation Networks, Quality of Services, Sensor Networks, Telecommunications, Traffic Engineering and Routing

Turku Centre for Computer Science – Annual Report 2013

Due to a major reform of organization and responsibilities of TUCS, its role, activities, and even structures have been under reconsideration in 2013. The traditional pillar of collaboration at TUCS, doctoral training, was reorganized due to changes at both universities according to the renewed national system for doctoral education. Computer Science and Engineering and Information Systems Science are now accompanied by Mathematics and Statistics in newly established doctoral programs at both University of Turku and &Aring;bo Akademi University. Moreover, both universities granted sufficient resources to their respective programmes for doctoral training in these fields, so that joint activities at TUCS can continue. The outcome of this reorganization has the potential of proving out to be a success in terms of scientific profile as well as the quality and quantity of scientific and educational results.&nbsp; International activities that have been characteristic to TUCS since its inception continue strong. TUCS&rsquo; participation in European collaboration through EIT ICT Labs Master&rsquo;s and Doctoral School is now more active than ever. The new double degree programs at MSc and PhD level between University of Turku and Fudan University in Shaghai, P.R.China were succesfully set up and are&nbsp; now running for their first year. The joint students will add to the already international athmosphere of the ICT House.&nbsp; The four new thematic reseach programmes set up acccording to the decision by the TUCS Board have now established themselves, and a number of events and other activities saw the light in 2013. The TUCS Distinguished Lecture Series managed to gather a large audience with its several prominent speakers. The development of these and other research centre activities continue, and&nbsp; new practices and structures will be initiated to support the tradition of close academic collaboration.&nbsp; The TUCS&rsquo; slogan Where Academic Tradition Meets the Exciting Future has proven true throughout these changes. Despite of the dark clouds on the national and European economic sky, science and higher education in the field have managed to retain all the key ingredients for success. Indeed, the future of ICT and Mathematics in Turku seems exciting.</p

Book of abstracts of the 24th Euro Working Group on Transportation Meeting

Sem resumo disponível.publishe

A theoretical and practical approach to a persuasive agent model for change behaviour in oral care and hygiene

There is an increased use of the persuasive agent in behaviour change interventions due to the agent‘s features of sociable, reactive, autonomy, and proactive. However, many interventions have been unsuccessful, particularly in the domain of oral care. The psychological reactance has been identified as one of the major reasons for these unsuccessful behaviour change interventions. This study proposes a formal persuasive agent model that leads to psychological reactance reduction in order to achieve an improved behaviour change intervention in oral care and hygiene. Agent-based simulation methodology is adopted for the development of the proposed model. Evaluation of the model was conducted in two phases that include verification and validation. The verification process involves simulation trace and stability analysis. On the other hand, the validation was carried out using user-centred approach by developing an agent-based application based on belief-desire-intention architecture. This study contributes an agent model which is made up of interrelated cognitive and behavioural factors. Furthermore, the simulation traces provide some insights on the interactions among the identified factors in order to comprehend their roles in behaviour change intervention. The simulation result showed that as time increases, the psychological reactance decreases towards zero. Similarly, the model validation result showed that the percentage of respondents‘ who experienced psychological reactance towards behaviour change in oral care and hygiene was reduced from 100 percent to 3 percent. The contribution made in this thesis would enable agent application and behaviour change intervention designers to make scientific reasoning and predictions. Likewise, it provides a guideline for software designers on the development of agent-based applications that may not have psychological reactance

A Spatial Agent-based Model for Volcanic Evacuation of Mt. Merapi

Natural disasters, especially volcanic eruptions, are hazardous events that frequently happen in Indonesia. As a country within the “Ring of Fire”, Indonesia has hundreds of volcanoes and Mount Merapi is the most active. Historical studies of this volcano have revealed that there is potential for a major eruption in the future. Therefore, long-term disaster management is needed. To support the disaster management, physical and socially-based research has been carried out, but there is still a gap in the development of evacuation models. This modelling is necessary to evaluate the possibility of unexpected problems in the evacuation process since the hazard occurrences and the population behaviour are uncertain. The aim of this research was to develop an agent-based model (ABM) of volcanic evacuation to improve the effectiveness of evacuation management in Merapi. Besides the potential use of the results locally in Merapi, the development process of this evacuation model contributes by advancing the knowledge of ABM development for large-scale evacuation simulation in other contexts. Its novelty lies in (1) integrating a hazard model derived from historical records of the spatial impact of eruptions, (2) formulating and validating an individual evacuation decision model in ABM based on various interrelated factors revealed from literature reviews and surveys that enable the modelling of reluctant people, (3) formulating the integration of multi-criteria evaluation (MCE) in ABM to model a spatio-temporal dynamic model of risk (STDMR) that enables representation of the changing of risk as a consequence of changing hazard level, hazard extent and movement of people, and (4) formulating an evacuation staging method based on MCE using geographic and demographic criteria. The volcanic evacuation model represents the relationships between physical and human agents, consisting of the volcano, stakeholders, the population at risk and the environment. The experimentation of several evacuation scenarios in Merapi using the developed ABM of evacuation shows that simultaneous strategy is superior in reducing the risk, but the staged scenario is the most effective in minimising the potential of road traffic problems during evacuation events in Merapi. Staged evacuation can be a good option when there is enough time to evacuate. However, if the evacuation time is limited, the simultaneous strategy is better to be implemented. Appropriate traffic management should be prepared to avoid traffic problems when the second option is chosen