Deep Reinforcement Learning based Path-Planning for Multi-Agent Systems in Advection-Diffusion Field Reconstruction Tasks

Many environmental processes can be represented mathematically using spatial-temporal varying partial-differential equations. Timely estimation and prediction of processes such as wildfires is critical for disaster management response, but is difficult to accomplish without the availability of a dense network of stationary sensors. In this work, we propose a deep reinforcement learning-based real-time path-planning algorithm for mobile sensor networks traveling in a formation through a spatial-temporal varying advection-diffusion field for the task of field reconstruction. A deep Q-network (DQN) agent is trained on simulated advection-diffusion fields to direct the mobile sensor network to travel along information-rich trajectories. The field measurements made by the mobile sensor network along their trajectories enable identification of field advection parameters, which are required for field reconstruction. A cooperative Kalman filter developed in previous works is employed to receive estimates of the field values and gradients, which are essential for reconstruction as well as for the estimation of the diffusion parameter. A mechanism is provided that encourages exploration in the field domain once a stationary state is reached, which allows the algorithm to identify other information-rich trajectories that may exist in the field improving reconstruction performance significantly. Two simulation environments of different fidelities are provided to test the feasibility of the proposed algorithm. The low-fidelity simulation environment is used for training of the DQN agent. The high-fidelity simulation environment is based on Robot Operating System (ROS) and simulates real robots. We provide results of running sample test episodes in both environments which demonstrate the effectiveness and feasibility of the proposed algorithm

Assessing the potential of autonomous submarine gliders for ecosystem monitoring across multiple trophic levels (plankton to cetaceans) and pollutants in shallow shelf seas

A combination of scientific, economic, technological and policy drivers is behind a recent upsurge in the use of marine autonomous systems (and accompanying miniaturized sensors) for environmental mapping and monitoring. Increased spatial–temporal resolution and coverage of data, at reduced cost, is particularly vital for effective spatial management of highly dynamic and heterogeneous shelf environments. This proof-of-concept study involves integration of a novel combination of sensors onto buoyancy-driven submarine gliders, in order to assess their suitability for ecosystem monitoring in shelf waters at a variety of trophic levels. Two shallow-water Slocum gliders were equipped with CTD and fluorometer to measure physical properties and chlorophyll, respectively. One glider was also equipped with a single-frequency echosounder to collect information on zooplankton and fish distribution. The other glider carried a Passive Acoustic Monitoring system to detect and record cetacean vocalizations, and a passive sampler to detect chemical contaminants in the water column. The two gliders were deployed together off southwest UK in autumn 2013, and targeted a known tidal-mixing front west of the Isles of Scilly. The gliders’ mission took about 40 days, with each glider travelling distances of >1000 km and undertaking >2500 dives to depths of up to 100 m. Controlling glider flight and alignment of the two glider trajectories proved to be particularly challenging due to strong tidal flows. However, the gliders continued to collect data in poor weather when an accompanying research vessel was unable to operate. In addition, all glider sensors generated useful data, with particularly interesting initial results relating to subsurface chlorophyll maxima and numerous fish/cetacean detections within the water column. The broader implications of this study for marine ecosystem monitoring with submarine gliders are discussed

Bridging the gap between Open and User Innovation? : exploring the value of Living Labs as a means to structure user contribution and manage distributed innovation

In nowadays society, organizations are struggling with the practical implementation of ‘distributed innovation’, or the fact that organizations need to reach outside their boundaries to tap into distributed sources of knowledge to enhance their innovation processes. Within this PhD, we will look at a specific approach, promoted and supported by the European Commission, that tries to facilitate and manage distributed innovation processes through a Public-Private-People partnership with a central role for the end-user: Living Labs. Following Almirall & Wareham (2011) and Leminen et al. (2014), we define Living Labs as an organized approach (as opposed to an ad hoc approach) to innovation consisting of real-life experimentation and active user involvement by means of different methods involving multiple stakeholders, as is implied in the Public-Private-People character of Living Labs. However, there are two main problems associated with these Living Labs. First problem, in terms of Living Lab practice and activity, is that there seem to be too many initiatives, without enough noticeable results or impact. This is linked to the second problem, dealing with Living Labs theory. To this date, there have been a lot of Living Lab publications, but there is no consistency in terms of connection to larger research paradigms and frameworks, and there is a lack of papers with a significant academic impact as well as research clearly illustrating their value. Therefore, from a theoretical perspective, we have investigated both the Open and User Innovation paradigms and demonstrated that Living Labs are an embodiment of both, although there are only few references to these literature streams in the current Living Labs literature. From a practice perspective, we have illustrated that Living Labs are rooted within various European predecessors such as cooperative design, social experiments and ‘digital cities’, but that out of the 345 affiliated members to the European Network of Living Labs, at least 40% is currently inactive. In order to further evolve Living Labs as a concept and to allow a better conceptualization, we developed a three layered model, consisting of a macro level (the Living Lab constellation), the meso level (consisting of a Living Lab innovation project) and the micro level (consisting of the different methodological research steps). Moreover, within a multiple case study analysis of 4 Living Lab constellation, 21 Living Lab innovation projects and 107 methodological research steps, we have been able to demonstrate that the concepts gathered from the Open Innovation literature could be used to analyze the macro level, whereas the concepts from the User Innovation literature could be used on the micro level. Through co-creation, both levels merge on the meso level, resulting in useful contributions to the innovation in development. Therefore, we concluded that Living Labs are able to govern innovation networks and to structure user participation in concrete innovation projects

Essays on Business Value Creation in Digital Platform Ecosystems

Digital platforms and the surrounding ecosystems have garnered great interest from researchers and practitioners. Notwithstanding this attention, it remains unclear how and when digital platforms create business value for platform owners and complementors. This three-essay dissertation focuses on understanding business value creation in digital platform ecosystems. The first essay reviews and synthesizes literature across disciplines and offers an integrative framework of digital platform business value. Advised by the findings from the review, the second and third essays focus on the value creation for platform complementors. The second essay examines how IT startups entering a platform ecosystem at different times can strategically design their products (i.e., product diversification across platform architectural layers and product differentiation) to gain competitive advantages. Longitudinal evidence from the Hadoop ecosystem demonstrates that product diversification has an inverted U-shaped relationship with complementors success, and such an effect is more salient for earlier entrants than later entrants. Earlier entrants should develop products that are similar to other ecosystem competitors to reduce uncertainty whereas later entrants are advised to explore market niche and differentiate their products.The third essay investigates how platform complementors strategies and products co-evolve over time in the co-created ecosystem network environment. Our longitudinal analysis of the Hadoop ecosystem indicates that complementors technological architecture coverage and alliance exploration strategies increase their product evolution rate. In turn, complementors with faster product evolution are more likely to explore new partners but less likely to cover a wider range of the focal platforms technological layers in subsequent periods. Network density, co-created by all platform complementors, weakens the effects of complementors strategies on their product evolution but amplifies the effects of past product evolutions on strategies.This three-essay dissertation uncovers various understudied competitive strategies in the digital platform context and enriches our understanding of business value creation in digital platform ecosystems

A security-and quality-aware system architecture for Internet of Things

Internet of Things (IoT) is characterized, at the system level, by high diversity with respect to enabling technologies and supported services. IoT also assumes to deal with a huge amount of heterogeneous data generated by devices, transmitted by the underpinning infrastructure and processed to support value-added services. In order to provide users with valuable output, the IoT architecture should guarantee the suitability and trustworthiness of the processed data. This is a major requirement of such systems in order to guarantee robustness and reliability at the service level. In this paper, we introduce a novel IoT architecture able to support security, privacy and data quality guarantees, thereby effectively boosting the diffusion of IoT services

The Inclusive Growth and Development Report 2017

Around the globe, leaders of governments and other stakeholder institutions enter 2017 facing a set of difficult and increasingly urgent questions:With fiscal space limited, interest rates near zero, and demographic trends unfavorable in many countries, does the world economy face a protracted period of relatively low growth? Will macroeconomics and demography determine the world economy's destiny for the foreseeable future?Can rising in-country inequality be satisfactorily redressed within the prevailing liberal international economic order? Can those who argue that modern capitalist economies face inherent limitations in this regard – that their internal "income distribution system" is broken and likely beyond repair – be proven wrong?As technological disruption accelerates in the Fourth Industrial Revolution, how can societies organize themselves better to respond to the potential employment and other distributional effects? Are expanded transfer payments the only or primary solution, or can market mechanisms be developed to widen social participation in new forms of economic value-creation?These questions beg the more fundamental one of whether a secular correction is required in the existing economic growth model in order to counteract secular stagnation and dispersion (chronic low growth and rising inequality). Does the mental map of how policymakers conceptualize and enable national economic performance need to be redrawn? Is there a structural way, beyond the temporary monetary and fiscal measures of recent years, to cut the Gordian knot of slow growth and rising inequality, to turn the current vicious cycle of stagnation and dispersion into a virtuous one in which greater social inclusion and stronger and more sustainable growth reinforce each other?This is precisely what government, business, and other leaders from every region have been calling for. Over the past several years, a worldwide consensus has emerged on the need for a more inclusive growth and development model; however, this consensus is mainly directional. Inclusive growth remains more a discussion topic than an action agenda. This Report seeks to help countries and the wider international community practice inclusive growth and development by offering a new policy framework and corresponding set of policy and performance indicators for this purpose