A DevOps Reference Architecture for Multi-Cloud IoT Applications Deployment

University of Technology Sydney. Faculty of Engineering and Information Technology.DevOps originated in the context of agile software development, which seems an appropriate approach to enable the continuous delivery and deployment of a software application in small releases. There is growing interest among organisations in adopting the DevOps approach and a multi-cloud environment for IoT (Internet of Things) application deployment. However, the challenge is how to apply DevOps when a multi-cloud heterogeneous environment is required for IoT application deployment. To address this vital research need, this thesis applies a design science research (DSR) method. It develops the DevOps reference architecture (DRA) framework to automate IoT applications deployment to the heterogeneous multi-cloud environment. The DRA is a cloud-enabled framework that mainly focuses on the deployment part of the integrated agile–DevOps methodology. Using a DSR method, the DRA has been incrementally developed by the iterative application of build, review, and adjust research activities. The DRA is intended for use by software organisations, coaches, managers, engineers, developers, and consultants as comprehensive reference architecture for deploying IoT applications to a multi-cloud environment using the DevOps approach. The DRA has three main components: framework characteristics, framework architecture, and framework composition. Framework characteristics incorporate nine main elements arranged into three categories: foundation (abstraction, human factor, infrastructure), core (process, tools, product), and extended (business value, rules, legal). Framework characteristics provide the building blocks necessary to create a reference architecture design using the DevOps approach and cloud infrastructure. Framework architecture is composed of five models: contextual, conceptual, logical, physical, and operational. Framework architecture is the blueprint used in the framework composition to create DevOps pipeline instances that enable IoT application deployment to the multi-cloud environment. The DRA framework composition includes three components: resources (architecture design, software, and hardware), configuration (pipeline, IoT application, IoT network), and output (DRA reference architecture, DRAv1.0 instance, DRAv2.0 instance). The framework provides implementation instructions and an evaluation template to implement and evaluate DRAv1.0 (single cloud) and DRA v2.0 (multi-cloud) instances in different organisational contexts. The proposed DRA framework is evaluated using an empirical evaluation composed of four iterations: industry case study, research case study, teaching case study, and industry field surveys. The results of this thesis indicate that the proposed DRA framework can be considered reasonable for the successful adoption of the DevOps approach for IoT application deployment to the multi-cloud environment. The evaluation results indicate that the DRA framework is generic and can be used in different organisational contexts and technology stacks to establish a cloud-based deployment architecture that is suitable for IoT applications

A Configurable Transport Layer for CAF

The message-driven nature of actors lays a foundation for developing scalable and distributed software. While the actor itself has been thoroughly modeled, the message passing layer lacks a common definition. Properties and guarantees of message exchange often shift with implementations and contexts. This adds complexity to the development process, limits portability, and removes transparency from distributed actor systems. In this work, we examine actor communication, focusing on the implementation and runtime costs of reliable and ordered delivery. Both guarantees are often based on TCP for remote messaging, which mixes network transport with the semantics of messaging. However, the choice of transport may follow different constraints and is often governed by deployment. As a first step towards re-architecting actor-to-actor communication, we decouple the messaging guarantees from the transport protocol. We validate our approach by redesigning the network stack of the C++ Actor Framework (CAF) so that it allows to combine an arbitrary transport protocol with additional functions for remote messaging. An evaluation quantifies the cost of composability and the impact of individual layers on the entire stack

A Review on Software Architectures for Heterogeneous Platforms

The increasing demands for computing performance have been a reality regardless of the requirements for smaller and more energy efficient devices. Throughout the years, the strategy adopted by industry was to increase the robustness of a single processor by increasing its clock frequency and mounting more transistors so more calculations could be executed. However, it is known that the physical limits of such processors are being reached, and one way to fulfill such increasing computing demands has been to adopt a strategy based on heterogeneous computing, i.e., using a heterogeneous platform containing more than one type of processor. This way, different types of tasks can be executed by processors that are specialized in them. Heterogeneous computing, however, poses a number of challenges to software engineering, especially in the architecture and deployment phases. In this paper, we conduct an empirical study that aims at discovering the state-of-the-art in software architecture for heterogeneous computing, with focus on deployment. We conduct a systematic mapping study that retrieved 28 studies, which were critically assessed to obtain an overview of the research field. We identified gaps and trends that can be used by both researchers and practitioners as guides to further investigate the topic

CONFIGURE: An Optimisation Framework for the Cost-Effective Spatial Configuration of Blue-Green Infrastructure

This paper develops a Blue-Green Infrastructure (BGI) performance evaluation approach by integrating a Non-dominated Sorting Genetic Algorithm II (NSGA-II) with a detailed hydrodynamic model. The proposed Cost OptimisatioN Framework for Implementing blue-Green infrastructURE (CONFIGURE), with a simplified problem-framing process and efficient genetic operations, can be connected to any flood simulation model. In this study, CONFIGURE is integrated with the CityCAT hydrodynamic model to optimise the locations and combinations of permeable surfaces. Permeable zones with four different levels of spatial discretisation are designed to evaluate their efficiency for 100-year and 30-year return period rainstorms. Overall, the framework performs effectively for the given scenarios. The application of the detailed hydrodynamic model explicitly captures the functioning of permeable features to provide the optimal locations for their deployment. Moreover, the size and the location of the permeable surfaces and the intensity of the rainstorm events are the critical performance parameters for economical BGI deployment.Comment: Paper submitted for publication in Environmental Modelling and Software. 26 pages, 11 figure

A QFD framework for quality, innovation and high-tech product development dynamics

The customer mostly chooses a product on the base of its quality, which therefore arises as the main cause of its commercial success. In a nearly axiomatic drawing, it follows that the effect of innovation is the improvement of quality, which itself becomes the aim of innovation. Even though the previous statement relates quality and innovation, it still does not explain their dynamics. To stress them, the ‘quality' concept must be analyzed in more detail. In fact, in addition to the ‘perceived quality', the quality ensured through `design, manufacturing and marketing' combined domains should be dealt with. This paper enhances this issue taking advantage of principles and models made available by control theory schemes coupled with quality function development (QFD) and best practice software modeling based on unified modeling language (UML

Transparent Orchestration of Task-based Parallel Applications in Containers Platforms

This paper presents a framework to easily build and execute parallel applications in container-based distributed computing platforms in a user-transparent way. The proposed framework is a combination of the COMP Superscalar (COMPSs) programming model and runtime, which provides a straightforward way to develop task-based parallel applications from sequential codes, and containers management platforms that ease the deployment of applications in computing environments (as Docker, Mesos or Singularity). This framework provides scientists and developers with an easy way to implement parallel distributed applications and deploy them in a one-click fashion. We have built a prototype which integrates COMPSs with different containers engines in different scenarios: i) a Docker cluster, ii) a Mesos cluster, and iii) Singularity in an HPC cluster. We have evaluated the overhead in the building phase, deployment and execution of two benchmark applications compared to a Cloud testbed based on KVM and OpenStack and to the usage of bare metal nodes. We have observed an important gain in comparison to cloud environments during the building and deployment phases. This enables better adaptation of resources with respect to the computational load. In contrast, we detected an extra overhead during the execution, which is mainly due to the multi-host Docker networking.This work is partly supported by the Spanish Government through Programa Severo Ochoa (SEV-2015-0493), by the Spanish Ministry of Science and Technology through TIN2015-65316 project, by the Generalitat de Catalunya under contracts 2014-SGR-1051 and 2014-SGR-1272, and by the European Union through the Horizon 2020 research and innovation program under grant 690116 (EUBra-BIGSEA Project). Results presented in this paper were obtained using the Chameleon testbed supported by the National Science Foundation.Peer ReviewedPostprint (author's final draft

Aligning a Service Provisioning Model of a Service-Oriented System with the ITIL v.3 Life Cycle

Bringing together the ICT and the business layer of a service-oriented system (SoS) remains a great challenge. Few papers tackle the management of SoS from the business and organizational point of view. One solution is to use the well-known ITIL v.3 framework. The latter enables to transform the organization into a service-oriented organizational which focuses on the value provided to the service customers. In this paper, we align the steps of the service provisioning model with the ITIL v.3 processes. The alignment proposed should help organizations and IT teams to integrate their ICT layer, represented by the SoS, and their business layer, represented by ITIL v.3. One main advantage of this combined use of ITIL and a SoS is the full service orientation of the company.Comment: This document is the technical work of a conference paper submitted to the International Conference on Exploring Service Science 1.5 (IESS 2015