Monitoring Large-Scale Cloud Systems with Layered Gossip Protocols

Monitoring is an essential aspect of maintaining and developing computer systems that increases in difficulty proportional to the size of the system. The need for robust monitoring tools has become more evident with the advent of cloud computing. Infrastructure as a Service (IaaS) clouds allow end users to deploy vast numbers of virtual machines as part of dynamic and transient architectures. Current monitoring solutions, including many of those in the open-source domain rely on outdated concepts including manual deployment and configuration, centralised data collection and adapt poorly to membership churn. In this paper we propose the development of a cloud monitoring suite to provide scalable and robust lookup, data collection and analysis services for large-scale cloud systems. In lieu of centrally managed monitoring we propose a multi-tier architecture using a layered gossip protocol to aggregate monitoring information and facilitate lookup, information collection and the identification of redundant capacity. This allows for a resource aware data collection and storage architecture that operates over the system being monitored. This in turn enables monitoring to be done in-situ without the need for significant additional infrastructure to facilitate monitoring services. We evaluate this approach against alternative monitoring paradigms and demonstrate how our solution is well adapted to usage in a cloud-computing context.Comment: Extended Abstract for the ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC 2013) Poster Trac

Observing the clouds : a survey and taxonomy of cloud monitoring

This research was supported by a Royal Society Industry Fellowship and an Amazon Web Services (AWS) grant. Date of Acceptance: 10/12/2014Monitoring is an important aspect of designing and maintaining large-scale systems. Cloud computing presents a unique set of challenges to monitoring including: on-demand infrastructure, unprecedented scalability, rapid elasticity and performance uncertainty. There are a wide range of monitoring tools originating from cluster and high-performance computing, grid computing and enterprise computing, as well as a series of newer bespoke tools, which have been designed exclusively for cloud monitoring. These tools express a number of common elements and designs, which address the demands of cloud monitoring to various degrees. This paper performs an exhaustive survey of contemporary monitoring tools from which we derive a taxonomy, which examines how effectively existing tools and designs meet the challenges of cloud monitoring. We conclude by examining the socio-technical aspects of monitoring, and investigate the engineering challenges and practices behind implementing monitoring strategies for cloud computing.Publisher PDFPeer reviewe

Academic Cloud Computing Research: Five Pitfalls and Five Opportunities

This discussion paper argues that there are five fundamental pitfalls, which can restrict academics from conducting cloud computing research at the infrastructure level, which is currently where the vast majority of academic research lies. Instead academics should be conducting higher risk research, in order to gain understanding and open up entirely new areas. We call for a renewed mindset and argue that academic research should focus less upon physical infrastructure and embrace the abstractions provided by clouds through five opportunities: user driven research, new programming models, PaaS environments, and improved tools to support elasticity and large-scale debugging. The objective of this paper is to foster discussion, and to define a roadmap forward, which will allow academia to make longer-term impacts to the cloud computing community.Comment: Accepted and presented at the 6th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud'14

Managing Saline Groundwater Impacts from Irrigation - Designing and Testing Emissions Trading in Coleambally Irrigation Area

Irrigated agriculture often leads to recharge to local and regional groundwater systems greater than what the systems can absorb, resulting in the development of shallow watertables causing salinity and waterlogging. Policy based on emissions trading offers one option for effective management of existing recharge externalities if effective property rights to diffuse emissions can be defined. In this paper we combine the conclusions drawn from biophysical research with economic principles underpinning emissions trading to present such a system. Allocation of net recharge contracts to irrigation farms will internalize the costs associated with saline aquifer impacts. Irrigators may reduce their compliance costs by creating or purchasing credits that reduce recharge through perennial vegetation, engineering solutions or crop rotation options. We discuss the economic impacts of adopting such a policy in the Coleambally Irrigation Area in southwestern New South Wales, Australia. We also demonstrate some of the conclusions drawn from our research using experimental economics.salinity, irrigation, recharge, tradeable emissions, cap and trade, hydrologic-economic modelling, experimental economics

Gravity thaws the frozen moduli of the CP^1 lump

The slow motion of a self-gravitating CP^1 lump is investigated in the approximation of geodesic flow on the moduli space of unit degree static solutions M_1. It is found that moduli which are frozen in the absence of gravity, parametrizing the lump's width and internal orientation, may vary once gravitational effects are included. If gravitational coupling is sufficiently strong, the presence of the lump shrinks physical space to finite volume, and the moduli determining the boundary value of the CP^1 field thaw also. Explicit formulae for the metric on M_1 are found in both the weak and strong coupling regimes. The geodesic problem for weak coupling is studied in detail, and it is shown that M_1 is geodesically incomplete. This leads to the prediction that self-gravitating lumps are unstable.Comment: 6 pages, minor error corrected (conclusions unchanged

A Question of Balance: Exploring the Acculturation, Integration and Adaptation of Muslim Immigrant Youth

The paper addresses criticisms of contemporary acculturation research by adopting a mixed method approach (open-ended survey responses, interviews, focus groups and projective techniques) to the study of the acculturation experiences of Muslim youth in New Zealand. The research explores: 1) the meaning, definition and achievement of success; 2) the process of negotiating multiple social identities; and 3) the graphic representation of identity. Thematic analysis indicated that young Muslims aspire to achieve success in personal, social, material and religious domains and that they seek to balance potentially competing demands from family, friends, the Muslim community and the wider society. At the same time they aspire to balance multiple identities, retaining religious and cultural elements in the definition of self while endeavoring to integrate into the wider society. The process of achieving this balance is characterized by three strategies: alternating orientations, blending orientations and minimizing differences. The findings are discussed in relation to advancing our understanding of integration as an acculturation option, and the community-based policy implications for multicultural societies are considered