Survey on cloud based testing tools

Cloud computing has been adopted by many business organizations due to its simplicity and innovative technology. It has changed the way software used to be developed and delivered to customers. Every company aims to develop high quality software, with reduced cost and complexity. Cloud computing provides a platform for software testing where any application can be tested in cloud environment. The main goal of this thesis was to provide an understanding about cloud testing methodologies and explore cloud service providers offering various testing tools and technologies for different types of testing (functional and non-functional testing). This thesis incorporates description about cloud computing, its benefits, and how it has been helping the organizations with different service models. Taking cloud computing as the base of understanding, cloud testing methodologies and its architecture are explained. In addition, the cloud service providers along with the tools they provide for testing were explored and some of their features were discussed. The pros and cons were analysed in order to find whether cloud-based testing tools were suitable for the organizational environment and its differences were compared with the traditional approach of testing. The research for this thesis was carried out via companies (service providers) websites, blogs, articles, journals and other papers. Communication mediums such as chat, email and phone were also used for the research on tools. The study indicates that cloud testing is often used as a performance testing and is mostly implemented using software as a service model. In addition, organizations can be benefited by embracing cloud testing methodologies, if they know how to exploit it properly. The results of this study suggest that though cloud testing is attracting more businesses with its promise of minimal maintenance and low costs, it can sometimes be risky. Cloud testing provides more choices for the organizations regarding how to run the infrastructures, save costs and time and delegate liabilities to third-party providers. On the other hand, it can also be challenging in terms of security, performance and other issues. This thesis also analyses things to be considered before moving to the cloud system

A TIERED RECOMMENDER SYSTEM FOR COST-EFFECTIVE CLOUD INSTANCE SELECTION

Cloud computing has greatly impacted the scientific community and the end users. By leveraging cloud computing, small research institutions and undergraduate colleges are able to alleviate costs and achieve research goals without purchasing and maintaining all the hardware and software. In addition, cloud computing allows researchers to access resources as their teams require and allows real-time collaboration with team members across the globe. Nowadays however, users are easily overwhelmed by the wide range of cloud servers and instances. Due to differences between the cloud server platforms and between instances within the platform, users find it difficult to identify the right instance match for their application. Therefore, we propose the A2Cloud-Hierarchy (A2Cloud-H) framework that recommends Cloud instances to users for high-performance scientific computing. The framework comprises four components: training data collection, supervised learning (SL) module, unsupervised learning (USL) module, and a decision module. The training database comprise testing traces of previous application and Cloud instances; these are contributed by the scientific community. The SL module contains three popular supervised learning modules: logistic regression, support vector machine and random forest, which train using the database to qualitatively assess the instance performance for the target application. The USL module includes three collaborative filtering methods: application-based, instance-based and rank-based, which use the database to estimate the instances’ performance ratings for the target application. The decision module comprises multiple tiers of analytic hierarchy processing, which consolidate the instance recommendation from the SL and USL modules into a final instance recommendation. The model is trained and validated by 8 real-world applications on 20 Cloud instances, yielding more than 90% modeling accuracy. The recommendation and integration method proposed in this thesis can help promote a better cloud computing environment for both end-users and cloud server platforms

Cloud based testing of business applications and web services

This paper deals with testing of applications based on the principles of cloud computing. It is aimed to describe options of testing business software in clouds (cloud testing). It identifies the needs for cloud testing tools including multi-layer testing; service level agreement (SLA) based testing, large scale simulation, and on-demand test environment. In a cloud-based model, ICT services are distributed and accessed over networks such as intranet or internet, which offer large data centers deliver on demand, resources as a service, eliminating the need for investments in specific hardware, software, or on data center infrastructure. Businesses can apply those new technologies in the contest of intellectual capital management to lower the cost and increase competitiveness and also earnings. Based on comparison of the testing tools and techniques, the paper further investigates future trend of cloud based testing tools research and development. It is also important to say that this comparison and classification of testing tools describes a new area and it has not yet been done

Report from GI-Dagstuhl Seminar 16394: Software Performance Engineering in the DevOps World

This report documents the program and the outcomes of GI-Dagstuhl Seminar 16394 "Software Performance Engineering in the DevOps World". The seminar addressed the problem of performance-aware DevOps. Both, DevOps and performance engineering have been growing trends over the past one to two years, in no small part due to the rise in importance of identifying performance anomalies in the operations (Ops) of cloud and big data systems and feeding these back to the development (Dev). However, so far, the research community has treated software engineering, performance engineering, and cloud computing mostly as individual research areas. We aimed to identify cross-community collaboration, and to set the path for long-lasting collaborations towards performance-aware DevOps. The main goal of the seminar was to bring together young researchers (PhD students in a later stage of their PhD, as well as PostDocs or Junior Professors) in the areas of (i) software engineering, (ii) performance engineering, and (iii) cloud computing and big data to present their current research projects, to exchange experience and expertise, to discuss research challenges, and to develop ideas for future collaborations

Microservices Validation: Methodology and Implementation

Due to the wide spread of cloud computing, arises actual question about architecture, design and implementation of cloud applications. The microservice model describes the design and development of loosely coupled cloud applications when computing resources are provided on the basis of automated IaaS and PaaS cloud platforms. Such applications consist of hundreds and thousands of service instances, so automated validation and testing of cloud applications developed on the basis of microservice model is a pressing issue. There are constantly developing new methods of testing both individual microservices and cloud applications at a whole. This article presents our vision of a framework for the validation of the microservice cloud applications, providing an integrated approach for the implementation of various testing methods of such applications, from basic unit tests to continuous stability testing

Cloud engineering is search based software engineering too

Many of the problems posed by the migration of computation to cloud platforms can be formulated and solved using techniques associated with Search Based Software Engineering (SBSE). Much of cloud software engineering involves problems of optimisation: performance, allocation, assignment and the dynamic balancing of resources to achieve pragmatic trade-offs between many competing technical and business objectives. SBSE is concerned with the application of computational search and optimisation to solve precisely these kinds of software engineering challenges. Interest in both cloud computing and SBSE has grown rapidly in the past five years, yet there has been little work on SBSE as a means of addressing cloud computing challenges. Like many computationally demanding activities, SBSE has the potential to benefit from the cloud; ‘SBSE in the cloud’. However, this paper focuses, instead, of the ways in which SBSE can benefit cloud computing. It thus develops the theme of ‘SBSE for the cloud’, formulating cloud computing challenges in ways that can be addressed using SBSE