A systematic review on cloud testing

A systematic literature review is presented that surveyed the topic of cloud testing over the period (2012-2017). Cloud testing can refer either to testing cloud-based systems (testing of the cloud), or to leveraging the cloud for testing purposes (testing in the cloud): both approaches (and their combination into testing of the cloud in the cloud) have drawn research interest. An extensive paper search was conducted by both automated query of popular digital libraries and snowballing, which resulted into the final selection of 147 primary studies. Along the survey a framework has been incrementally derived that classifies cloud testing research along six main areas and their topics. The paper includes a detailed analysis of the selected primary studies to identify trends and gaps, as well as an extensive report of the state of art as it emerges by answering the identified Research Questions. We find that cloud testing is an active research field, although not all topics have received so far enough attention, and conclude by presenting the most relevant open research challenges for each area of the classification framework.This paper describes research work mostly undertaken in the context of the European Project H2020 731535: ElasTest. This work has also been partially supported by: the Italian MIUR PRIN 2015 Project: GAUSS; the Regional Government of Madrid (CM) under project Cloud4BigData (S2013/ICE-2894) cofunded by FSE & FEDER; and the Spanish Government under project LERNIM (RTC-2016-4674-7) cofunded by the Ministry of Economy and Competitiveness, FEDER & AEI

AndroFleet: Testing WiFi Peer-to-Peer Mobile Apps in the Large

International audienceWiFi P2P allows mobile apps to connect to each other via WiFi without an intermediate access point. This communication mode is widely used by mobile apps to support interactions with one or more devices simultaneously. However, testing such P2P apps remains a challenge for app developers as i) existing testing frameworks lack support for WiFi P2P, and ii) WiFi P2P testing fails to scale when considering a deployment on more than two devices.In this paper, we therefore propose an acceptance testing framework, named AndroFleet, to automate testing of WiFi P2P mobile apps at scale. Beyond the capability of testing point-to-point interactions under various conditions, AndroFleet supports the deployment and the emulation of a fleet of mobile devices as part of an alpha testing phase in order to assess the robustness of a WiFi P2P app once deployed in the field. To validate AndroFleet, we demonstrate the detection of failing black-box acceptance tests for WiFi P2P apps and we capture the conditions under which such a mobile app can correctly work in the field. The demo video of AndroFleet is made available from https://youtu.be/oAWgum07mKw

Uma pesquisa qualitativa das práticas de testes de software no contexto das aplicações móveis.

Contexto: O desenvolvimento de aplicações móveis cresce, acompanhando as constantes evoluções do hardware dos dispositivos. Com esta evolução, mais e mais recursos são adicionados e integrados à vida diária dos usuários. Contudo, a prática de testes de software utilizada pela comunidade para garantir o correto funcionamento das aplicações, incluindo a verificação de aspectos de segurança, portabilidade e compatibilidade, continua sendo um assunto pouco difundido. Objetivo: O objetivo deste estudo é compreender como as equipes lidam com a prática de testes de software aplicada ao contexto móvel, a relação cotidiana dos desenvolvedores com a literatura científica, a automação de testes e os desafios encontrados neste contexto. Método: Foi elaborado um estudo qualitativo, baseado na metodologia de Análise Temática, em três etapas: um survey, de caráter exploratório, que obteve 44 respostas de profissionais da área, seguido de uma seção de entrevistas com 12 profissionais para detalhar as questões levantadas durante o survey e um novo survey, de caráter confirmatório, que obteve 54 respostas e permitiu aos respondentes avaliar as principais conclusões das etapas anteriores. Resultados: Nossos resultados indicam a preferência dos desenvolvedores por testes manuais em detrimento da automação e o uso de testes funcionais automáticos de performance em alternativa, a escassez de referências para criação dos cenários de teste e os meios utilizados pelos profissionais para lidar com desafios como a fragmentação.Context: Mobile WebApplicationdevelopmentincrease,followedbyoftenhardwareevolutions fromdevices.Withthisdevelopment,moreandmorefeatureshasbeenaddedina daily lifeofusers.However,thepracticesofsoftwaretestingusedbydeveloperstoensure the correctexecutionflowoftheapplication,includingsafetyaspects,portabilityandcompatibility,remainsawidespreadissue. Objective: This studyaddresseshowtounderstand teams andhowtheyapplythetestsinthedevelopmentphase.plan. Method: There was elaborated aqualitativestudy,basedonTematicAnalisysmethodology,inthreestages:a exploratorysurvey,thatcollected44answersfromprofessionals,followedbyaninterview with 12professionalstodetailtheanswerscollectedduringtheexploratorysurveyanda newconfirmatorysurvey,thatcollected54answersandallowedtheprofessionalstoevaluate the mainconclusionsfrompreviousstages. Results: Our resultsshownapreferencefrom developersformanualtestingoverautomationanduseofautomaticfunctionaltestsinstead, the lackofreferencestocreatenewtestscenariesandthemethodusedbyprofessionalsto deal withchallengessuchasfragmentation