Devroey, Xavier

Repository of the University of Namur

RESEARCH OUTPUTS / RÉSULTATS DE RECHERCHEAuthor(s) - Auteur(s) :Publication date - Date de publication :Permanent link - Permalien :Rights / License - Licence de droit d’auteur :Bibliothèque Universitaire Moretus PlantinInstitutional Repository - Research PortalDépôt Institutionnel - Portail de la Rechercheresearchportal.unamur.bePoster: Behavioral Model-Based Testing of Variability Intensive SystemsDevroey, XavierPublication date:2015Document VersionPeer reviewed versionLink to publicationCitation for pulished version (HARVARD):Devroey, X 2015, 'Poster: Behavioral Model-Based Testing of Variability Intensive Systems' Journée desDoctorants en Informatique 2015, Namur, Belgium, 26/07/14 - 26/07/14, .General rightsCopyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright ownersand it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.            • Users may download and print one copy of any publication from the public portal for the purpose of private study or research.            • You may not further distribute the material or use it for any profit-making activity or commercial gain            • You may freely distribute the URL identifying the publication in the public portal ?Take down policyIf you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediatelyand investigate your claim.Download date: 21. May. 2019Behavioral Model-Based Testing of Variability Intensive SystemsXavier Devroey, Gilles Perrouin, Pierre-Yves Schobbens, Patrick HeymansContact: xavier.devroey@unamur.behttps://projects.info.unamur.be/vibes/ ▪  Focus on Variability-Intensive Behavioural Models (software product lines, plugin-based systems, etc.)▪  Formal Foundations (Featured Transition Systems) suitable for Analysis and Checking▪  Combining Model-checking and Test-case Generation techniques in VIBeS Framework▪  Cover various Testing Activities (test-case seleciton, prioritization, mutation assessment, etc.)BibliographyFuture Work[1] Devroey, X., et al. (2014). A Variability Perspective of Mutation Analysis. In Vision & Challenges @ FSE'14. Hong Kong: ACM. [2] Devroey, X., et al. (2014). Abstract Test Case Generation for Behavioural Testing of Software Product Lines. In SPLat @ SPLC'15. Florence, Italy: ACM.[3] Devroey, X., et al. (2014). Coverage Criteria for Behavioural Testing of Software Product Lines. In ISoLA'14. Corfu, Greece: Springer.[4] Devroey, X., et al. (2014). Towards Statistical Prioritization for Software Product Lines Testing. In VaMoS'14. Nice, France: ACM.[5] Devroey, X., et al. (2012). A Vision for Behavioural Model-Driven Validation of Software Product Lines. In ISoLA'12. Crete, Greece: Springer.▪ Higher order and equivalent mutants detect./gen.▪ Test cases generation using counter examples in ProVeLines FTS model checker▪ Abstract test cases concretization ▪ Empirical assessment on an industrial case studyTest ModelCPTerminal t Identification idDirectDebit ddCreditCard cdOnline onOffline offPIN pinSignature sigreq.[1..*]PaymentSchema psConnectivity copt.InitCard_inAbortedinsert_cardabortremove_cardApp_initabortCH_verifiedcheck_PIN_online / on ∧ pin check_PIN_offline / off ∧ pincheck_signature/ ¬dd ∧ sigGo_online Go_offlineNO_GO no_gogo_offline / offgo_online / onabortIssuer_respondedask_issuerissuer_rejectsCompletedissuer_acceptsacceptsremove_cardinit_schema / dd ∨ crFeatured Transition System Java DSLpublic class CPTerminalFts extends   FeaturedTransitionSystemDefinition {@Overrideprotected void define() {  initial("i");  from("i").action("insert_card")     .to("CardIn");  from("cardIn").action("init_schema")     .fexpr("dd || cr").to("App_init");  ...}}Feature ModelBoolean Conjunctive Normal Form (CNF) in DIMACS format used as input to SAT and BDD solversModels Def.Model-Based Testing ProcessTest EngineerRequirementsTestModel Test CaseGenerator1. models2. selectioncriteriaAbstractTests  Test ScriptGeneratorTest Scripts3. concrete mapping SystemUnder TestTest Results4. analyses1. Models definition (Java DSL)2. Selection criteria definition  ■ Maximizing      - Structural coverage (state, transition, paths, ...) [2,3]      - Usage coverage (based on a usage model) [4]      - Dissimilarity measure (based on distance def.)      - Number of mutants killed by the tests [1]  ■ Minimizing      - Number of test cases in the test set [3]      - Number of valid configurations needed by the test set [3]3. Concrete mapping definition (TBD)4. Tests results analysis (TBD)Structural coverage FeaturedTransitionSystem fts =   new CPTerminalFts().getTransitionSystem();SolverFacade solver =   new Sat4JSolverFacade(dimacsFile);TestSet set = allStatesSelection(fts, solver);Dissimilarity measure maximization...set = dissimilarLocalMaximumDistance(fts,  solver, nbrTestCases, time);...set = dissimilarGlobalMaximumDistance(fts,  solver, nbrTestCases, time);Selection Criteria Def. ■ Goals: Quality Assessment (QA)    - Tester: QA of a set of abstract test cases    - Researcher: QA of a test case selection method ■ Mutant = Test Model with injected fault(s) ■ Result of the application of a mutation operator     - Act. Exchange, State Missing, Trans. Dest. Exchange, etc.  ■ Execution of the test cases on the mutants                                 Number of mutants detected ■ Mutation score =                                      Total number of mutantsModel Based Mutation Testing Mutant Execution using Featured Mutants ModelVariability Intensive system Behavioural teSting FrameworkVIBeStoolboxDSLselectiontransformationexecutionmutationcorefexpression<<uses>>●●Alive Killed FMM5e+015e+025e+035e+04Claroline●●●●●●●●●●●●●●●●●●Alive Killed FMM1e+021e+041e+06AGE−RR●●●●●●Alive Killed FMM1e+031e+041e+051e+06RandomTime in microsec.

Poster: Behavioral Model-Based Testing of Variability Intensive Systems

RESEARCH OUTPUTS / RÉSULTATS DE RECHERCHEAuthor(s) - Auteur(s) :Publication date - Date de publication :Permanent link - Permalien :Rights / License - Licence de droit d’auteur :Bibliothèque Universitaire Moretus PlantinInstitutional Repository - Research PortalDépôt Institutionnel - Portail de la Rechercheresearchportal.unamur.bePoster: Behavioral Model-Based Testing of Variability Intensive SystemsDevroey, XavierPublication date:2015Document VersionPeer reviewed versionLink to publicationCitation for pulished version (HARVARD):Devroey, X 2015, 'Poster: Behavioral Model-Based Testing of Variability Intensive Systems', Journée desDoctorants en Informatique 2015, Namur, Belgium, 26/07/14 - 26/07/14.General rightsCopyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright ownersand it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.            • Users may download and print one copy of any publication from the public portal for the purpose of private study or research.            • You may not further distribute the material or use it for any profit-making activity or commercial gain            • You may freely distribute the URL identifying the publication in the public portal ?Take down policyIf you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediatelyand investigate your claim.Download date: 23. Jun. 2020Behavioral Model-Based Testing of Variability Intensive SystemsXavier Devroey, Gilles Perrouin, Pierre-Yves Schobbens, Patrick HeymansContact: xavier.devroey@unamur.behttps://projects.info.unamur.be/vibes/ ▪  Focus on Variability-Intensive Behavioural Models (software product lines, plugin-based systems, etc.)▪  Formal Foundations (Featured Transition Systems) suitable for Analysis and Checking▪  Combining Model-checking and Test-case Generation techniques in VIBeS Framework▪  Cover various Testing Activities (test-case seleciton, prioritization, mutation assessment, etc.)BibliographyFuture Work[1] Devroey, X., et al. (2014). A Variability Perspective of Mutation Analysis. In Vision & Challenges @ FSE'14. Hong Kong: ACM. [2] Devroey, X., et al. (2014). Abstract Test Case Generation for Behavioural Testing of Software Product Lines. In SPLat @ SPLC'15. Florence, Italy: ACM.[3] Devroey, X., et al. (2014). Coverage Criteria for Behavioural Testing of Software Product Lines. In ISoLA'14. Corfu, Greece: Springer.[4] Devroey, X., et al. (2014). Towards Statistical Prioritization for Software Product Lines Testing. In VaMoS'14. Nice, France: ACM.[5] Devroey, X., et al. (2012). A Vision for Behavioural Model-Driven Validation of Software Product Lines. In ISoLA'12. Crete, Greece: Springer.▪ Higher order and equivalent mutants detect./gen.▪ Test cases generation using counter examples in ProVeLines FTS model checker▪ Abstract test cases concretization ▪ Empirical assessment on an industrial case studyTest ModelCPTerminal t Identification idDirectDebit ddCreditCard cdOnline onOffline offPIN pinSignature sigreq.[1..*]PaymentSchema psConnectivity copt.InitCard_inAbortedinsert_cardabortremove_cardApp_initabortCH_verifiedcheck_PIN_online / on ∧ pin check_PIN_offline / off ∧ pincheck_signature/ ¬dd ∧ sigGo_online Go_offlineNO_GO no_gogo_offline / offgo_online / onabortIssuer_respondedask_issuerissuer_rejectsCompletedissuer_acceptsacceptsremove_cardinit_schema / dd ∨ crFeatured Transition System Java DSLpublic class CPTerminalFts extends   FeaturedTransitionSystemDefinition {@Overrideprotected void define() {  initial("i");  from("i").action("insert_card")     .to("CardIn");  from("cardIn").action("init_schema")     .fexpr("dd || cr").to("App_init");  ...}}Feature ModelBoolean Conjunctive Normal Form (CNF) in DIMACS format used as input to SAT and BDD solversModels Def.Model-Based Testing ProcessTest EngineerRequirementsTestModel Test CaseGenerator1. models2. selectioncriteriaAbstractTests  Test ScriptGeneratorTest Scripts3. concrete mapping SystemUnder TestTest Results4. analyses1. Models definition (Java DSL)2. Selection criteria definition  ■ Maximizing      - Structural coverage (state, transition, paths, ...) [2,3]      - Usage coverage (based on a usage model) [4]      - Dissimilarity measure (based on distance def.)      - Number of mutants killed by the tests [1]  ■ Minimizing      - Number of test cases in the test set [3]      - Number of valid configurations needed by the test set [3]3. Concrete mapping definition (TBD)4. Tests results analysis (TBD)Structural coverage FeaturedTransitionSystem fts =   new CPTerminalFts().getTransitionSystem();SolverFacade solver =   new Sat4JSolverFacade(dimacsFile);TestSet set = allStatesSelection(fts, solver);Dissimilarity measure maximization...set = dissimilarLocalMaximumDistance(fts,  solver, nbrTestCases, time);...set = dissimilarGlobalMaximumDistance(fts,  solver, nbrTestCases, time);Selection Criteria Def. ■ Goals: Quality Assessment (QA)    - Tester: QA of a set of abstract test cases    - Researcher: QA of a test case selection method ■ Mutant = Test Model with injected fault(s) ■ Result of the application of a mutation operator     - Act. Exchange, State Missing, Trans. Dest. Exchange, etc.  ■ Execution of the test cases on the mutants                                 Number of mutants detected ■ Mutation score =                                      Total number of mutantsModel Based Mutation Testing Mutant Execution using Featured Mutants ModelVariability Intensive system Behavioural teSting FrameworkVIBeStoolboxDSLselectiontransformationexecutionmutationcorefexpression<<uses>>●●Alive Killed FMM5e+015e+025e+035e+04Claroline●●●●●●●●●●●●●●●●●●Alive Killed FMM1e+021e+041e+06AGE−RR●●●●●●Alive Killed FMM1e+031e+041e+051e+06RandomTime in microsec.

English

https://pure.unamur.be/ws/files/12605865/JDI2015_poster.pdf

Poster: Behavioral Model-Based Testing of Variability Intensive Systems

Abstract

Similar works

Full text

Available Versions

Repository of the University of Namur

Repository of the University of Namur