Development of a framework for automated systematic testing of safety-critical embedded systems

“This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder." “Copyright IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.”In this paper we introduce the development of a framework for testing safety-critical embedded systems based on the concepts of model-based testing. In model-based testing the test cases are derived from a model of the system under test. In our approach the model is an automaton model that is automatically extracted from the C-source code of the system under test. Beside random test data generation the test case generation uses formal methods, in detail model checking techniques. To find appropriate test cases we use the requirements defined in the system specification. To cover further execution paths we developed an additional, to our best knowledge, novel method based on special structural coverage criteria. We present preliminary results on the model extraction using a concrete industrial case study from the automotive domain

A Framework for the Verification and Validation of Artificial Intelligence Machine Learning Systems

An effective verification and validation (V&V) process framework for the white-box and black-box testing of artificial intelligence (AI) machine learning (ML) systems is not readily available. This research uses grounded theory to develop a framework that leads to the most effective and informative white-box and black-box methods for the V&V of AI ML systems. Verification of the system ensures that the system adheres to the requirements and specifications developed and given by the major stakeholders, while validation confirms that the system properly performs with representative users in the intended environment and does not perform in an unexpected manner. Beginning with definitions, descriptions, and examples of ML processes and systems, the research results identify a clear and general process to effectively test these systems. The developed framework ensures the most productive and accurate testing results. Formerly, and occasionally still, the system definition and requirements exist in scattered documents that make it difficult to integrate, trace, and test through V&V. Modern system engineers along with system developers and stakeholders collaborate to produce a full system model using model-based systems engineering (MBSE). MBSE employs a Unified Modeling Language (UML) or System Modeling Language (SysML) representation of the system and its requirements that readily passes from each stakeholder for system information and additional input. The comprehensive and detailed MBSE model allows for direct traceability to the system requirements. xxiv To thoroughly test a ML system, one performs either white-box or black-box testing or both. Black-box testing is a testing method in which the internal model structure, design, and implementation of the system under test is unknown to the test engineer. Testers and analysts are simply looking at performance of the system given input and output. White-box testing is a testing method in which the internal model structure, design, and implementation of the system under test is known to the test engineer. When possible, test engineers and analysts perform both black-box and white-box testing. However, sometimes testers lack authorization to access the internal structure of the system. The researcher captures this decision in the ML framework. No two ML systems are exactly alike and therefore, the testing of each system must be custom to some degree. Even though there is customization, an effective process exists. This research includes some specialized methods, based on grounded theory, to use in the testing of the internal structure and performance. Through the study and organization of proven methods, this research develops an effective ML V&V framework. Systems engineers and analysts are able to simply apply the framework for various white-box and black-box V&V testing circumstances

Pengembangan Model Sistem Informasi Manajemen Dokumen Mutu STKIP PGRI Lubuklinggau

This study aims to manage quality document data based on information technology. The stages of this research method include; 1) requirements analysis, 2) design, 3) implementation and unit testing. 4) integration and system test. The approach in this study uses a systems approach with the waterfall model. The steps for developing a software model with a waterfall model are divided into 4 cycles, namely; 1) requirements analysis, 2) design, 3) implementation and unit testing. 4) integration and system test. The results of the study, 1) menu components and SOP submenus are feasible for use, 2) Standard Quality menu and submenu components are feasible for use, 3) quality manual menu and submenu components are feasible for use, 4) menu components and formuruclear submenus are suitable for use. In conclusion, the Quality Document SIM is feasible to use. The Quality Document Database Management Information System can assist LP3MP in managing data online, so that the LP3MP operator team can (input, process and output data) quickly, precisely and accurately. Keywords: SIM, Database, Quality Document

JTorX: Exploring Model-Based Testing

The overall goal of the work described in this thesis is: ``To design a flexible tool for state-of-the-art model-based derivation and automatic application of black-box tests for reactive systems, usable both for education and outside an academic context.'' From this goal, we derive functional and non-functional design requirements. The core of the thesis is a discussion of the design, in which we show how the functional requirements are fulfilled. In addition, we provide evidence to validate the non-functional requirements, in the form of case studies and responses to a tool user questionnaire. We describe the overall architecture of our tool, and discuss three usage scenarios which are necessary to fulfill the functional requirements: random on-line testing, guided on-line testing, and off-line test derivation and execution. With on-line testing, test derivation and test execution takes place in an integrated manner: a next test step is only derived when it is necessary for execution. With random testing, during test derivation a random walk through the model is done. With guided testing, during test derivation additional (guidance) information is used, to guide the derivation through specific paths in the model. With off-line testing, test derivation and test execution take place as separate activities. In our architecture we identify two major components: a test derivation engine, which synthesizes test primitives from a given model and from optional test guidance information, and a test execution engine, which contains the functionality to connect the test tool to the system under test. We refer to this latter functionality as the ``adapter''. In the description of the test derivation engine, we look at the same three usage scenarios, and we discuss support for visualization, and for dealing with divergence in the model. In the description of the test execution engine, we discuss three example adapter instances, and then generalise this to a general adapter design. We conclude with a description of extensions to deal with symbolic treatment of data and time

Analisis dan Perancangan Aplikasi Kepuasan Klien Berdasarkan Model Servqual (Studi Kasus: PT. Longvin Indonesia)

This research aims to analyze and develop service quality information systems on client satisfaction at PT. Longvin. This is because of PT. Longvin in processing service evaluations, assessing and distributing questionnaires which were still carried out manually so that in general it allowed for limitations and shortcomings such as piling up of files, incomplete questionnaire data filling, slow data processing, and could result in inaccurate decisions.The process of developing information systems using the waterfall model includes requirements analysis, system analysis, system modeling through defining context diagrams, data flow diagrams and entity relationship diagram. At the implementation stage, the system is oriented to the web environment using the programming languages PHP and MySQL as database management. For the analysis of service quality measurement using the servqual model. In the system, testing is carried out using BlackBox testing, while end-user testing is based on the results of questionnaire data processing using the Likert scale model.Based on the observation that the system can display the results of service quality calculations quickly and depicted through detailed graphs, total tables, average tables, and automatic suggestions. The results of system testing on end users show that the application built is very good with a percentage of 82% giving an agreed assessment

Information Management Database System Managerial Supervision of School Supervisors

This article aimed at managing information technology based school supervisory managerial supervision database. The approach in this study uses a system approach with a waterfall model. The steps of developing the model are requirements analysis, design,  implementation and unit testing, integration and system test. The results show that School supervisors in the North Musi Rawas District Office still use the manual system, and design of managerial supervisory information systems for principals are designed based on planned flowcharts. The results of expert validation, the supervisory managerial supervisory database includes; curriculum and learning administration, class administration, school administration and management, organization and institutions, facilities and infrastructure, staffing, funding, students, community participation, school cultural environment are appropriate to be used. The appropriate Implementation of the School Supervisory Managerial with Supervision Database SIM. Keywords: Management Information System, Management Supervision, System Managerial Supervisio