An Evaluation Framework for Comparative Analysis of Generalized Stochastic Petri Net Simulation Techniques

Availability of a common, shared benchmark to provide repeatable, quantifiable, and comparable results is an added value for any scientific community. International consortia provide benchmarks in a wide range of domains, being normally used by industry, vendors, and researchers for evaluating their software products. In this regard, a benchmark of untimed Petri net models was developed to be used in a yearly software competition driven by the Petri net community. However, to the best of our knowledge there is not a similar benchmark to evaluate solution techniques for Petri nets with timing extensions. In this paper, we propose an evaluation framework for the comparative analysis of generalized stochastic Petri nets (GSPNs) simulation techniques. Although we focus on simulation techniques, our framework provides a baseline for a comparative analysis of different GSPN solvers (e.g., simulators, numerical solvers, or other techniques). The evaluation framework encompasses a set of 50 GSPN models including test cases and case studies from the literature, and a set of evaluation guidelines for the comparative analysis. In order to show the applicability of the proposed framework, we carry out a comparative analysis of steady-state simulators implemented in three academic software tools, namely, GreatSPN, PeabraiN, and TimeNET. The results allow us to validate the trustfulness of these academic software tools, as well as to point out potential problems and algorithmic optimization opportunities

Eco-design Integration into New Product Development Processes: Comparison between LCA Software and CAD-integrated Tools

The constant growth of environmental concerns and in order to satisfy the increasing population demands, designers have started to integrate eco-design parameters in early design stages. The technological development that happened in the last decade has started to integrate LCA methods within CAD tools, allowing non-geometric data to be integrated in a typical geometrical model. The main research interest of this thesis is focused on the evaluation of the use of these emerging CAD tools, as tools capable to evaluate the futures environmental impacts of products and processes. This thesis studies through three comparative case studies if SolidWorks Sustainability as a CAD tool integrating LCA features, is an acceptable and feasible software to perform a real LCA. The LCA software used for the comparison is GaBi. Results from the analyses revealed that SolidWorks Sustainability works as a trade-off solution introducing sustainability features into product design. However, it does not provide an accurate and extensive analysis the same way a dedicated LCA does. Thus, CAD-integrated tools should be only used as comparative tools. Further research with different products, settings, and software will bring more precise conclusions about the accuracy of these CAD tools

Statistical process monitoring of a multiphase flow facility

Industrial needs are evolving fast towards more flexible manufacture schemes. As a consequence, it is often required to adapt the plant production to the demand, which can be volatile depending on the application. This is why it is important to develop tools that can monitor the condition of the process working under varying operational conditions. Canonical Variate Analysis (CVA) is a multivariate data driven methodology which has been demonstrated to be superior to other methods, particularly under dynamically changing operational conditions. These comparative studies normally use computer simulated data in benchmark case studies such as the Tennessee Eastman Process Plant (Ricker, N.L. Tennessee Eastman Challenge Archive, Available at 〈http://depts.washington.edu/control/LARRY/TE/download.html〉 Accessed 21.03.2014). The aim of this work is to provide a benchmark case to demonstrate the ability of different monitoring techniques to detect and diagnose artificially seeded faults in an industrial scale multiphase flow experimental rig. The changing operational conditions, the size and complexity of the test rig make this case study an ideal candidate for a benchmark case that provides a test bed for the evaluation of novel multivariate process monitoring techniques performance using real experimental data. In this paper, the capabilities of CVA to detect and diagnose faults in a real system working under changing operating conditions are assessed and compared with other methodologies. The results obtained demonstrate that CVA can be effectively applied for the detection and diagnosis of faults in real complex systems, and reinforce the idea that the performance of CVA is superior to other algorithms

THE DOMINO EFFECT: Evaluating Therapeutic Recreation Assessment Tools’ Utility for Persons Experiencing [Dis] abilities

Assessment tools are part of a systematic process that is needed to provide a comprehensive picture of a client’s ability, performance and/or quality of life. These tools should inspire Therapeutic Recreation (TR) practitioners to reflect on whether our participants are benefiting from our services in the way we think they are benefiting from them (Ellis & Witt, 1986). The purpose of my qualitative research study was threefold. To explore the utility of several selected assessment tools from both the implementer and recipient’s perspective and from a manifest and latent analysis of the clarity and construction of the selected TR assessment tools. Utilization- focused evaluation framework guided this study to better understand which elements within existing assessment tools present a challenge. Three program participants and 26 practitioners participated in the study. The data sets included interview transcripts, focus group summaries of engagement with a “mock” case study, and the tools themselves. Data analysis involved manifest and latent content analyses of the tools, thematic analyses of the interviews and focus group engagement with the case study, and a triangulated comparative pattern analysis across the three data sets. Results indicated five main challenges practitioners experience when administering standardized assessment tools, (1) inconsistencies, (2) language barriers, (3) accessibility, (4) relevance, (5) perspective. Three main themes revealed from the data derived from the target populations, were (1) Fear, (2) Stereotyping and (3) Social Control. This thesis is a gateway for professionals and future researchers to begin a phase of creating new or updating existing TR standardized assessment tools to better meet the needs of ALL the populations we serve. Keywords: Therapeutic Recreation (TR), Assessment Tools, Evaluation, Disability, Mental Health, Barriers, and Utilit

What and how to evaluate clinical–surgical competence. The resident and staff surgeon perspective

AbstractBackgroundEvaluation is a means for significant and rigorous improvement of the educational process. Therefore, competence evaluation should allow assessing the complex activity of medical care, as well as improving the training process. This is the case in the evaluation process of clinical–surgical competences.Materials and methodsA cross-sectional study was designed to measure knowledge about the evaluation of clinical–surgical competences for the General Surgery residency programme at the Faculty of Medicine, Universidad Autónoma de Chihuahua (UACH). A 55-item questionnaire divided into six sections was used (perception, planning, practice, function, instruments and strategies, and overall evaluation), with a six level Likert scale, performing a descriptive, correlation and comparative analysis, with a significance level of 0.001.ResultsIn both groups perception of evaluation was considered as a further qualification. As regards tools, the best known was the written examination. As regards function, evaluation was considered as a further administrative requirement. In the correlation analysis, evaluation was perceived as qualification and was significantly associated with measurement, assessment and accreditation. In the comparative analysis between residents and staff surgeons, a significant difference was found as regards the perception of the evaluation as a measurement of knowledge (Student's t test: p=0.04).ConclusionThe results provide information about the concept we have about the evaluation of clinical–surgical competences, considering it as a measure of learning achievement for a socially required certification. There is confusion as regards the perception of evaluation, its function, goals and scopes as benefit for those evaluated

The Applicability of Software Tools for Genotoxicity and Carcinogenicity Prediction: Case Studies relevant to the Assessment of Pesticides

This report presents research results obtained in the framework of a project on the Applicability of Quantitative Structure-Activity Relationship (QSAR) analysis in the evaluation of the toxicological relevance of metabolites and degradates of pesticide active substances. During this project, which was funded by the European Food Safety Authority (EFSA), the Joint Research Centre (JRC) performed several investigations to evaluate the comparative performance of selected software tools for genotoxicity and carcinogenicity prediction, and to develop a number of case studies to illustrate the opportunities and difficulties arising in the computational assessment of pesticides. This exercise also included an investigation of the chemical space of several pesticides datasets. The results indicate that different software tools have different advantages and disadvantages, depending on the specific requirements of the user / risk assessor. It is concluded that further work is needed to develop acceptance criteria for specific regulatory applications (e.g. evaluation of pesticide metabolites) and to develop batteries of models fulfilling such criteria.JRC.DG.I.6-Systems toxicolog

Impact of rating evaluation on development of investment climate: case of Ukrainian economy

Methodical approaches to the investment climate evaluation have been formed. Methodological tools for assessing the investment attractiveness of the economy have been classified. To create a database to select the most important methods of assessment of the investment climate should undertake a comparative analysis on the target group of potential investors, the depth of research, the frequency of assessment of the investment climate, purpose assessment of the investment climate. International ratings are effective tools that help reduction information asymmetry, and a large number of methods of ranking permit the investor to receive information on all aspects of the investment attractiveness of the state. Rankings are shaping the image of the state, and ignoring the results of the ratings can lead to financial isolation of the state. Information on the methodology of the ratings in most cases is transparent, so the domestic state institutions have the ability to affect the future results of the ratings in the case of related reforms. However, there is no unified model of investment climate evaluation of the national economy, which directly affects the state of the investment climate of Ukraine's economy and the volume of foreign capital in the state. Rating evaluation of the investment climate for the Ukrainian economy has been offered

Central Management of Local Performance: A Comparison of England and Korea

The author analyses performance measurement in the public sector and empirically tests the validity, legitimacy and functionality of Comprehensive Performance Assessment in England and Joint Performance Assessment in Korea on the basis of comparative methodology.Since the 1980s, New Public Management (NPM) has deeply influenced the public sector across the world, and thus measuring or managing performance has become a principal element of government reform. In terms of borrowing models and techniques from the private sector, performance measurement has been significantly extended into government, but differences between the two sectors have led to difficulties and criticism of this practice with a wide inconsistent variety of different theoretical explanations about it. In this context, this thesis investigates the effectiveness of performance measurement and theoretical explanations of conditions for its success in the public sector. It focuses through a comparative methodology on Comprehensive Performance Assessment and Joint Performance Assessment that have recently been introduced between the levels of government in England and Korea for the improvement of local government performance and accountability. Extensive analysis of literature and case studies have allowed the thesis to find firstly, that the introduction of such unique assessment systems, by which the centre assesses localities, was deeply affected by the environmental commonalities of both countries such as centralisation in inter-governmental relations and enthusiasm for NPM. Second, the empirical evaluation of both tools shows that they have in practice been valid for accurate assessment, and directly functional for improvement and indirectly for accountability to the public. Their high validity and functionality proved to be mainly attributable to two characteristics. One was institutionally that both frameworks were based on a balanced approach to performance and the disclosure of assessment results to the public for facilitating competition between localities. The other was that both had impacted on internal management of local government which led to change in organisational culture with more focus on performance. However, it identified a necessity for local authorities to participate in the development process of those tools to ensure legitimacy of central management of local performance since they enjoy their own electorally based political support. The research has also found the importance of assessors’ expertise for accurate assessment and a possibility that performance measurement can contribute to the resolution of political tension and cooperation between central and local government when it focuses more on outcomes than input and process. A deeper theoretical and practical understanding of these successful experiences and important policy elements in contemporary public management contributes significantly to knowledge in the three settings of evaluation of policy instruments, comparison between countries and central-local relations. Finally, the study assists each country and others to draw lessons from each other

Development of a microcontroller-based control system with a hardware-in-the-loop (HIL) method for control education using MATLAB/simulink/xPC Target

This paper discusses the development of a microcontroller-based control system with hardware-inthe-loop (HIL) for enhancing the teaching of control engineering. This system consists of both hardware and software. The software tools MATLAB/Simulink/xPC Target by MathWorks, Inc and a C++ compiler are used to simulate the physical system (plant) to be controlled, while the hardware include a microcontroller as a controller and interfacing circuits to allow communication between the simulated plant and the real controller. This proposed system is inexpensive and allows students to carry out extensive experimental investigations, as well as the design, implementation, performance evaluation and comparative studies of controllers. A case study of the controller design and implementation for an active suspension system is presented to illustrate the application of the proposed system