Measuring Software Process: A Systematic Mapping Study

Context: Measurement is essential to reach predictable performance and high capability processes. It provides support for better understanding, evaluation, management, and control of the development process and project, as well as the resulting product. It also enables organizations to improve and predict its process’s performance, which places organizations in better positions to make appropriate decisions. Objective: This study aims to understand the measurement of the software development process, to identify studies, create a classification scheme based on the identified studies, and then to map such studies into the scheme to answer the research questions. Method: Systematic mapping is the selected research methodology for this study. Results: A total of 462 studies are included and classified into four topics with respect to their focus and into three groups based on the publishing date. Five abstractions and 64 attributes were identified, 25 methods/models and 17 contexts were distinguished. Conclusion: capability and performance were the most measured process attributes, while effort and performance were the most measured project attributes. Goal Question Metric and Capability Maturity Model Integration were the main methods and models used in the studies, whereas agile/lean development and small/medium-size enterprise were the most frequently identified research contexts.Ministerio de Economía y Competitividad TIN2013-46928-C3-3-RMinisterio de Economía y Competitividad TIN2016-76956-C3-2- RMinisterio de Economía y Competitividad TIN2015-71938-RED

Interventions for improving upper limb function after stroke

Background: Improving upper limb function is a core element of stroke rehabilitation needed to maximise patient outcomes and reduce disability. Evidence about effects of individual treatment techniques and modalities is synthesised within many reviews. For selection of effective rehabilitation treatment, the relative effectiveness of interventions must be known. However, a comprehensive overview of systematic reviews in this area is currently lacking. Objectives: To carry out a Cochrane overview by synthesising systematic reviews of interventions provided to improve upper limb function after stroke. Methods: Search methods: We comprehensively searched the Cochrane Database of Systematic Reviews; the Database of Reviews of Effects; and PROSPERO (an international prospective register of systematic reviews) (June 2013). We also contacted review authors in an effort to identify further relevant reviews. Selection criteria: We included Cochrane and non‐Cochrane reviews of randomised controlled trials (RCTs) of patients with stroke comparing upper limb interventions with no treatment, usual care or alternative treatments. Our primary outcome of interest was upper limb function; secondary outcomes included motor impairment and performance of activities of daily living. When we identified overlapping reviews, we systematically identified the most up‐to‐date and comprehensive review and excluded reviews that overlapped with this. Data collection and analysis: Two overview authors independently applied the selection criteria, excluding reviews that were superseded by more up‐to‐date reviews including the same (or similar) studies. Two overview authors independently assessed the methodological quality of reviews (using a modified version of the AMSTAR tool) and extracted data. Quality of evidence within each comparison in each review was determined using objective criteria (based on numbers of participants, risk of bias, heterogeneity and review quality) to apply GRADE (Grades of Recommendation, Assessment, Development and Evaluation) levels of evidence. We resolved disagreements through discussion. We systematically tabulated the effects of interventions and used quality of evidence to determine implications for clinical practice and to make recommendations for future research. Main results: Our searches identified 1840 records, from which we included 40 completed reviews (19 Cochrane; 21 non‐Cochrane), covering 18 individual interventions and dose and setting of interventions. The 40 reviews contain 503 studies (18,078 participants). We extracted pooled data from 31 reviews related to 127 comparisons. We judged the quality of evidence to be high for 1/127 comparisons (transcranial direct current stimulation (tDCS) demonstrating no benefit for outcomes of activities of daily living (ADLs)); moderate for 49/127 comparisons (covering seven individual interventions) and low or very low for 77/127 comparisons. Moderate‐quality evidence showed a beneficial effect of constraint‐induced movement therapy (CIMT), mental practice, mirror therapy, interventions for sensory impairment, virtual reality and a relatively high dose of repetitive task practice, suggesting that these may be effective interventions; moderate‐quality evidence also indicated that unilateral arm training may be more effective than bilateral arm training. Information was insufficient to reveal the relative effectiveness of different interventions. Moderate‐quality evidence from subgroup analyses comparing greater and lesser doses of mental practice, repetitive task training and virtual reality demonstrates a beneficial effect for the group given the greater dose, although not for the group given the smaller dose; however tests for subgroup differences do not suggest a statistically significant difference between these groups. Future research related to dose is essential. Specific recommendations for future research are derived from current evidence. These recommendations include but are not limited to adequately powered, high‐quality RCTs to confirm the benefit of CIMT, mental practice, mirror therapy, virtual reality and a relatively high dose of repetitive task practice; high‐quality RCTs to explore the effects of repetitive transcranial magnetic stimulation (rTMS), tDCS, hands‐on therapy, music therapy, pharmacological interventions and interventions for sensory impairment; and up‐to‐date reviews related to biofeedback, Bobath therapy, electrical stimulation, reach‐to‐grasp exercise, repetitive task training, strength training and stretching and positioning. Authors' conclusions: Large numbers of overlapping reviews related to interventions to improve upper limb function following stroke have been identified, and this overview serves to signpost clinicians and policy makers toward relevant systematic reviews to support clinical decisions, providing one accessible, comprehensive document, which should support clinicians and policy makers in clinical decision making for stroke rehabilitation. Currently, no high‐quality evidence can be found for any interventions that are currently used as part of routine practice, and evidence is insufficient to enable comparison of the relative effectiveness of interventions. Effective collaboration is urgently needed to support large, robust RCTs of interventions currently used routinely within clinical practice. Evidence related to dose of interventions is particularly needed, as this information has widespread clinical and research implications

Methodological criteria for the assessment of moderators in systematic reviews of randomised controlled trials : a consensus study

Background: Current methodological guidelines provide advice about the assessment of sub-group analysis within RCTs, but do not specify explicit criteria for assessment. Our objective was to provide researchers with a set of criteria that will facilitate the grading of evidence for moderators, in systematic reviews. Method: We developed a set of criteria from methodological manuscripts (n = 18) using snowballing technique, and electronic database searches. Criteria were reviewed by an international Delphi panel (n = 21), comprising authors who have published methodological papers in this area, and researchers who have been active in the study of sub-group analysis in RCTs. We used the Research ANd Development/University of California Los Angeles appropriateness method to assess consensus on the quantitative data. Free responses were coded for consensus and disagreement. In a subsequent round additional criteria were extracted from the Cochrane Reviewers’ Handbook, and the process was repeated. Results: The recommendations are that meta-analysts report both confirmatory and exploratory findings for subgroups analysis. Confirmatory findings must only come from studies in which a specific theory/evidence based apriori statement is made. Exploratory findings may be used to inform future/subsequent trials. However, for inclusion in the meta-analysis of moderators, the following additional criteria should be applied to each study: Baseline factors should be measured prior to randomisation, measurement of baseline factors should be of adequate reliability and validity, and a specific test of the interaction between baseline factors and interventions must be presented. Conclusions: There is consensus from a group of 21 international experts that methodological criteria to assess moderators within systematic reviews of RCTs is both timely and necessary. The consensus from the experts resulted in five criteria divided into two groups when synthesising evidence: confirmatory findings to support hypotheses about moderators and exploratory findings to inform future research. These recommendations are discussed in reference to previous recommendations for evaluating and reporting moderator studies

A framework for the selection of the right nuclear power plant

Civil nuclear reactors are used for the production of electrical energy. In the nuclear industry vendors propose several nuclear reactor designs with a size from 35–45 MWe up to 1600–1700 MWe. The choice of the right design is a multidimensional problem since a utility has to include not only financial factors as levelised cost of electricity (LCOE) and internal rate of return (IRR), but also the so called “external factors” like the required spinning reserve, the impact on local industry and the social acceptability. Therefore it is necessary to balance advantages and disadvantages of each design during the entire life cycle of the plant, usually 40–60 years. In the scientific literature there are several techniques for solving this multidimensional problem. Unfortunately it does not seem possible to apply these methodologies as they are, since the problem is too complex and it is difficult to provide consistent and trustworthy expert judgments. This paper fills the gap, proposing a two-step framework to choosing the best nuclear reactor at the pre-feasibility study phase. The paper shows in detail how to use the methodology, comparing the choice of a small-medium reactor (SMR) with a large reactor (LR), characterised, according to the International Atomic Energy Agency (2006), by an electrical output respectively lower and higher than 700 MWe

A Programming Environment Evaluation Methodology for Object-Oriented Systems

The object-oriented design strategy as both a problem decomposition and system development paradigm has made impressive inroads into the various areas of the computing sciences. Substantial development productivity improvements have been demonstrated in areas ranging from artificial intelligence to user interface design. However, there has been very little progress in the formal characterization of these productivity improvements and in the identification of the underlying cognitive mechanisms. The development and validation of models and metrics of this sort require large amounts of systematically-gathered structural and productivity data. There has, however, been a notable lack of systematically-gathered information on these development environments. A large part of this problem is attributable to the lack of a systematic programming environment evaluation methodology that is appropriate to the evaluation of object-oriented systems

Program Evaluation in the Context of Debates in the Field: The Evaluation of PR-CETP

This paper rationalizes the selection of the concept of energy as the central theme of a new capstone course aimed at science education majors. It describes the goals of the course and the activities that preceded the course design and led to the selection of the topics, of the educational materials, and of the teaching methodologies. It presents a sequential description of the manner in which the conceptual knowledge of energy was to be developed. The specific experiments, interactive demonstrations and other educational materials utilized for the conceptual development of the concept of energy in context are described and referenced. The course objectives are described, as well as the instruments utilized to assess student learning. It also presents the activities utilized to assess the course, in addition to the modifications made to the course syllabus based on this assessment

User involvement in a Cochrane systematic review:using structured methods to enhance the clinical relevance, usefulness and usability of a systematic review update

Background: This paper describes the structured methods used to involve patients, carers and health professionals in an update of a Cochrane systematic review relating to physiotherapy after stroke and explores the perceived impact of involvement.Methods: We sought funding and ethical approval for our user involvement. We recruited a stakeholder group comprising stroke survivors, carers, physiotherapists and educators and held three pre-planned meetings during the course of updating a Cochrane systematic review. Within these meetings, we used formal group consensus methods, based on nominal group techniques, to reach consensus decisions on key issues relating to the structure and methods of the review.Results: The stakeholder group comprised 13 people, including stroke survivors, carers and physiotherapists with a range of different experience, and either 12 or 13 participated in each meeting. At meeting 1, there was consensus that methods of categorising interventions that were used in the original Cochrane review were no longer appropriate or clinically relevant (11/13 participants disagreed or strongly disagreed with previous categories) and that international trials (which had not fitted into the original method of categorisation) ought to be included within the review (12/12 participants agreed or strongly agreed these should be included). At meeting 2, the group members reached consensus over 27 clearly defined treatment components, which were to be used to categorise interventions within the review (12/12 agreed or strongly agreed), and at meeting 3, they agreed on the key messages emerging from the completed review. All participants strongly agreed that the views of the group impacted on the review update, that the review benefited from the involvement of the stakeholder group, and that they believed other Cochrane reviews would benefit from the involvement of similar stakeholder groups.Conclusions: We involved a stakeholder group in the update of a Cochrane systematic review, using clearly described structured methods to reach consensus decisions. The involvement of stakeholders impacted substantially on the review, with the inclusion of international studies, and changes to classification of treatments, comparisons and subgroup comparisons explored within the meta-analysis. We argue that the structured approach which we adopted has implications for other systematic reviews.</p