Performance evaluation metrics for multi-objective evolutionary algorithms in search-based software engineering: Systematic literature review

Many recent studies have shown that various multi-objective evolutionary algorithms have been widely applied in the field of search-based software engineering (SBSE) for optimal solutions. Most of them either focused on solving newly re-formulated problems or on proposing new approaches, while a number of studies performed reviews and comparative studies on the performance of proposed algorithms. To evaluate such performance, it is necessary to consider a number of performance metrics that play important roles during the evaluation and comparison of investigated algorithms based on their best-simulated results. While there are hundreds of performance metrics in the literature that can quantify in performing such tasks, there is a lack of systematic review conducted to provide evidence of using these performance metrics, particularly in the software engineering problem domain. In this paper, we aimed to review and quantify the type of performance metrics, number of objectives, and applied areas in software engineering that reported in primary studies-this will eventually lead to inspiring the SBSE community to further explore such approaches in depth. To perform this task, a formal systematic review protocol was applied for planning, searching, and extracting the desired elements from the studies. After considering all the relevant inclusion and exclusion criteria for the searching process, 105 relevant articles were identified from the targeted online databases as scientific evidence to answer the eight research questions. The preliminary results show that remarkable studies were reported without considering performance metrics for the purpose of algorithm evaluation. Based on the 27 performance metrics that were identified, hypervolume, inverted generational distance, generational distance, and hypercube-based diversity metrics appear to be widely adopted in most of the studies in software requirements engineering, software design, software project management, software testing, and software verification. Additionally, there are increasing interest in the community in re-formulating many objective problems with more than three objectives, yet, currently are dominated in re-formulating two to three objectives

Bim: the setback or solution to project cost issues in Malaysia construction industry?

Malaysia is progressing into Industry Revolution (IR) 4.0 which emphasizes more onto digital, data and artificial intelligence where everything is expected to be automated. However, cost tends to be a major issue at the pioneer stage of embracing technology where Building Information Modelling (BIM) for example tends to be a cost tussle for the current construction industry. Yet, research has shown that BIM is arguably one of the technology platforms in combating the costing issue considering that BIM enables 3D model elements to link to cost and auto-generate quantities which potentially achieve cost-effective project. Due to the conflicting perspectives of how BIM affects project cost issues, it is imperative to investigate the cost-related issues in implementing BIM in the project and to determine how BIM in general positively influences the overall project cost. Qualitative research is adopted in this study. A semi-structured interview was conducted among four professionals who employs BIM in their project. They consist of the assistant manager, senior manager and chief executive officer. The data collected is analysed by utilising Matrix Table for better organisation. The scope of the study is in the Selangor state in which the local construction industry had applied BIM in their construction industry up to the 3D stage. The results showed that the BIM implementation cost is not too burdensome as it is only a one-time cost and does not vary throughout the project period. In addition, the BIM influence on the overall cost of the project is beneficial to the industry. It improves workflow and cost management. In conclusion, BIM is beneficial to the construction industry in the long term. It is important to resolve the costrelated issues for implement BIM and hence, encourage the usage of BIM, especially in the IR 4.0 ecosyste

Gallstone pancreatitis vs alcohol-induced pancreatitis: does aetiology affect the extent of pancreatic necrosis?

This is the final version. Available on open access from Mattioli 1885 via the DOI in this recordBackground and aim: The impact of different aetiologies of acute pancreatitis on the development of pancreatic necrosis (PN) is unclear. This study assessed the extent and progression of pancreatic and peripan-creatic necrosis on the computed tomography (CT) scan of patients with gallstone (GP) and alcohol-induced (AIP) pancreatitis and evaluated their impact on disease severity. Methods: Patients ≥ 18-year-old with GP, AIP and PN on CT ( January 2010 – September 2018), were considered. The radiological extent of PN and clinical outcomes were analysed with a logistic regression model. Results: Eighty-one patients, 59 with GP, 22 with AIP, were included. GP had a larger extent of PN when the body and/or tail of the pancreas were involved (P = 0.009). Gallstone disease (P = 0.028) and higher American Society of Anesthetists scores (P = 0.043) were predictors of necrosis diffuse to different areas of the pancreas. Predictors of single/multiple organ failure were GP (P = 0.040), necrosis > 50% of the pancreas (P = 0.002) with a diffuse pattern (P = 0.004). Conclusions: Patients with GP had a wider extent of necrosis in the pancreatic body and/or tail. The onset of organ failure can be predicted in subjects with GP and larger amount of PN

Locked down apps versus the social media ecology : why do young people and educators disagree on the best delivery platform for digital sexual health entertainment education?

This article reports on focus groups exploring the best way to reach young men with vulgar comedy videos that provide sexual health information. Young people reported that they found the means by which the material was presented - as a locked down app - to be problematic, and that it would better be delivered through social media platforms such as YouTube. This would make it more 'spreadable'. By contrast, adult sex education stakeholders thought the material should be contained within a locked down, stand-alone app - otherwise it might be seen by children who are too young, and/or young people might misunderstand the messages. We argue that the difference in approach represented by these two sets of opinions represents a fundamental stumbling block for attempts to reach young people with digital sexual health materials, which can be understood through the prism of different cultural forms - education versus entertainment

CMR for Assessment of Diastolic Function

Prevalence of heart failure with preserved left ventricular ejection fraction amounts to 50% of all cases with heart failure. Diagnosis assessment requires evidence of left ventricular diastolic dysfunction. Currently, echocardiography is the method of choice for diastolic function testing in clinical practice. Various applications are in use and recommended criteria are followed for classifying the severity of dysfunction. Cardiovascular magnetic resonance (CMR) offers a variety of alternative applications for evaluation of diastolic function, some superior to echocardiography in accuracy and reproducibility, some being complementary. In this article, the role of the available CMR applications for diastolic function testing in clinical practice and research is reviewed and compared to echocardiography

[(18)F]Fluoroethyltyrosine- positron emission tomography-guided radiotherapy for high-grade glioma

BACKGROUND: To compare morphological gross tumor volumes (GTVs), defined as pre- and postoperative gadolinium enhancement on T1-weighted magnetic resonance imaging to biological tumor volumes (BTVs), defined by the uptake of (18)F fluoroethyltyrosine (FET) for the radiotherapy planning of high-grade glioma, using a dedicated positron emission tomography (PET)-CT scanner equipped with three triangulation lasers for patient positioning. METHODS: Nineteen patients with malignant glioma were included into a prospective protocol using FET PET-CT for radiotherapy planning. To be eligible, patients had to present with residual disease after surgery. Planning was performed using the clinical target volume (CTV = GTV union or logical sum BTV) and planning target volume (PTV = CTV + 20 mm). First, the interrater reliability for BTV delineation was assessed among three observers. Second, the BTV and GTV were quantified and compared. Finally, the geometrical relationships between GTV and BTV were assessed. RESULTS: Interrater agreement for BTV delineation was excellent (intraclass correlation coefficient 0.9). Although, BTVs and GTVs were not significantly different (p = 0.9), CTVs (mean 57.8 +/- 30.4 cm(3)) were significantly larger than BTVs (mean 42.1 +/- 24.4 cm(3); p < 0.01) or GTVs (mean 38.7 +/- 25.7 cm(3); p < 0.01). In 13 (68%) and 6 (32%) of 19 patients, FET uptake extended >or= 10 and 20 mm from the margin of the gadolinium enhancement. CONCLUSION: Using FET, the interrater reliability had excellent agreement for BTV delineation. With FET PET-CT planning, the size and geometrical location of GTVs and BTVs differed in a majority of patients

Improved outcomes in patients with chronic obstructive pulmonary disease treated with salmeterol compared with placebo/usual therapy: results of a meta-analysis

BACKGROUND: Several studies have demonstrated that long-acting β(2)-agonists such as salmeterol are beneficial in chronic obstructive pulmonary disease (COPD). A meta-analysis was therefore conducted to review studies in COPD to provide pooled estimates of the effect of salmeterol 50 mcg taken twice daily in addition to usual therapy on several clinically relevant endpoints, when compared with placebo/usual therapy. METHODS: An extensive search of literature and clinical trial databases was conducted using the terms salmeterol, COPD, chronic, obstructive, bronchitis and emphysema. Nine randomized, double-blind, parallel-group, placebo-controlled trials of ≥12 week duration with salmeterol 50 mcg bid treatment in COPD were included (>3500 patients), with a further 14 trials excluded due to study design or reporting timelines. All patients were included, and a sub-group of subjects (84%) with poorly reversible COPD were considered separately. Statistical testing was carried out at the 5% level, except for interaction testing which was carried out at the 10% level. RESULTS: Patients treated with salmeterol over 12 months were less likely to withdraw early from the studies (19% patients compared with 25% on their current usual therapy, p < 0.001), less likely to suffer a moderate/severe exacerbation (34% compared with 39%, p < 0.0001) and had a greater increase in average FEV(1 )(73 mL difference vs placebo/usual therapy, p < 0.0001). Similar differences were found at 3 and 6 months. At all time points, more patients experienced an improvement in health status and also a greater change with salmeterol than with placebo/usual therapy (p < 0.002). There was no evidence of tachyphylaxis to salmeterol over 12 months. CONCLUSION: The meta-analysis confirmed clinically and statistically significant, sustained and consistent superiority of salmeterol 50 mcg bid over placebo/usual therapy on a broad range of outcome measures

Comparing the Invasibility of Experimental “Reefs” with Field Observations of Natural Reefs and Artificial Structures

Natural systems are increasingly being modified by the addition of artificial habitats which may facilitate invasion. Where invaders are able to disperse from artificial habitats, their impact may spread to surrounding natural communities and therefore it is important to investigate potential factors that reduce or enhance invasibility. We surveyed the distribution of non-indigenous and native invertebrates and algae between artificial habitats and natural reefs in a marine subtidal system. We also deployed sandstone plates as experimental ‘reefs’ and manipulated the orientation, starting assemblage and degree of shading. Invertebrates (non-indigenous and native) appeared to be responding to similar environmental factors (e.g. orientation) and occupied most space on artificial structures and to a lesser extent reef walls. Non-indigenous invertebrates are less successful than native invertebrates on horizontal reefs despite functional similarities. Manipulative experiments revealed that even when non-indigenous invertebrates invade vertical “reefs”, they are unlikely to gain a foothold and never exceed covers of native invertebrates (regardless of space availability). Community ecology suggests that invertebrates will dominate reef walls and algae horizontal reefs due to functional differences, however our surveys revealed that native algae dominate both vertical and horizontal reefs in shallow estuarine systems. Few non-indigenous algae were sampled in the study, however where invasive algal species are present in a system, they may present a threat to reef communities. Our findings suggest that non-indigenous species are less successful at occupying space on reef compared to artificial structures, and manipulations of biotic and abiotic conditions (primarily orientation and to a lesser extent biotic resistance) on experimental “reefs” explained a large portion of this variation, however they could not fully explain the magnitude of differences

The Love of Money and Pay Level Satisfaction: Measurement and Functional Equivalence in 29 Geopolitical Entities around the World

Demonstrating the equivalence of constructs is a key requirement for cross-cultural empirical research. The major purpose of this paper is to demonstrate how to assess measurement and functional equivalence or invariance using the 9-item, 3-factor Love of Money Scale (LOMS, a second-order factor model) and the 4-item, 1-factor Pay Level Satisfaction Scale (PLSS, a first-order factor model) across 29 samples in six continents (N = 5973). In step 1, we tested the configural, metric and scalar invariance of the LOMS and 17 samples achieved measurement invariance. In step 2, we applied the same procedures to the PLSS and nine samples achieved measurement invariance. Five samples (Brazil, China, South Africa, Spain and the USA) passed the measurement invariance criteria for both measures. In step 3, we found that for these two measures, common method variance was non-significant. In step 4, we tested the functional equivalence between the Love of Money Scale and Pay Level Satisfaction Scale. We achieved functional equivalence for these two scales in all five samples. The results of this study suggest the critical importance of evaluating and establishing measurement equivalence in cross-cultural studies. Suggestions for remedying measurement non-equivalence are offered

Delays without Mistakes: Response Time and Error Distributions in Dual-Task

BACKGROUND: When two tasks are presented within a short interval, a delay in the execution of the second task has been systematically observed. Psychological theorizing has argued that while sensory and motor operations can proceed in parallel, the coordination between these modules establishes a processing bottleneck. This model predicts that the timing but not the characteristics (duration, precision, variability...) of each processing stage are affected by interference. Thus, a critical test to this hypothesis is to explore whether the quality of the decision is unaffected by a concurrent task. METHODOLOGY/PRINCIPAL FINDINGS: In number comparison--as in most decision comparison tasks with a scalar measure of the evidence--the extent to which two stimuli can be discriminated is determined by their ratio, referred as the Weber fraction. We investigated performance in a rapid succession of two non-symbolic comparison tasks (number comparison and tone discrimination) in which error rates in both tasks could be manipulated parametrically from chance to almost perfect. We observed that dual-task interference has a massive effect on RT but does not affect the error rates, or the distribution of errors as a function of the evidence. CONCLUSIONS/SIGNIFICANCE: Our results imply that while the decision process itself is delayed during multiple task execution, its workings are unaffected by task interference, providing strong evidence in favor of a sequential model of task execution