Test Case Selection and Prioritization Using Machine Learning: A Systematic Literature Review

Regression testing is an essential activity to assure that software code changes do not adversely affect existing functionalities. With the wide adoption of Continuous Integration (CI) in software projects, which increases the frequency of running software builds, running all tests can be time-consuming and resource-intensive. To alleviate that problem, Test case Selection and Prioritization (TSP) techniques have been proposed to improve regression testing by selecting and prioritizing test cases in order to provide early feedback to developers. In recent years, researchers have relied on Machine Learning (ML) techniques to achieve effective TSP (ML-based TSP). Such techniques help combine information about test cases, from partial and imperfect sources, into accurate prediction models. This work conducts a systematic literature review focused on ML-based TSP techniques, aiming to perform an in-depth analysis of the state of the art, thus gaining insights regarding future avenues of research. To that end, we analyze 29 primary studies published from 2006 to 2020, which have been identified through a systematic and documented process. This paper addresses five research questions addressing variations in ML-based TSP techniques and feature sets for training and testing ML models, alternative metrics used for evaluating the techniques, the performance of techniques, and the reproducibility of the published studies

A Fine-grained Data Set and Analysis of Tangling in Bug Fixing Commits

Context: Tangled commits are changes to software that address multiple concerns at once. For researchers interested in bugs, tangled commits mean that they actually study not only bugs, but also other concerns irrelevant for the study of bugs. Objective: We want to improve our understanding of the prevalence of tangling and the types of changes that are tangled within bug fixing commits. Methods: We use a crowd sourcing approach for manual labeling to validate which changes contribute to bug fixes for each line in bug fixing commits. Each line is labeled by four participants. If at least three participants agree on the same label, we have consensus. Results: We estimate that between 17% and 32% of all changes in bug fixing commits modify the source code to fix the underlying problem. However, when we only consider changes to the production code files this ratio increases to 66% to 87%. We find that about 11% of lines are hard to label leading to active disagreements between participants. Due to confirmed tangling and the uncertainty in our data, we estimate that 3% to 47% of data is noisy without manual untangling, depending on the use case. Conclusion: Tangled commits have a high prevalence in bug fixes and can lead to a large amount of noise in the data. Prior research indicates that this noise may alter results. As researchers, we should be skeptics and assume that unvalidated data is likely very noisy, until proven otherwise.Comment: Status: Accepted at Empirical Software Engineerin

The role of centre and country factors on process and outcome indicators in critically ill patients with hospital-acquired bloodstream infections

Purpose: The primary objective of this study was to evaluate the associations between centre/country-based factors and two important process and outcome indicators in patients with hospital-acquired bloodstream infections (HABSI). Methods: We used data on HABSI from the prospective EUROBACT-2 study to evaluate the associations between centre/country factors on a process or an outcome indicator: adequacy of antimicrobial therapy within the first 24 h or 28-day mortality, respectively. Mixed logistical models with clustering by centre identified factors associated with both indicators. Results: Two thousand two hundred nine patients from two hundred one intensive care units (ICUs) were included in forty-seven countries. Overall, 51% (n = 1128) of patients received an adequate antimicrobial therapy and the 28-day mortality was 38% (n = 839). The availability of therapeutic drug monitoring (TDM) for aminoglycosides everyday [odds ratio (OR) 1.48, 95% confidence interval (CI) 1.03-2.14] or within a few hours (OR 1.79, 95% CI 1.34-2.38), surveillance cultures for multidrug-resistant organism carriage performed weekly (OR 1.45, 95% CI 1.09-1.93), and increasing Human Development Index (HDI) values were associated with adequate antimicrobial therapy. The presence of intermediate care beds (OR 0.63, 95% CI 0.47-0.84), TDM for aminoglycoside available everyday (OR 0.66, 95% CI 0.44-1.00) or within a few hours (OR 0.51, 95% CI 0.37-0.70), 24/7 consultation of clinical pharmacists (OR 0.67, 95% CI 0.47-0.95), percentage of vancomycin-resistant enterococci (VRE) between 10% and 25% in the ICU (OR 1.67, 95% CI 1.00-2.80), and decreasing HDI values were associated with 28-day mortality. Conclusion: Centre/country factors should be targeted for future interventions to improve management strategies and outcome of HABSI in ICU patients

Presentation, management, and outcomes of older compared to younger adults with hospital-acquired bloodstream infections in the intensive care unit: a multicenter cohort study

Purpose: Older adults admitted to the intensive care unit (ICU) usually have fair baseline functional capacity, yet their age and frailty may compromise their management. We compared the characteristics and management of older (≥ 75 years) versus younger adults hospitalized in ICU with hospital-acquired bloodstream infection (HA-BSI). Methods: Nested cohort study within the EUROBACT-2 database, a multinational prospective cohort study including adults (≥ 18 years) hospitalized in the ICU during 2019-2021. We compared older versus younger adults in terms of infection characteristics (clinical signs and symptoms, source, and microbiological data), management (imaging, source control, antimicrobial therapy), and outcomes (28-day mortality and hospital discharge). Results: Among 2111 individuals hospitalized in 219 ICUs with HA-BSI, 563 (27%) were ≥ 75 years old. Compared to younger patients, these individuals had higher comorbidity score and lower functional capacity; presented more often with a pulmonary, urinary, or unknown HA-BSI source; and had lower heart rate, blood pressure and temperature at presentation. Pathogens and resistance rates were similar in both groups. Differences in management included mainly lower rates of effective source control achievement among aged individuals. Older adults also had significantly higher day-28 mortality (50% versus 34%, p < 0.001), and lower rates of discharge from hospital (12% versus 20%, p < 0.001) by this time. Conclusions: Older adults with HA-BSI hospitalized in ICU have different baseline characteristics and source of infection compared to younger patients. Management of older adults differs mainly by lower probability to achieve source control. This should be targeted to improve outcomes among older ICU patients

Epidemiology and outcomes of hospital-acquired bloodstream infections in intensive care unit patients: the EUROBACT-2 international cohort study

Purpose In the critically ill, hospital-acquired bloodstream infections (HA-BSI) are associated with significant mortality. Granular data are required for optimizing management, and developing guidelines and clinical trials. Methods We carried out a prospective international cohort study of adult patients (≥ 18 years of age) with HA-BSI treated in intensive care units (ICUs) between June 2019 and February 2021. Results 2600 patients from 333 ICUs in 52 countries were included. 78% HA-BSI were ICU-acquired. Median Sequential Organ Failure Assessment (SOFA) score was 8 [IQR 5; 11] at HA-BSI diagnosis. Most frequent sources of infection included pneumonia (26.7%) and intravascular catheters (26.4%). Most frequent pathogens were Gram-negative bacteria (59.0%), predominantly Klebsiella spp. (27.9%), Acinetobacter spp. (20.3%), Escherichia coli (15.8%), and Pseudomonas spp. (14.3%). Carbapenem resistance was present in 37.8%, 84.6%, 7.4%, and 33.2%, respectively. Difficult-to-treat resistance (DTR) was present in 23.5% and pan-drug resistance in 1.5%. Antimicrobial therapy was deemed adequate within 24 h for 51.5%. Antimicrobial resistance was associated with longer delays to adequate antimicrobial therapy. Source control was needed in 52.5% but not achieved in 18.2%. Mortality was 37.1%, and only 16.1% had been discharged alive from hospital by day-28. Conclusions HA-BSI was frequently caused by Gram-negative, carbapenem-resistant and DTR pathogens. Antimicrobial resistance led to delays in adequate antimicrobial therapy. Mortality was high, and at day-28 only a minority of the patients were discharged alive from the hospital. Prevention of antimicrobial resistance and focusing on adequate antimicrobial therapy and source control are important to optimize patient management and outcomes

Geoeconomic variations in epidemiology, ventilation management, and outcomes in invasively ventilated intensive care unit patients without acute respiratory distress syndrome: a pooled analysis of four observational studies

Background: Geoeconomic variations in epidemiology, the practice of ventilation, and outcome in invasively ventilated intensive care unit (ICU) patients without acute respiratory distress syndrome (ARDS) remain unexplored. In this analysis we aim to address these gaps using individual patient data of four large observational studies. Methods: In this pooled analysis we harmonised individual patient data from the ERICC, LUNG SAFE, PRoVENT, and PRoVENT-iMiC prospective observational studies, which were conducted from June, 2011, to December, 2018, in 534 ICUs in 54 countries. We used the 2016 World Bank classification to define two geoeconomic regions: middle-income countries (MICs) and high-income countries (HICs). ARDS was defined according to the Berlin criteria. Descriptive statistics were used to compare patients in MICs versus HICs. The primary outcome was the use of low tidal volume ventilation (LTVV) for the first 3 days of mechanical ventilation. Secondary outcomes were key ventilation parameters (tidal volume size, positive end-expiratory pressure, fraction of inspired oxygen, peak pressure, plateau pressure, driving pressure, and respiratory rate), patient characteristics, the risk for and actual development of acute respiratory distress syndrome after the first day of ventilation, duration of ventilation, ICU length of stay, and ICU mortality. Findings: Of the 7608 patients included in the original studies, this analysis included 3852 patients without ARDS, of whom 2345 were from MICs and 1507 were from HICs. Patients in MICs were younger, shorter and with a slightly lower body-mass index, more often had diabetes and active cancer, but less often chronic obstructive pulmonary disease and heart failure than patients from HICs. Sequential organ failure assessment scores were similar in MICs and HICs. Use of LTVV in MICs and HICs was comparable (42·4% vs 44·2%; absolute difference -1·69 [-9·58 to 6·11] p=0·67; data available in 3174 [82%] of 3852 patients). The median applied positive end expiratory pressure was lower in MICs than in HICs (5 [IQR 5-8] vs 6 [5-8] cm H2O; p=0·0011). ICU mortality was higher in MICs than in HICs (30·5% vs 19·9%; p=0·0004; adjusted effect 16·41% [95% CI 9·52-23·52]; p<0·0001) and was inversely associated with gross domestic product (adjusted odds ratio for a US$10 000 increase per capita 0·80 [95% CI 0·75-0·86]; p<0·0001). Interpretation: Despite similar disease severity and ventilation management, ICU mortality in patients without ARDS is higher in MICs than in HICs, with a strong association with country-level economic status