Evaluating the public value of social innovation

Services that were traditionally delivered by the public sector are now proving difficult for the state to afford due to economic and socio-political challenges faced by society. In this context, social innovation plays an important role as it encourages civil society, private, public and third sector organisations to work together to find alternative ways of delivering services. This paper evaluates the influence of social innovation in creating public value through services offered to the community at both local and national levels in the UK. Three diverse cases are used from the UK context and analysed through a public value lens to examine the role of community, private, public and third sector organisations in driving social innovation. The findings highlight how social innovation contributes to addressing civil society needs while simultaneously contributing to the political and economic agendas of a country and the exploitation of science for the benefit of communities

Model selection, estimation and forecasting in VAR models with short-run and long-run restrictions

We study the joint determination of the lag length, the dimension of the cointegrating space and the rank of the matrix of short-run parameters of a vector autoregressive (VAR) model using model selection criteria. We consider model selection criteria which have data-dependent penalties for a lack of parsimony, as well as the traditional ones. We suggest a new procedure which is a hybrid of traditional criteria with data-dependant penalties. In order to compute the fit of each model, we propose an iterative procedure to compute the maximum likelihood estimates of parameters of a VAR model with short-run and long-run restrictions. Our Monte Carlo simulations measure the improvements in forecasting accuracy that can arise from the joint determination of lag-length and rank, relative to the commonly used procedure of selecting the lag-length only and then testing for cointegration.Reduced rank models, model selection criteria, forecasting accuracy

An interpretable deep learning model for time-series electronic health records: Case study of delirium prediction in critical care

Deep Learning (DL) models have received increasing attention in the clinical setting, particularly in intensive care units (ICU). In this context, the interpretability of the outcomes estimated by the DL models is an essential step towards increasing adoption of DL models in clinical practice. To address this challenge, we propose an ante-hoc, interpretable neural network model. Our proposed model, named double self-attention architecture (DSA), uses two attention-based mechanisms, including self-attention and effective attention. It can capture the importance of input variables in general, as well as changes in importance along the time dimension for the outcome of interest. We evaluated our model using two real-world clinical datasets covering 22840 patients in predicting onset of delirium 12 h and 48 h in advance. Additionally, we compare the descriptive performance of our model with three post-hoc interpretable algorithms as well as with the opinion of clinicians based on the published literature and clinical experience. We find that our model covers the majority of the top-10 variables ranked by the other three post-hoc interpretable algorithms as well as the clinical opinion, with the advantage of taking into account both, the dependencies among variables as well as dependencies between varying time-steps. Finally, our results show that our model can improve descriptive performance without sacrificing predictive performance

Prediction of stress levels in the workplace using surrounding stress

Occupational stress has a significant adverse effect on workers’ well-being, productivity, and performance and is becoming a major concern for both individual companies and the overall economy. To reduce negative consequences, early detection of stress is a key factor. In response several stress prediction methods have been proposed, whose primary aim is to analyse physiological and behavioural data. However, evidence suggests that solutions based on physiological and behavioural data alone might be challenging when implemented in real-world settings. These solutions are sensitive to data problems arising from losses in signal quality or alterations in body responses, which are common in everyday activities. The contagious nature of stress and its sensitivity to the surroundings can be used to improve these methods. In this study, we sought to investigate automatic stress prediction using both surrounding stress data, which we define as close colleagues’ stress levels and the stress level history of the individuals. We introduce a real-life, unconstrained study conducted with 30 workers monitored over 8 weeks. Furthermore, we propose a method to investigate the effect of stress levels of close colleagues on the prediction of an individual’s stress levels. Our method is also validated on an external, independent dataset. Our results show that surrounding stress can be used to improve stress prediction in the workplace, where we achieve 80% of F-score in predicting individuals’ stress levels from the surrounding stress data in a multiclass stress classification

Underweight but not overweight is associated with excess mortality in septic ICU patients

Background Higher survival has been shown for overweight septic patients compared with normal or underweight patients in the past. This study aimed at investigating the management and outcome of septic ICU patients in different body mass index (BMI) categories in a large multicenter database. Methods In total, 16,612 patients of the eICU collaborative research database were included. Baseline characteristics and data on organ support were documented. Multilevel logistic regression analysis was performed to fit three sequential regression models for the binary primary outcome (ICU mortality) to evaluate the impact of the BMI categories: underweight (<18.5 kg/m2), normal weight (18.5 to < 25 kg/m2), overweight (25 to < 30 kg/m2) and obesity (≥ 30 kg/m2). Data were adjusted for patient level characteristics (model 2) as well as management strategies (model 3). Results Management strategies were similar across BMI categories. Underweight patients evidenced higher rates of ICU mortality. This finding persisted after adjusting in model 2 (aOR 1.54, 95% CI 1.15–2.06; p = 0.004) and model 3 (aOR 1.57, 95%CI 1.16–2.12; p = 0.003). No differences were found regarding ICU mortality between normal and overweight patients (aOR 0.93, 95%CI 0.81–1.06; p = 0.29). Obese patients evidenced a lower risk of ICU mortality compared to normal weight, a finding which persisted across all models (model 2: aOR 0.83, 95%CI 0.69–0.99; p = 0.04; model 3: aOR 0.82, 95%CI 0.68–0.98; p = 0.03). The protective effect of obesity and the negative effect of underweight were significant in individuals > 65 years only. Conclusion In this cohort, underweight was associated with a worse outcome, whereas obese patients evidenced lower mortality. Our analysis thus supports the thesis of the obesity paradox

Machine learning models predict liver steatosis but not liver fibrosis in a prospective cohort study

Introduction Screening for liver fibrosis continues to rely on laboratory panels and non-invasive tests such as FIB-4-score and transient elastography. In this study, we evaluated the potential of machine learning (ML) methods to predict liver steatosis on abdominal ultrasound and liver fibrosis, namely the intermediate-high risk of advanced fibrosis, in individuals participating in a screening program for colorectal cancer. Methods We performed ultrasound on 5834 patients admitted between 2006 and 2020, and transient elastography on a subset of 1240 patients. Steatosis on ultrasound was diagnosed if liver areas showed a significantly increased echogenicity compared to the renal parenchyma. Liver fibrosis was defined as a liver stiffness measurement ≥8 kPa in transient elastography. We evaluated the performance of three algorithms, namely Extreme Gradient Boosting, Feed-Forward neural network and Logistic Regression, deriving the models using data from patients admitted from January 2007 up to January 2016 and prospectively evaluating on the data of patients admitted from January 2016 up to March 2020. We also performed a performance comparison with the standard clinical test based on Fibrosis-4 Index (FIB-4). Results The mean age was 58±9 years with 3036 males (52%). Modelling laboratory parameters, clinical parameters, and data on eight food types/dietary patterns, we achieved high performance in predicting liver steatosis on ultrasound with AUC of 0.87 (95% CI [0.87–0.87]), and moderate performance in predicting liver fibrosis with AUC of 0.75 (95% CI [0.74–0.75]) using XGBoost machine learning algorithm. Patient-reported variables did not significantly improve predictive performance. Gender-specific analyses showed significantly higher performance in males with AUC of 0.74 (95% CI [0.73–0.74]) in comparison to female patients with AUC of 0.66 (95% CI [0.65–0.66]) in prediction of liver fibrosis. This difference was significantly smaller in prediction of steatosis with AUC of 0.85 (95% CI [0.83–0.87]) in female patients, in comparison to male patients with AUC of 0.82 (95% CI [0.80–0.84]). Conclusion ML based on point-prevalence laboratory and clinical information predicts liver steatosis with high accuracy and liver fibrosis with moderate accuracy. The observed gender differences suggest the need to develop gender-specific models

Delirium prediction in the ICU: designing a screening tool for preventive interventions

Introduction Delirium occurrence is common and preventive strategies are resource intensive. Screening tools can prioritize patients at risk. Using machine learning, we can capture time and treatment effects that pose a challenge to delirium prediction. We aim to develop a delirium prediction model that can be used as a screening tool. Methods From the eICU Collaborative Research Database (eICU-CRD) and the Medical Information Mart for Intensive Care version III (MIMIC-III) database, patients with one or more Confusion Assessment Method-Intensive Care Unit (CAM-ICU) values and intensive care unit (ICU) length of stay greater than 24 h were included in our study. We validated our model using 21 quantitative clinical parameters and assessed performance across a range of observation and prediction windows, using different thresholds and applied interpretation techniques. We evaluate our models based on stratified repeated cross-validation using 3 algorithms, namely Logistic Regression, Random Forest, and Bidirectional Long Short-Term Memory (BiLSTM). BiLSTM represents an evolution from recurrent neural network-based Long Short-Term Memory, and with a backward input, preserves information from both past and future. Model performance is measured using Area Under Receiver Operating Characteristic, Area Under Precision Recall Curve, Recall, Precision (Positive Predictive Value), and Negative Predictive Value metrics. Results We evaluated our results on 16 546 patients (47% female) and 6294 patients (44% female) from eICU-CRD and MIMIC-III databases, respectively. Performance was best in BiLSTM models where, precision and recall changed from 37.52% (95% confidence interval [CI], 36.00%–39.05%) to 17.45 (95% CI, 15.83%–19.08%) and 86.1% (95% CI, 82.49%–89.71%) to 75.58% (95% CI, 68.33%–82.83%), respectively as prediction window increased from 12 to 96 h. After optimizing for higher recall, precision and recall changed from 26.96% (95% CI, 24.99%–28.94%) to 11.34% (95% CI, 10.71%–11.98%) and 93.73% (95% CI, 93.1%–94.37%) to 92.57% (95% CI, 88.19%–96.95%), respectively. Comparable results were obtained in the MIMIC-III cohort. Conclusions Our model performed comparably to contemporary models using fewer variables. Using techniques like sliding windows, modification of threshold to augment recall and feature ranking for interpretability, we addressed shortcomings of current models

Hyperlactatemia and altered lactate kinetics are associated with excess mortality in sepsis

Severe hyperlactatemia (>10mmol/L) or impaired lactate metabolism are known to correlate with increased mortality. The maximum lactate concentration on day 1 of 10,724 septic patients from the eICU Collaborative Research Database was analyzed and patients were divided into three groups based on maximum lactate in the first 24 h (<5mmol/l; ≥5mmol/l & <10mmol/l; ≥10mmol/l). In addition, delta lactate was calculated using the following formula: (maximum lactate day 1 minus maximum lactate day 2) divided by maximum lactate day 1. A multilevel regression analysis was performed, with hospital mortality serving as the primary study end point. Significant differences in hospital mortality were found in patients with hyperlactatemia (lactate ≥10mmol/l: 79%, ≥5mmol/l & <10mmol/l: 43%, <5mmol/l, 13%; p<0.001). The sensitivity of severe hyperlactatemia (≥10mmol/l) for hospital mortality was 17%, the specificity was 99%. In patients with negative delta lactate in the first 24 h, hospital mortality was excessive (92%). In conclusion, mortality in patients with severe hyperlactatemia is very high, especially if it persists for more than 24 h. Severe hyperlactatemia, together with clinical parameters, could therefore provide a basis for setting treatment limits

A large-scale study of a poultry trading network in Bangladesh: implications for control and surveillance of avian influenza viruses

Since its first report in 2007, avian influenza (AI) has been endemic in Bangladesh. While live poultry marketing is widespread throughout the country and known to influence AI dissemination and persistence, trading patterns have not been described. The aim of this study is to assess poultry trading practices and features of the poultry trading networks which could promote AI spread, and their potential implications for disease control and surveillance. Data on poultry trading practices was collected from 849 poultry traders during a cross-sectional survey in 138 live bird markets (LBMs) across 17 different districts of Bangladesh. The quantity and origins of traded poultry were assessed for each poultry type in surveyed LBMs. The network of contacts between farms and LBMs resulting from commercial movements of live poultry was constructed to assess its connectivity and to identify the key premises influencing it

Failure of lactate clearance predicts the outcome of critically ill septic patients

Purpose: Early lactate clearance is an important parameter for prognosis assessment and therapy control in sepsis. Patients with a lactate clearance >0% might differ from patients with an inferior clearance in terms of intensive care management and outcomes. This study analyzes a large collective with regards to baseline risk distribution and outcomes. Methods: In total, 3299 patients were included in this analysis, consisting of 1528 (46%) ≤0% and 1771 (54%) >0% patients. The primary endpoint was intensive care unit (ICU) mortality. Multilevel logistic regression analyses were used to compare both groups: A baseline model (model 1) with lactate clearance as a fixed effect and ICU as a random effect was installed. For model 2, patient characteristics (model 2) were included. For model 3, intensive care treatment (mechanical ventilation and vasopressors) was added to the model. Models 1 and 2 were used to evaluate the primary and secondary outcomes, respectively. Model 3 was only used to evaluate the primary outcomes. Adjusted odds ratios (aORs) with respective 95% confidence intervals (CI) were calculated. Results: The cohorts had no relevant differences regarding the gender, BMI, age, heart rate, body temperature, and baseline lactate. Neither the primary infection focuses nor the ethnic background differed between both groups. In both groups, the most common infection sites were of pulmonary origin, the urinary tract, and the gastrointestinal tract. Patients with lactate clearance >0% evidenced lower sepsis-related organ failure assessment (SOFA) scores (7 ± 6 versus 9 ± 6; p < 0.001) and creatinine (1.53 ± 1.49 versus 1.80 ± 1.67; p < 0.001). The ICU mortality differed significantly (14% versus 32%), and remained this way after multivariable adjustment for patient characteristics and intensive care treatment (aOR 0.43 95% CI 0.36–0.53; p < 0.001). In the additional sensitivity analysis, the lack of lactate clearance was associated with a worse prognosis in each subgroup. Conclusion: In this large collective of septic patients, the 6 h lactate clearance is an independent method for outcome prediction