Traffic Light Control Using Deep Policy-Gradient and Value-Function Based Reinforcement Learning

Recent advances in combining deep neural network architectures with reinforcement learning techniques have shown promising potential results in solving complex control problems with high dimensional state and action spaces. Inspired by these successes, in this paper, we build two kinds of reinforcement learning algorithms: deep policy-gradient and value-function based agents which can predict the best possible traffic signal for a traffic intersection. At each time step, these adaptive traffic light control agents receive a snapshot of the current state of a graphical traffic simulator and produce control signals. The policy-gradient based agent maps its observation directly to the control signal, however the value-function based agent first estimates values for all legal control signals. The agent then selects the optimal control action with the highest value. Our methods show promising results in a traffic network simulated in the SUMO traffic simulator, without suffering from instability issues during the training process

Global, regional, and national burden of disorders affecting the nervous system, 1990–2021: a systematic analysis for the Global Burden of Disease Study 2021

BackgroundDisorders affecting the nervous system are diverse and include neurodevelopmental disorders, late-life neurodegeneration, and newly emergent conditions, such as cognitive impairment following COVID-19. Previous publications from the Global Burden of Disease, Injuries, and Risk Factor Study estimated the burden of 15 neurological conditions in 2015 and 2016, but these analyses did not include neurodevelopmental disorders, as defined by the International Classification of Diseases (ICD)-11, or a subset of cases of congenital, neonatal, and infectious conditions that cause neurological damage. Here, we estimate nervous system health loss caused by 37 unique conditions and their associated risk factors globally, regionally, and nationally from 1990 to 2021.MethodsWe estimated mortality, prevalence, years lived with disability (YLDs), years of life lost (YLLs), and disability-adjusted life-years (DALYs), with corresponding 95% uncertainty intervals (UIs), by age and sex in 204 countries and territories, from 1990 to 2021. We included morbidity and deaths due to neurological conditions, for which health loss is directly due to damage to the CNS or peripheral nervous system. We also isolated neurological health loss from conditions for which nervous system morbidity is a consequence, but not the primary feature, including a subset of congenital conditions (ie, chromosomal anomalies and congenital birth defects), neonatal conditions (ie, jaundice, preterm birth, and sepsis), infectious diseases (ie, COVID-19, cystic echinococcosis, malaria, syphilis, and Zika virus disease), and diabetic neuropathy. By conducting a sequela-level analysis of the health outcomes for these conditions, only cases where nervous system damage occurred were included, and YLDs were recalculated to isolate the non-fatal burden directly attributable to nervous system health loss. A comorbidity correction was used to calculate total prevalence of all conditions that affect the nervous system combined.FindingsGlobally, the 37 conditions affecting the nervous system were collectively ranked as the leading group cause of DALYs in 2021 (443 million, 95% UI 378–521), affecting 3·40 billion (3·20–3·62) individuals (43·1%, 40·5–45·9 of the global population); global DALY counts attributed to these conditions increased by 18·2% (8·7–26·7) between 1990 and 2021. Age-standardised rates of deaths per 100 000 people attributed to these conditions decreased from 1990 to 2021 by 33·6% (27·6–38·8), and age-standardised rates of DALYs attributed to these conditions decreased by 27·0% (21·5–32·4). Age-standardised prevalence was almost stable, with a change of 1·5% (0·7–2·4). The ten conditions with the highest age-standardised DALYs in 2021 were stroke, neonatal encephalopathy, migraine, Alzheimer's disease and other dementias, diabetic neuropathy, meningitis, epilepsy, neurological complications due to preterm birth, autism spectrum disorder, and nervous system cancer.InterpretationAs the leading cause of overall disease burden in the world, with increasing global DALY counts, effective prevention, treatment, and rehabilitation strategies for disorders affecting the nervous system are needed

The effect of gabapentin on muscle cramps during hemodialysis: A double-blind clinical trial

Hemodialysis‐associated muscle cramps (HAMC) are a common complication during hemodialysis (HD) sessions. A number of pharmacologic agents have been evaluated to prevent and or diminish HAMC; however, none of them has an established role. To the best of our knowledge, this is the first study to evaluate the possible effect of gabapentin on HAMC. In a double-blinded clinical trial, we compared the possible effect of gabapentin with a placebo in prevention and or diminishing episodes of HAMC in HD patients who had experienced frequent intradialytic muscle cramps. At first, placebo was given before each dialysis session for four weeks and then, after a two-week washout period, 300 mg of gabapentin was given before each dialysis session for four weeks to verify the effect of gabapentin on HAMC. Overall, 15 patients (seven men and eight women; mean age, 52.02 years) with frequent intradialytic muscle cramps were enrolled in the study. The incidence of symptomatic muscle cramp decreased in the gabapentin group compared with the placebo group, with a significant difference between them (P = 0.001). The intensity of muscle cramps also decreased in the gabapentin group (P = 0.001). There was no significant association between HAMC in male and female patients (P = 0. 397), mean age of HD patients (P = 0.226) and cause of end-stage renal disease (P = 0.551). According to the results of our study, gabapentin prescription before each HD session significantly reduced the frequency and the intensity of muscle cramps during HD without any major side-effects

What are the Antecedents of Safety Performance in the Workplace?

Given the progressive growth of interest in both academic and practitioners about safety performance in the workplace, the aim of this study is to provide a review of the literature on workplace safety from the perspective of the antecedent of safety performance. By conducting a systematic literature review, a list of relevant contributions on workplace safety is provided. The contributions were analyzed and classified regarding the arguments about the antecedents of safety performance. The study integrated different domains of the antecedent of safety performance to provide a clear and consistent definition for the concept of antecedent when applied to safety performance. Moreover, a list of common antecedents of safety performance was extracted from the literature and categorized. Finally, a unified and classified framework for antecedents of safety performance is proposed. From an academic perspective, this paper enables future research in developing research streams on the antecedents of safety performance. Equally important, practitioners can employ the proposed framework to select leading KPIs for safety performance evaluation and monitoring in the workplace

Improving pulse eddy current and ultrasonic testing stress measurement accuracy using neural network data fusion

Stress and residual stress are two crucial factors which play important roles in mechanical performance of materials, including fatigue and creep, hence measuring them is highly in demand. Pulse eddy current (PEC) and ultrasonic testing (UT) are two non-destructive tests (NDT) which are nominated to measure stresses and residual stresses by numerous scholars. However, both techniques suffer from lack of accuracy and reliability. One technique to tackle these challenges is data fusion, which has numerous approaches. This study introduces a promising one called neural network data fusion, which shows effective performance. First, stresses are simulated in an aluminium alloy 2024 specimen and then PEC and UT signals related to stresses are acquired and processed. Afterward, useful information obtained is fused using artificial neural network procedure and stresses are estimated by fused data. Finally, the accuracy of fused data are compared with PEC and UT information and results show the capability of neural network data fusion to improve stress measurement accuracy

MPPT Improvement for PMSG-Based Wind Turbines Using Extended Kalman Filter and Fuzzy Control System

Variable speed wind turbines are commonly used as wind power generation systems because of their lower maintenance cost and flexible speed control. The optimum output power for a wind turbine can be extracted using maximum power point tracking (MPPT) strategies. However, unpredictable parameters, such as wind speed and air density could affect the accuracy of the MPPT methods, especially during the wind speed small oscillations. In this paper, in a permanent magnet synchronous generator (PMSG), the MPPT is implemented by determining the uncertainty of the unpredictable parameters using the extended Kalman filter (EKF). Also, the generator speed is controlled by employing a fuzzy logic control (FLC) system. This study aims at minimizing the effects of unpredictable parameters on the MPPT of the PMSG system. The simulation results represent an improvement in MPPT accuracy and output power efficiency

Global mortality associated with 33 bacterial pathogens in 2019: a systematic analysis for the Global Burden of Disease Study 2019

Summary Background Reducing the burden of death due to infection is an urgent global public health priority. Previous studies have estimated the number of deaths associated with drug-resistant infections and sepsis and found that infections remain a leading cause of death globally. Understanding the global burden of common bacterial pathogens (both susceptible and resistant to antimicrobials) is essential to identify the greatest threats to public health. To our knowledge, this is the first study to present global comprehensive estimates of deaths associated with 33 bacterial pathogens across 11 major infectious syndromes. Methods We estimated deaths associated with 33 bacterial genera or species across 11 infectious syndromes in 2019 using methods from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2019, in addition to a subset of the input data described in the Global Burden of Antimicrobial Resistance 2019 study. This study included 343 million individual records or isolates covering 11 361 study-location-years. We used three modelling steps to estimate the number of deaths associated with each pathogen: deaths in which infection had a role, the fraction of deaths due to infection that are attributable to a given infectious syndrome, and the fraction of deaths due to an infectious syndrome that are attributable to a given pathogen. Estimates were produced for all ages and for males and females across 204 countries and territories in 2019. 95% uncertainty intervals (UIs) were calculated for final estimates of deaths and infections associated with the 33 bacterial pathogens following standard GBD methods by taking the 2·5th and 97·5th percentiles across 1000 posterior draws for each quantity of interest. Findings From an estimated 13·7 million (95% UI 10·9–17·1) infection-related deaths in 2019, there were 7·7 million deaths (5·7–10·2) associated with the 33 bacterial pathogens (both resistant and susceptible to antimicrobials) across the 11 infectious syndromes estimated in this study. We estimated deaths associated with the 33 bacterial pathogens to comprise 13·6% (10·2–18·1) of all global deaths and 56·2% (52·1–60·1) of all sepsis-related deaths in 2019. Five leading pathogens—Staphylococcus aureus, Escherichia coli, Streptococcus pneumoniae, Klebsiella pneumoniae, and Pseudomonas aeruginosa—were responsible for 54·9% (52·9–56·9) of deaths among the investigated bacteria. The deadliest infectious syndromes and pathogens varied by location and age. The age-standardised mortality rate associated with these bacterial pathogens was highest in the sub-Saharan Africa super-region, with 230 deaths (185–285) per 100 000 population, and lowest in the high-income super-region, with 52·2 deaths (37·4–71·5) per 100 000 population. S aureus was the leading bacterial cause of death in 135 countries and was also associated with the most deaths in individuals older than 15 years, globally. Among children younger than 5 years, S pneumoniae was the pathogen associated with the most deaths. In 2019, more than 6 million deaths occurred as a result of three bacterial infectious syndromes, with lower respiratory infections and bloodstream infections each causing more than 2 million deaths and peritoneal and intra-abdominal infections causing more than 1 million deaths. Interpretation The 33 bacterial pathogens that we investigated in this study are a substantial source of health loss globally, with considerable variation in their distribution across infectious syndromes and locations. Compared with GBD Level 3 underlying causes of death, deaths associated with these bacteria would rank as the second leading cause of death globally in 2019; hence, they should be considered an urgent priority for intervention within the global health community. Strategies to address the burden of bacterial infections include infection prevention, optimised use of antibiotics, improved capacity for microbiological analysis, vaccine development, and improved and more pervasive use of available vaccines. These estimates can be used to help set priorities for vaccine need, demand, and development

Age–sex differences in the global burden of lower respiratory infections and risk factors, 1990–2019: results from the Global Burden of Disease Study 2019

Summary Background The global burden of lower respiratory infections (LRIs) and corresponding risk factors in children older than 5 years and adults has not been studied as comprehensively as it has been in children younger than 5 years. We assessed the burden and trends of LRIs and risk factors across all age groups by sex, for 204 countries and territories. Methods In this analysis of data for the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2019, we used clinician-diagnosed pneumonia or bronchiolitis as our case definition for LRIs. We included International Classification of Diseases 9th edition codes 079.6, 466–469, 470.0, 480–482.8, 483.0–483.9, 484.1–484.2, 484.6–484.7, and 487–489 and International Classification of Diseases 10th edition codes A48.1, A70, B97.4–B97.6, J09–J15.8, J16–J16.9, J20–J21.9, J91.0, P23.0–P23.4, and U04–U04.9. We used the Cause of Death Ensemble modelling strategy to analyse 23 109 site-years of vital registration data, 825 site-years of sample vital registration data, 1766 site-years of verbal autopsy data, and 681 site-years of mortality surveillance data. We used DisMod-MR 2.1, a Bayesian meta-regression tool, to analyse age–sex-specific incidence and prevalence data identified via systematic reviews of the literature, population-based survey data, and claims and inpatient data. Additionally, we estimated age–sex-specific LRI mortality that is attributable to the independent effects of 14 risk factors. Findings Globally, in 2019, we estimated that there were 257 million (95% uncertainty interval [UI] 240–275) LRI incident episodes in males and 232 million (217–248) in females. In the same year, LRIs accounted for 1·30 million (95% UI 1·18–1·42) male deaths and 1·20 million (1·07–1·33) female deaths. Age-standardised incidence and mortality rates were 1·17 times (95% UI 1·16–1·18) and 1·31 times (95% UI 1·23–1·41) greater in males than in females in 2019. Between 1990 and 2019, LRI incidence and mortality rates declined at different rates across age groups and an increase in LRI episodes and deaths was estimated among all adult age groups, with males aged 70 years and older having the highest increase in LRI episodes (126·0% [95% UI 121·4–131·1]) and deaths (100·0% [83·4–115·9]). During the same period, LRI episodes and deaths in children younger than 15 years were estimated to have decreased, and the greatest decline was observed for LRI deaths in males younger than 5 years (–70·7% [–77·2 to –61·8]). The leading risk factors for LRI mortality varied across age groups and sex. More than half of global LRI deaths in children younger than 5 years were attributable to child wasting (population attributable fraction [PAF] 53·0% [95% UI 37·7–61·8] in males and 56·4% [40·7–65·1] in females), and more than a quarter of LRI deaths among those aged 5–14 years were attributable to household air pollution (PAF 26·0% [95% UI 16·6–35·5] for males and PAF 25·8% [16·3–35·4] for females). PAFs of male LRI deaths attributed to smoking were 20·4% (95% UI 15·4–25·2) in those aged 15–49 years, 30·5% (24·1–36·9) in those aged 50–69 years, and 21·9% (16·8–27·3) in those aged 70 years and older. PAFs of female LRI deaths attributed to household air pollution were 21·1% (95% UI 14·5–27·9) in those aged 15–49 years and 18·2% (12·5–24·5) in those aged 50–69 years. For females aged 70 years and older, the leading risk factor, ambient particulate matter, was responsible for 11·7% (95% UI 8·2–15·8) of LRI deaths. Interpretation The patterns and progress in reducing the burden of LRIs and key risk factors for mortality varied across age groups and sexes. The progress seen in children younger than 5 years was clearly a result of targeted interventions, such as vaccination and reduction of exposure to risk factors. Similar interventions for other age groups could contribute to the achievement of multiple Sustainable Development Goals targets, including promoting wellbeing at all ages and reducing health inequalities. Interventions, including addressing risk factors such as child wasting, smoking, ambient particulate matter pollution, and household air pollution, would prevent deaths and reduce health disparities