39 research outputs found

    Attention Visualizer Package: Revealing Word Importance for Deeper Insight into Encoder-Only Transformer Models

    Full text link
    This report introduces the Attention Visualizer package, which is crafted to visually illustrate the significance of individual words in encoder-only transformer-based models. In contrast to other methods that center on tokens and self-attention scores, our approach will examine the words and their impact on the final embedding representation. Libraries like this play a crucial role in enhancing the interpretability and explainability of neural networks. They offer the opportunity to illuminate their internal mechanisms, providing a better understanding of how they operate and can be enhanced. You can access the code and review examples on the following GitHub repository: https://github.com/AlaFalaki/AttentionVisualizer.Comment: 12 pages, 15 figure

    Keratinocyte Growth Factor Induces Gene Expression Signature Associated with Suppression of Malignant Phenotype of Cutaneous Squamous Carcinoma Cells

    Get PDF
    Keratinocyte growth factor (KGF, fibroblast growth factor-7) is a fibroblast-derived mitogen, which stimulates proliferation of epithelial cells. The expression of KGF by dermal fibroblasts is induced following injury and it promotes wound repair. However, the role of KGF in cutaneous carcinogenesis and cancer progression is not known. We have examined the role of KGF in progression of squamous cell carcinoma (SCC) of the skin. The expression of KGF receptor (KGFR) mRNA was lower in cutaneous SCCs (n = 6) than in normal skin samples (n = 6). Expression of KGFR mRNA was detected in 6 out of 8 cutaneous SCC cell lines and the levels were downregulated by 24-h treatment with KGF. KGF did not stimulate SCC cell proliferation, but it reduced invasion of SCC cells through collagen. Gene expression profiling of three cutaneous SCC cell lines treated with KGF for 24 h revealed a specific gene expression signature characterized by upregulation of a set of genes specifically downregulated in SCC cells compared to normal epidermal keratinocytes, including genes with tumor suppressing properties (SPRY4, DUSP4, DUSP6, LRIG1, PHLDA1). KGF also induced downregulation of a set of genes specifically upregulated in SCC cells compared to normal keratinocytes, including genes associated with tumor progression (MMP13, MATN2, CXCL10, and IGFBP3). Downregulation of MMP-13 and KGFR expression in SCC cells and HaCaT cells was mediated via ERK1/2. Activation of ERK1/2 in HaCaT cells and tumorigenic Ha-ras-transformed HaCaT cells resulted in downregulation of MMP-13 and KGFR expression. These results provide evidence, that KGF does not promote progression of cutaneous SCC, but rather suppresses the malignant phenotype of cutaneous SCC cells by regulating the expression of several genes differentially expressed in SCC cells, as compared to normal keratinocytes

    Cardiometabolic effects of genetic upregulation of the interleukin 1 receptor antagonist: a Mendelian randomisation analysis

    Get PDF
    Background To investigate potential cardiovascular and other effects of long-term pharmacological interleukin 1 (IL-1) inhibition, we studied genetic variants that produce inhibition of IL-1, a master regulator of inflammation. Methods We created a genetic score combining the effects of alleles of two common variants (rs6743376 and rs1542176) that are located upstream of IL1RN, the gene encoding the IL-1 receptor antagonist (IL-1Ra; an endogenous inhibitor of both IL-1 alpha and IL-1 beta); both alleles increase soluble IL-1Ra protein concentration. We compared effects on inflammation biomarkers of this genetic score with those of anakinra, the recombinant form of IL-1Ra, which has previously been studied in randomised trials of rheumatoid arthritis and other inflammatory disorders. In primary analyses, we investigated the score in relation to rheumatoid arthritis and four cardiometabolic diseases (type 2 diabetes, coronary heart disease, ischaemic stroke, and abdominal aortic aneurysm; 453 411 total participants). In exploratory analyses, we studied the relation of the score to many disease traits and to 24 other disorders of proposed relevance to IL-1 signalling (746 171 total participants). Findings For each IL1RN minor allele inherited, serum concentrations of IL-1Ra increased by 0.22 SD (95% CI 0.18-0.25; 12.5%; p=9.3 x 10(-33)), concentrations of interleukin 6 decreased by 0.02 SD (-0.04 to -0.01; -1,7%; p=3.5 x 10(-3)), and concentrations of C-reactive protein decreased by 0.03 SD (-0.04 to -0.02; -3.4%; p=7.7 x 10(-14)). We noted the effects of the genetic score on these inflammation biomarkers to be directionally concordant with those of anakinra. The allele count of the genetic score had roughly log-linear, dose-dependent associations with both IL-1Ra concentration and risk of coronary heart disease. For people who carried four IL-1Ra-raising alleles, the odds ratio for coronary heart disease was 1.15 (1.08-1.22; p=1.8 x 10(-6)) compared with people who carried no IL-1Ra-raising alleles; the per-allele odds ratio for coronary heart disease was 1.03 (1.02-1.04; p=3.9 x 10(-10)). Perallele odds ratios were 0.97 (0.95-0.99; p=9.9 x 10(-4)) for rheumatoid arthritis, 0.99 (0.97-1.01; p=0.47) for type 2 diabetes, 1.00 (0.98-1.02; p=0.92) for ischaemic stroke, and 1.08 (1.04-1.12; p=1.8 x 10(-5)) for abdominal aortic aneurysm. In exploratory analyses, we observed per-allele increases in concentrations of proatherogenic lipids, including LDL-cholesterol, but no clear evidence of association for blood pressure, glycaemic traits, or any of the 24 other disorders studied. Modelling suggested that the observed increase in LDL-cholesterol could account for about a third of the association observed between the genetic score and increased coronary risk. Interpretation Human genetic data suggest that long-term dual IL-1 alpha/beta inhibition could increase cardiovascular risk and, conversely, reduce the risk of development of rheumatoid arthritis. The cardiovascular risk might, in part, be mediated through an increase in proatherogenic lipid concentrations. Copyright (C) The Interleukin 1 Genetics Consortium. Open Access article distributed under the terms of CC-BY-NC-ND

    Human matrix metalloproteinases: An ubiquitarian class of enzymes involved in several pathological processes

    Get PDF
    Human matrix metalloproteinases (MMPs) belong to the M10 family of the MA clan of endopeptidases. They are ubiquitarian enzymes, structurally characterized by an active site where a Zn(2+) atom, coordinated by three histidines, plays the catalytic role, assisted by a glutamic acid as a general base. Various MMPs display different domain composition, which is very important for macromolecular substrates recognition. Substrate specificity is very different among MMPs, being often associated to their cellular compartmentalization and/or cellular type where they are expressed. An extensive review of the different MMPs structural and functional features is integrated with their pathological role in several types of diseases, spanning from cancer to cardiovascular diseases and to neurodegeneration. It emerges a very complex and crucial role played by these enzymes in many physiological and pathological processes

    Population and fertility by age and sex for 195 countries and territories, 1950–2017: a systematic analysis for the Global Burden of Disease Study 2017

    Get PDF
    Background: Population estimates underpin demographic and epidemiological research and are used to track progress on numerous international indicators of health and development. To date, internationally available estimates of population and fertility, although useful, have not been produced with transparent and replicable methods and do not use standardised estimates of mortality. We present single-calendar year and single-year of age estimates of fertility and population by sex with standardised and replicable methods. Methods: We estimated population in 195 locations by single year of age and single calendar year from 1950 to 2017 with standardised and replicable methods. We based the estimates on the demographic balancing equation, with inputs of fertility, mortality, population, and migration data. Fertility data came from 7817 location-years of vital registration data, 429 surveys reporting complete birth histories, and 977 surveys and censuses reporting summary birth histories. We estimated age-specific fertility rates (ASFRs; the annual number of livebirths to women of a specified age group per 1000 women in that age group) by use of spatiotemporal Gaussian process regression and used the ASFRs to estimate total fertility rates (TFRs; the average number of children a woman would bear if she survived through the end of the reproductive age span [age 10–54 years] and experienced at each age a particular set of ASFRs observed in the year of interest). Because of sparse data, fertility at ages 10–14 years and 50–54 years was estimated from data on fertility in women aged 15–19 years and 45–49 years, through use of linear regression. Age-specific mortality data came from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2017 estimates. Data on population came from 1257 censuses and 761 population registry location-years and were adjusted for underenumeration and age misreporting with standard demographic methods. Migration was estimated with the GBD Bayesian demographic balancing model, after incorporating information about refugee migration into the model prior. Final population estimates used the cohort-component method of population projection, with inputs of fertility, mortality, and migration data. Population uncertainty was estimated by use of out-of-sample predictive validity testing. With these data, we estimated the trends in population by age and sex and in fertility by age between 1950 and 2017 in 195 countries and territories. Findings: From 1950 to 2017, TFRs decreased by 49\ub74% (95% uncertainty interval [UI] 46\ub74–52\ub70). The TFR decreased from 4\ub77 livebirths (4\ub75–4\ub79) to 2\ub74 livebirths (2\ub72–2\ub75), and the ASFR of mothers aged 10–19 years decreased from 37 livebirths (34–40) to 22 livebirths (19–24) per 1000 women. Despite reductions in the TFR, the global population has been increasing by an average of 83\ub78 million people per year since 1985. The global population increased by 197\ub72% (193\ub73–200\ub78) since 1950, from 2\ub76 billion (2\ub75–2\ub76) to 7\ub76 billion (7\ub74–7\ub79) people in 2017; much of this increase was in the proportion of the global population in south Asia and sub-Saharan Africa. The global annual rate of population growth increased between 1950 and 1964, when it peaked at 2\ub70%; this rate then remained nearly constant until 1970 and then decreased to 1\ub71% in 2017. Population growth rates in the southeast Asia, east Asia, and Oceania GBD super-region decreased from 2\ub75% in 1963 to 0\ub77% in 2017, whereas in sub-Saharan Africa, population growth rates were almost at the highest reported levels ever in 2017, when they were at 2\ub77%. The global average age increased from 26\ub76 years in 1950 to 32\ub71 years in 2017, and the proportion of the population that is of working age (age 15–64 years) increased from 59\ub79% to 65\ub73%. At the national level, the TFR decreased in all countries and territories between 1950 and 2017; in 2017, TFRs ranged from a low of 1\ub70 livebirths (95% UI 0\ub79–1\ub72) in Cyprus to a high of 7\ub71 livebirths (6\ub78–7\ub74) in Niger. The TFR under age 25 years (TFU25; number of livebirths expected by age 25 years for a hypothetical woman who survived the age group and was exposed to current ASFRs) in 2017 ranged from 0\ub708 livebirths (0\ub707–0\ub709) in South Korea to 2\ub74 livebirths (2\ub72–2\ub76) in Niger, and the TFR over age 30 years (TFO30; number of livebirths expected for a hypothetical woman ageing from 30 to 54 years who survived the age group and was exposed to current ASFRs) ranged from a low of 0\ub73 livebirths (0\ub73–0\ub74) in Puerto Rico to a high of 3\ub71 livebirths (3\ub70–3\ub72) in Niger. TFO30 was higher than TFU25 in 145 countries and territories in 2017. 33 countries had a negative population growth rate from 2010 to 2017, most of which were located in central, eastern, and western Europe, whereas population growth rates of more than 2\ub70% were seen in 33 of 46 countries in sub-Saharan Africa. In 2017, less than 65% of the national population was of working age in 12 of 34 high-income countries, and less than 50% of the national population was of working age in Mali, Chad, and Niger. Interpretation: Population trends create demographic dividends and headwinds (ie, economic benefits and detriments) that affect national economies and determine national planning needs. Although TFRs are decreasing, the global population continues to grow as mortality declines, with diverse patterns at the national level and across age groups. To our knowledge, this is the first study to provide transparent and replicable estimates of population and fertility, which can be used to inform decision making and to monitor progress. Funding: Bill & Melinda Gates Foundation

    Mortality and pulmonary complications in patients undergoing surgery with perioperative SARS-CoV-2 infection: an international cohort study

    Get PDF
    Background: The impact of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) on postoperative recovery needs to be understood to inform clinical decision making during and after the COVID-19 pandemic. This study reports 30-day mortality and pulmonary complication rates in patients with perioperative SARS-CoV-2 infection. Methods: This international, multicentre, cohort study at 235 hospitals in 24 countries included all patients undergoing surgery who had SARS-CoV-2 infection confirmed within 7 days before or 30 days after surgery. The primary outcome measure was 30-day postoperative mortality and was assessed in all enrolled patients. The main secondary outcome measure was pulmonary complications, defined as pneumonia, acute respiratory distress syndrome, or unexpected postoperative ventilation. Findings: This analysis includes 1128 patients who had surgery between Jan 1 and March 31, 2020, of whom 835 (74·0%) had emergency surgery and 280 (24·8%) had elective surgery. SARS-CoV-2 infection was confirmed preoperatively in 294 (26·1%) patients. 30-day mortality was 23·8% (268 of 1128). Pulmonary complications occurred in 577 (51·2%) of 1128 patients; 30-day mortality in these patients was 38·0% (219 of 577), accounting for 81·7% (219 of 268) of all deaths. In adjusted analyses, 30-day mortality was associated with male sex (odds ratio 1·75 [95% CI 1·28–2·40], p\textless0·0001), age 70 years or older versus younger than 70 years (2·30 [1·65–3·22], p\textless0·0001), American Society of Anesthesiologists grades 3–5 versus grades 1–2 (2·35 [1·57–3·53], p\textless0·0001), malignant versus benign or obstetric diagnosis (1·55 [1·01–2·39], p=0·046), emergency versus elective surgery (1·67 [1·06–2·63], p=0·026), and major versus minor surgery (1·52 [1·01–2·31], p=0·047). Interpretation: Postoperative pulmonary complications occur in half of patients with perioperative SARS-CoV-2 infection and are associated with high mortality. Thresholds for surgery during the COVID-19 pandemic should be higher than during normal practice, particularly in men aged 70 years and older. Consideration should be given for postponing non-urgent procedures and promoting non-operative treatment to delay or avoid the need for surgery. Funding: National Institute for Health Research (NIHR), Association of Coloproctology of Great Britain and Ireland, Bowel and Cancer Research, Bowel Disease Research Foundation, Association of Upper Gastrointestinal Surgeons, British Association of Surgical Oncology, British Gynaecological Cancer Society, European Society of Coloproctology, NIHR Academy, Sarcoma UK, Vascular Society for Great Britain and Ireland, and Yorkshire Cancer Research

    Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock, 2012

    Get PDF
    OBJECTIVE: To provide an update to the "Surviving Sepsis Campaign Guidelines for Management of Severe Sepsis and Septic Shock," last published in 2008. DESIGN: A consensus committee of 68 international experts representing 30 international organizations was convened. Nominal groups were assembled at key international meetings (for those committee members attending the conference). A formal conflict of interest policy was developed at the onset of the process and enforced throughout. The entire guidelines process was conducted independent of any industry funding. A stand-alone meeting was held for all subgroup heads, co- and vice-chairs, and selected individuals. Teleconferences and electronic-based discussion among subgroups and among the entire committee served as an integral part of the development. METHODS: The authors were advised to follow the principles of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system to guide assessment of quality of evidence from high (A) to very low (D) and to determine the strength of recommendations as strong (1) or weak (2). The potential drawbacks of making strong recommendations in the presence of low-quality evidence were emphasized. Recommendations were classified into three groups: (1) those directly targeting severe sepsis; (2) those targeting general care of the critically ill patient and considered high priority in severe sepsis; and (3) pediatric considerations. RESULTS: Key recommendations and suggestions, listed by category, include: early quantitative resuscitation of the septic patient during the first 6 h after recognition (1C); blood cultures before antibiotic therapy (1C); imaging studies performed promptly to confirm a potential source of infection (UG); administration of broad-spectrum antimicrobials therapy within 1 h of the recognition of septic shock (1B) and severe sepsis without septic shock (1C) as the goal of therapy; reassessment of antimicrobial therapy daily for de-escalation, when appropriate (1B); infection source control with attention to the balance of risks and benefits of the chosen method within 12 h of diagnosis (1C); initial fluid resuscitation with crystalloid (1B) and consideration of the addition of albumin in patients who continue to require substantial amounts of crystalloid to maintain adequate mean arterial pressure (2C) and the avoidance of hetastarch formulations (1B); initial fluid challenge in patients with sepsis-induced tissue hypoperfusion and suspicion of hypovolemia to achieve a minimum of 30 mL/kg of crystalloids (more rapid administration and greater amounts of fluid may be needed in some patients (1C); fluid challenge technique continued as long as hemodynamic improvement is based on either dynamic or static variables (UG); norepinephrine as the first-choice vasopressor to maintain mean arterial pressure ≥65 mmHg (1B); epinephrine when an additional agent is needed to maintain adequate blood pressure (2B); vasopressin (0.03 U/min) can be added to norepinephrine to either raise mean arterial pressure to target or to decrease norepinephrine dose but should not be used as the initial vasopressor (UG); dopamine is not recommended except in highly selected circumstances (2C); dobutamine infusion administered or added to vasopressor in the presence of (a) myocardial dysfunction as suggested by elevated cardiac filling pressures and low cardiac output, or (b) ongoing signs of hypoperfusion despite achieving adequate intravascular volume and adequate mean arterial pressure (1C); avoiding use of intravenous hydrocortisone in adult septic shock patients if adequate fluid resuscitation and vasopressor therapy are able to restore hemodynamic stability (2C); hemoglobin target of 7-9 g/dL in the absence of tissue hypoperfusion, ischemic coronary artery disease, or acute hemorrhage (1B); low tidal volume (1A) and limitation of inspiratory plateau pressure (1B) for acute respiratory distress syndrome (ARDS); application of at least a minimal amount of positive end-expiratory pressure (PEEP) in ARDS (1B); higher rather than lower level of PEEP for patients with sepsis-induced moderate or severe ARDS (2C); recruitment maneuvers in sepsis patients with severe refractory hypoxemia due to ARDS (2C); prone positioning in sepsis-induced ARDS patients with a PaO (2)/FiO (2) ratio of ≤100 mm Hg in facilities that have experience with such practices (2C); head-of-bed elevation in mechanically ventilated patients unless contraindicated (1B); a conservative fluid strategy for patients with established ARDS who do not have evidence of tissue hypoperfusion (1C); protocols for weaning and sedation (1A); minimizing use of either intermittent bolus sedation or continuous infusion sedation targeting specific titration endpoints (1B); avoidance of neuromuscular blockers if possible in the septic patient without ARDS (1C); a short course of neuromuscular blocker (no longer than 48 h) for patients with early ARDS and a PaO (2)/FI O (2) 180 mg/dL, targeting an upper blood glucose ≤180 mg/dL (1A); equivalency of continuous veno-venous hemofiltration or intermittent hemodialysis (2B); prophylaxis for deep vein thrombosis (1B); use of stress ulcer prophylaxis to prevent upper gastrointestinal bleeding in patients with bleeding risk factors (1B); oral or enteral (if necessary) feedings, as tolerated, rather than either complete fasting or provision of only intravenous glucose within the first 48 h after a diagnosis of severe sepsis/septic shock (2C); and addressing goals of care, including treatment plans and end-of-life planning (as appropriate) (1B), as early as feasible, but within 72 h of intensive care unit admission (2C). Recommendations specific to pediatric severe sepsis include: therapy with face mask oxygen, high flow nasal cannula oxygen, or nasopharyngeal continuous PEEP in the presence of respiratory distress and hypoxemia (2C), use of physical examination therapeutic endpoints such as capillary refill (2C); for septic shock associated with hypovolemia, the use of crystalloids or albumin to deliver a bolus of 20 mL/kg of crystalloids (or albumin equivalent) over 5-10 min (2C); more common use of inotropes and vasodilators for low cardiac output septic shock associated with elevated systemic vascular resistance (2C); and use of hydrocortisone only in children with suspected or proven "absolute"' adrenal insufficiency (2C). CONCLUSIONS: Strong agreement existed among a large cohort of international experts regarding many level 1 recommendations for the best care of patients with severe sepsis. Although a significant number of aspects of care have relatively weak support, evidence-based recommendations regarding the acute management of sepsis and septic shock are the foundation of improved outcomes for this important group of critically ill patients

    Reducing the environmental impact of surgery on a global scale: systematic review and co-prioritization with healthcare workers in 132 countries

    Get PDF
    Abstract Background Healthcare cannot achieve net-zero carbon without addressing operating theatres. The aim of this study was to prioritize feasible interventions to reduce the environmental impact of operating theatres. Methods This study adopted a four-phase Delphi consensus co-prioritization methodology. In phase 1, a systematic review of published interventions and global consultation of perioperative healthcare professionals were used to longlist interventions. In phase 2, iterative thematic analysis consolidated comparable interventions into a shortlist. In phase 3, the shortlist was co-prioritized based on patient and clinician views on acceptability, feasibility, and safety. In phase 4, ranked lists of interventions were presented by their relevance to high-income countries and low–middle-income countries. Results In phase 1, 43 interventions were identified, which had low uptake in practice according to 3042 professionals globally. In phase 2, a shortlist of 15 intervention domains was generated. In phase 3, interventions were deemed acceptable for more than 90 per cent of patients except for reducing general anaesthesia (84 per cent) and re-sterilization of ‘single-use’ consumables (86 per cent). In phase 4, the top three shortlisted interventions for high-income countries were: introducing recycling; reducing use of anaesthetic gases; and appropriate clinical waste processing. In phase 4, the top three shortlisted interventions for low–middle-income countries were: introducing reusable surgical devices; reducing use of consumables; and reducing the use of general anaesthesia. Conclusion This is a step toward environmentally sustainable operating environments with actionable interventions applicable to both high– and low–middle–income countries

    Using e-wallet for business process development: challenges and prospects in Malaysia

    No full text
    Purpose – This study aims to explore the challenges and prospects of using e-wallets in Malaysia, and what it means for businesses and customers. Suggested here are strategies to leverage the strengths and opportunities as well as overcome the weaknesses and threats. Suggested here are strategies to leverage the strengths and opportunities as well as overcome the weaknesses and threats. Design/methodology/approach – This study analyses the e-wallet phenomenon using a SWOT (Strengths, Weaknesses, Opportunities and Threats) analysis to assess Malaysian business development. It is supported with findings from the literature and secondary data. The relevant secondary data were collected from Bank Negara Malaysia and the World Bank. Findings – This study shows that e-wallets in Malaysia have still not achieved their purpose but there is huge potential to do so. The SWOT analysis identified several strengths (e.g. financial incorporation, easy to access, protection and safety, simple for other accounts to connect to, product and consumer service management, quick to implement/administer), weaknesses (e.g. lack of infrastructure and the “tapping” of devices already cornered by the mobile phone market, opportunities (e.g. eliminating fraud, better customer service, promotion/ loyalty that can be built into customer experience) and threats (e.g. attacks from viruses, frequent inquiries whether multiple wallets can be used by clients, the concerns of reckless spending behaviour of the e-wallet users). Research limitations/implications – This study is crucial for assessing the current situation and the prospects of e-wallets in Malaysia. This study also offers significant insights for policymakers and e-wallet service providers to develop appropriate strategies to enhance e-wallet services in Malaysia. Originality/value –This paper is the first of its kind to integrate a SWOT analysis and the rapid development of the e-wallet market in Malaysia. Hence, the findings could broaden our knowledge on the fintech industry and enable firms to participate in the e-wallet market
    corecore