BERT for Long Documents: A Case Study of Automated ICD Coding

Transformer models have achieved great success across many NLP problems. However, previous studies in automated ICD coding concluded that these models fail to outperform some of the earlier solutions such as CNN-based models. In this paper we challenge this conclusion. We present a simple and scalable method to process long text with the existing transformer models such as BERT. We show that this method significantly improves the previous results reported for transformer models in ICD coding, and is able to outperform one of the prominent CNN-based methods

Framing the future for taxonomic monography: Improving recognition, support, and access

No abstract available

Influence of single and binary doping of strontium and lithium on in vivo biological properties of bioactive glass scaffolds

Effects of strontium and lithium ion doping on the biological properties of bioactive glass (BAG) porous scaffolds have been checked in vitro and in vivo. BAG scaffolds were prepared by conventional glass melting route and subsequently, scaffolds were produced by evaporation of fugitive pore formers. After thorough physico-chemical and in vitro cell characterization, scaffolds were used for pre-clinical study. Soft and hard tissue formation in a rabbit femoral defect model after 2 and 4 months, were assessed using different tools. Histological observations showed excellent osseous tissue formation in Sr and Li + Sr scaffolds and moderate bone regeneration in Li scaffolds. Fluorochrome labeling studies showed wide regions of new bone formation in Sr and Li + Sr doped samples as compared to Li doped samples. SEM revealed abundant collagenous network and minimal or no interfacial gap between bone and implant in Sr and Li + Sr doped samples compared to Li doped samples. Micro CT of Li + Sr samples showed highest degree of peripheral cancellous tissue formation on periphery and cortical tissues inside implanted samples and vascularity among four compositions. Our findings suggest that addition of Sr and/or Li alters physico-chemical properties of BAG and promotes early stage in vivo osseointegration and bone remodeling that may offer new insight in bone tissue engineering

Framing the future for taxonomic monography: Improving recognition, support, and access

Taxonomic monographs synthesize biodiversity knowledge and document biodiversity change through recent and geological time for a particular organismal group, sometimes also incorporating cultural and place-based knowledge. They are a vehicle through which broader questions about ecological and evolutionary patterns and processes can be generated and answered (e.g., Muñoz Rodríguez et al., 2019). Chiefly, monography represents the foundational research upon which all biological work is based (Hamilton et al., 2021). Moreover, monography can be a pathway to developing inclusive scientific practices, engaging diverse audiences in expanding and disseminating indigenous and local knowledge and significance of place. Apart from the scientific importance of monography, these comprehensive biodiversity treatments are also crucial for policy, conservation, human wellbeing, and the sustainable use of natural resources. Taxonomic, cultural and biodiversity data within monographs aid in the implementation of law and policy, such as the Convention on International Trade in Endangered Species of Wild Fauna and Flora (CITES), the Nagoya Protocol of the Convention on Biological Diversity (Buck & Hamilton, 2011), and the International Union for Conservation of Nature (IUCN) Red List (e.g., Neo et al., 2017). While vital as a knowledge resource and tool for conservation and research, monographs are not available for many groups of organisms. This is of particular concern for organisms that are threatened with extinction, of medical or economic importance, and those organisms that have the potential to provide insight into biodiversity change over time because they are most susceptible to global change. In discussing the future of collections-based systematics, researchers have highlighted the importance of updated monographic workflows, collaborative teams, and effective ways to educate and disseminate the results of monographs to the public and scientific community (e.g., Wen et al., 2015; Grace et al., 2021). Here, we discuss how improving recognition, support, and access can lead to greater inclusivity while promoting a more active, sustainable, and collaborative outlook for monographic research. </p

Global, regional, and national cancer incidence, mortality, years of life lost, years lived with disability, and disability-Adjusted life-years for 29 cancer groups, 1990 to 2017 : A systematic analysis for the global burden of disease study

Importance: Cancer and other noncommunicable diseases (NCDs) are now widely recognized as a threat to global development. The latest United Nations high-level meeting on NCDs reaffirmed this observation and also highlighted the slow progress in meeting the 2011 Political Declaration on the Prevention and Control of Noncommunicable Diseases and the third Sustainable Development Goal. Lack of situational analyses, priority setting, and budgeting have been identified as major obstacles in achieving these goals. All of these have in common that they require information on the local cancer epidemiology. The Global Burden of Disease (GBD) study is uniquely poised to provide these crucial data. Objective: To describe cancer burden for 29 cancer groups in 195 countries from 1990 through 2017 to provide data needed for cancer control planning. Evidence Review: We used the GBD study estimation methods to describe cancer incidence, mortality, years lived with disability, years of life lost, and disability-Adjusted life-years (DALYs). Results are presented at the national level as well as by Socio-demographic Index (SDI), a composite indicator of income, educational attainment, and total fertility rate. We also analyzed the influence of the epidemiological vs the demographic transition on cancer incidence. Findings: In 2017, there were 24.5 million incident cancer cases worldwide (16.8 million without nonmelanoma skin cancer [NMSC]) and 9.6 million cancer deaths. The majority of cancer DALYs came from years of life lost (97%), and only 3% came from years lived with disability. The odds of developing cancer were the lowest in the low SDI quintile (1 in 7) and the highest in the high SDI quintile (1 in 2) for both sexes. In 2017, the most common incident cancers in men were NMSC (4.3 million incident cases); tracheal, bronchus, and lung (TBL) cancer (1.5 million incident cases); and prostate cancer (1.3 million incident cases). The most common causes of cancer deaths and DALYs for men were TBL cancer (1.3 million deaths and 28.4 million DALYs), liver cancer (572000 deaths and 15.2 million DALYs), and stomach cancer (542000 deaths and 12.2 million DALYs). For women in 2017, the most common incident cancers were NMSC (3.3 million incident cases), breast cancer (1.9 million incident cases), and colorectal cancer (819000 incident cases). The leading causes of cancer deaths and DALYs for women were breast cancer (601000 deaths and 17.4 million DALYs), TBL cancer (596000 deaths and 12.6 million DALYs), and colorectal cancer (414000 deaths and 8.3 million DALYs). Conclusions and Relevance: The national epidemiological profiles of cancer burden in the GBD study show large heterogeneities, which are a reflection of different exposures to risk factors, economic settings, lifestyles, and access to care and screening. The GBD study can be used by policy makers and other stakeholders to develop and improve national and local cancer control in order to achieve the global targets and improve equity in cancer care. © 2019 American Medical Association. All rights reserved.Peer reviewe

Mapping local patterns of childhood overweight and wasting in low- and middle-income countries between 2000 and 2017

A double burden of malnutrition occurs when individuals, household members or communities experience both undernutrition and overweight. Here, we show geospatial estimates of overweight and wasting prevalence among children under 5 years of age in 105 low- and middle-income countries (LMICs) from 2000 to 2017 and aggregate these to policy-relevant administrative units. Wasting decreased overall across LMICs between 2000 and 2017, from 8.4% (62.3 (55.1–70.8) million) to 6.4% (58.3 (47.6–70.7) million), but is predicted to remain above the World Health Organization’s Global Nutrition Target of <5% in over half of LMICs by 2025. Prevalence of overweight increased from 5.2% (30 (22.8–38.5) million) in 2000 to 6.0% (55.5 (44.8–67.9) million) children aged under 5 years in 2017. Areas most affected by double burden of malnutrition were located in Indonesia, Thailand, southeastern China, Botswana, Cameroon and central Nigeria. Our estimates provide a new perspective to researchers, policy makers and public health agencies in their efforts to address this global childhood syndemic

The global burden of adolescent and young adult cancer in 2019 : a systematic analysis for the Global Burden of Disease Study 2019

Background In estimating the global burden of cancer, adolescents and young adults with cancer are often overlooked, despite being a distinct subgroup with unique epidemiology, clinical care needs, and societal impact. Comprehensive estimates of the global cancer burden in adolescents and young adults (aged 15-39 years) are lacking. To address this gap, we analysed results from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2019, with a focus on the outcome of disability-adjusted life-years (DALYs), to inform global cancer control measures in adolescents and young adults. Methods Using the GBD 2019 methodology, international mortality data were collected from vital registration systems, verbal autopsies, and population-based cancer registry inputs modelled with mortality-to-incidence ratios (MIRs). Incidence was computed with mortality estimates and corresponding MIRs. Prevalence estimates were calculated using modelled survival and multiplied by disability weights to obtain years lived with disability (YLDs). Years of life lost (YLLs) were calculated as age-specific cancer deaths multiplied by the standard life expectancy at the age of death. The main outcome was DALYs (the sum of YLLs and YLDs). Estimates were presented globally and by Socio-demographic Index (SDI) quintiles (countries ranked and divided into five equal SDI groups), and all estimates were presented with corresponding 95% uncertainty intervals (UIs). For this analysis, we used the age range of 15-39 years to define adolescents and young adults. Findings There were 1.19 million (95% UI 1.11-1.28) incident cancer cases and 396 000 (370 000-425 000) deaths due to cancer among people aged 15-39 years worldwide in 2019. The highest age-standardised incidence rates occurred in high SDI (59.6 [54.5-65.7] per 100 000 person-years) and high-middle SDI countries (53.2 [48.8-57.9] per 100 000 person-years), while the highest age-standardised mortality rates were in low-middle SDI (14.2 [12.9-15.6] per 100 000 person-years) and middle SDI (13.6 [12.6-14.8] per 100 000 person-years) countries. In 2019, adolescent and young adult cancers contributed 23.5 million (21.9-25.2) DALYs to the global burden of disease, of which 2.7% (1.9-3.6) came from YLDs and 97.3% (96.4-98.1) from YLLs. Cancer was the fourth leading cause of death and tenth leading cause of DALYs in adolescents and young adults globally. Interpretation Adolescent and young adult cancers contributed substantially to the overall adolescent and young adult disease burden globally in 2019. These results provide new insights into the distribution and magnitude of the adolescent and young adult cancer burden around the world. With notable differences observed across SDI settings, these estimates can inform global and country-level cancer control efforts. Copyright (C) 2021 The Author(s). Published by Elsevier Ltd.Peer reviewe

Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019

Background: In an era of shifting global agendas and expanded emphasis on non-communicable diseases and injuries along with communicable diseases, sound evidence on trends by cause at the national level is essential. The Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) provides a systematic scientific assessment of published, publicly available, and contributed data on incidence, prevalence, and mortality for a mutually exclusive and collectively exhaustive list of diseases and injuries. Methods: GBD estimates incidence, prevalence, mortality, years of life lost (YLLs), years lived with disability (YLDs), and disability-adjusted life-years (DALYs) due to 369 diseases and injuries, for two sexes, and for 204 countries and territories. Input data were extracted from censuses, household surveys, civil registration and vital statistics, disease registries, health service use, air pollution monitors, satellite imaging, disease notifications, and other sources. Cause-specific death rates and cause fractions were calculated using the Cause of Death Ensemble model and spatiotemporal Gaussian process regression. Cause-specific deaths were adjusted to match the total all-cause deaths calculated as part of the GBD population, fertility, and mortality estimates. Deaths were multiplied by standard life expectancy at each age to calculate YLLs. A Bayesian meta-regression modelling tool, DisMod-MR 2.1, was used to ensure consistency between incidence, prevalence, remission, excess mortality, and cause-specific mortality for most causes. Prevalence estimates were multiplied by disability weights for mutually exclusive sequelae of diseases and injuries to calculate YLDs. We considered results in the context of the Socio-demographic Index (SDI), a composite indicator of income per capita, years of schooling, and fertility rate in females younger than 25 years. Uncertainty intervals (UIs) were generated for every metric using the 25th and 975th ordered 1000 draw values of the posterior distribution. Findings: Global health has steadily improved over the past 30 years as measured by age-standardised DALY rates. After taking into account population growth and ageing, the absolute number of DALYs has remained stable. Since 2010, the pace of decline in global age-standardised DALY rates has accelerated in age groups younger than 50 years compared with the 1990–2010 time period, with the greatest annualised rate of decline occurring in the 0–9-year age group. Six infectious diseases were among the top ten causes of DALYs in children younger than 10 years in 2019: lower respiratory infections (ranked second), diarrhoeal diseases (third), malaria (fifth), meningitis (sixth), whooping cough (ninth), and sexually transmitted infections (which, in this age group, is fully accounted for by congenital syphilis; ranked tenth). In adolescents aged 10–24 years, three injury causes were among the top causes of DALYs: road injuries (ranked first), self-harm (third), and interpersonal violence (fifth). Five of the causes that were in the top ten for ages 10–24 years were also in the top ten in the 25–49-year age group: road injuries (ranked first), HIV/AIDS (second), low back pain (fourth), headache disorders (fifth), and depressive disorders (sixth). In 2019, ischaemic heart disease and stroke were the top-ranked causes of DALYs in both the 50–74-year and 75-years-and-older age groups. Since 1990, there has been a marked shift towards a greater proportion of burden due to YLDs from non-communicable diseases and injuries. In 2019, there were 11 countries where non-communicable disease and injury YLDs constituted more than half of all disease burden. Decreases in age-standardised DALY rates have accelerated over the past decade in countries at the lower end of the SDI range, while improvements have started to stagnate or even reverse in countries with higher SDI. Interpretation: As disability becomes an increasingly large component of disease burden and a larger component of health expenditure, greater research and developm nt investment is needed to identify new, more effective intervention strategies. With a rapidly ageing global population, the demands on health services to deal with disabling outcomes, which increase with age, will require policy makers to anticipate these changes. The mix of universal and more geographically specific influences on health reinforces the need for regular reporting on population health in detail and by underlying cause to help decision makers to identify success stories of disease control to emulate, as well as opportunities to improve. Funding: Bill & Melinda Gates Foundation. © 2020 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 licens

Population and fertility by age and sex for 195 countries and territories, 1950–2017: a systematic analysis for the Global Burden of Disease Study 2017

Background: Population estimates underpin demographic and epidemiological research and are used to track progress on numerous international indicators of health and development. To date, internationally available estimates of population and fertility, although useful, have not been produced with transparent and replicable methods and do not use standardised estimates of mortality. We present single-calendar year and single-year of age estimates of fertility and population by sex with standardised and replicable methods. Methods: We estimated population in 195 locations by single year of age and single calendar year from 1950 to 2017 with standardised and replicable methods. We based the estimates on the demographic balancing equation, with inputs of fertility, mortality, population, and migration data. Fertility data came from 7817 location-years of vital registration data, 429 surveys reporting complete birth histories, and 977 surveys and censuses reporting summary birth histories. We estimated age-specific fertility rates (ASFRs; the annual number of livebirths to women of a specified age group per 1000 women in that age group) by use of spatiotemporal Gaussian process regression and used the ASFRs to estimate total fertility rates (TFRs; the average number of children a woman would bear if she survived through the end of the reproductive age span [age 10–54 years] and experienced at each age a particular set of ASFRs observed in the year of interest). Because of sparse data, fertility at ages 10–14 years and 50–54 years was estimated from data on fertility in women aged 15–19 years and 45–49 years, through use of linear regression. Age-specific mortality data came from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2017 estimates. Data on population came from 1257 censuses and 761 population registry location-years and were adjusted for underenumeration and age misreporting with standard demographic methods. Migration was estimated with the GBD Bayesian demographic balancing model, after incorporating information about refugee migration into the model prior. Final population estimates used the cohort-component method of population projection, with inputs of fertility, mortality, and migration data. Population uncertainty was estimated by use of out-of-sample predictive validity testing. With these data, we estimated the trends in population by age and sex and in fertility by age between 1950 and 2017 in 195 countries and territories. Findings: From 1950 to 2017, TFRs decreased by 49\ub74% (95% uncertainty interval [UI] 46\ub74–52\ub70). The TFR decreased from 4\ub77 livebirths (4\ub75–4\ub79) to 2\ub74 livebirths (2\ub72–2\ub75), and the ASFR of mothers aged 10–19 years decreased from 37 livebirths (34–40) to 22 livebirths (19–24) per 1000 women. Despite reductions in the TFR, the global population has been increasing by an average of 83\ub78 million people per year since 1985. The global population increased by 197\ub72% (193\ub73–200\ub78) since 1950, from 2\ub76 billion (2\ub75–2\ub76) to 7\ub76 billion (7\ub74–7\ub79) people in 2017; much of this increase was in the proportion of the global population in south Asia and sub-Saharan Africa. The global annual rate of population growth increased between 1950 and 1964, when it peaked at 2\ub70%; this rate then remained nearly constant until 1970 and then decreased to 1\ub71% in 2017. Population growth rates in the southeast Asia, east Asia, and Oceania GBD super-region decreased from 2\ub75% in 1963 to 0\ub77% in 2017, whereas in sub-Saharan Africa, population growth rates were almost at the highest reported levels ever in 2017, when they were at 2\ub77%. The global average age increased from 26\ub76 years in 1950 to 32\ub71 years in 2017, and the proportion of the population that is of working age (age 15–64 years) increased from 59\ub79% to 65\ub73%. At the national level, the TFR decreased in all countries and territories between 1950 and 2017; in 2017, TFRs ranged from a low of 1\ub70 livebirths (95% UI 0\ub79–1\ub72) in Cyprus to a high of 7\ub71 livebirths (6\ub78–7\ub74) in Niger. The TFR under age 25 years (TFU25; number of livebirths expected by age 25 years for a hypothetical woman who survived the age group and was exposed to current ASFRs) in 2017 ranged from 0\ub708 livebirths (0\ub707–0\ub709) in South Korea to 2\ub74 livebirths (2\ub72–2\ub76) in Niger, and the TFR over age 30 years (TFO30; number of livebirths expected for a hypothetical woman ageing from 30 to 54 years who survived the age group and was exposed to current ASFRs) ranged from a low of 0\ub73 livebirths (0\ub73–0\ub74) in Puerto Rico to a high of 3\ub71 livebirths (3\ub70–3\ub72) in Niger. TFO30 was higher than TFU25 in 145 countries and territories in 2017. 33 countries had a negative population growth rate from 2010 to 2017, most of which were located in central, eastern, and western Europe, whereas population growth rates of more than 2\ub70% were seen in 33 of 46 countries in sub-Saharan Africa. In 2017, less than 65% of the national population was of working age in 12 of 34 high-income countries, and less than 50% of the national population was of working age in Mali, Chad, and Niger. Interpretation: Population trends create demographic dividends and headwinds (ie, economic benefits and detriments) that affect national economies and determine national planning needs. Although TFRs are decreasing, the global population continues to grow as mortality declines, with diverse patterns at the national level and across age groups. To our knowledge, this is the first study to provide transparent and replicable estimates of population and fertility, which can be used to inform decision making and to monitor progress. Funding: Bill &amp; Melinda Gates Foundation

Population and fertility by age and sex for 195 countries and territories, 1950–2017: a systematic analysis for the Global Burden of Disease Study 2017

Background: Population estimates underpin demographic and epidemiological research and are used to track progress on numerous international indicators of health and development. To date, internationally available estimates of population and fertility, although useful, have not been produced with transparent and replicable methods and do not use standardised estimates of mortality. We present single-calendar year and single-year of age estimates of fertility and population by sex with standardised and replicable methods. Methods: We estimated population in 195 locations by single year of age and single calendar year from 1950 to 2017 with standardised and replicable methods. We based the estimates on the demographic balancing equation, with inputs of fertility, mortality, population, and migration data. Fertility data came from 7817 location-years of vital registration data, 429 surveys reporting complete birth histories, and 977 surveys and censuses reporting summary birth histories. We estimated age-specific fertility rates (ASFRs; the annual number of livebirths to women of a specified age group per 1000 women in that age group) by use of spatiotemporal Gaussian process regression and used the ASFRs to estimate total fertility rates (TFRs; the average number of children a woman would bear if she survived through the end of the reproductive age span [age 10–54 years] and experienced at each age a particular set of ASFRs observed in the year of interest). Because of sparse data, fertility at ages 10–14 years and 50–54 years was estimated from data on fertility in women aged 15–19 years and 45–49 years, through use of linear regression. Age-specific mortality data came from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2017 estimates. Data on population came from 1257 censuses and 761 population registry location-years and were adjusted for underenumeration and age misreporting with standard demographic methods. Migration was estimated with the GBD Bayesian demographic balancing model, after incorporating information about refugee migration into the model prior. Final population estimates used the cohort-component method of population projection, with inputs of fertility, mortality, and migration data. Population uncertainty was estimated by use of out-of-sample predictive validity testing. With these data, we estimated the trends in population by age and sex and in fertility by age between 1950 and 2017 in 195 countries and territories. Findings: From 1950 to 2017, TFRs decreased by 49·4% (95% uncertainty interval [UI] 46·4–52·0). The TFR decreased from 4·7 livebirths (4·5–4·9) to 2·4 livebirths (2·2–2·5), and the ASFR of mothers aged 10–19 years decreased from 37 livebirths (34–40) to 22 livebirths (19–24) per 1000 women. Despite reductions in the TFR, the global population has been increasing by an average of 83·8 million people per year since 1985. The global population increased by 197·2% (193·3–200·8) since 1950, from 2·6 billion (2·5–2·6) to 7·6 billion (7·4–7·9) people in 2017; much of this increase was in the proportion of the global population in south Asia and sub-Saharan Africa. The global annual rate of population growth increased between 1950 and 1964, when it peaked at 2·0%; this rate then remained nearly constant until 1970 and then decreased to 1·1% in 2017. Population growth rates in the southeast Asia, east Asia, and Oceania GBD super-region decreased from 2·5% in 1963 to 0·7% in 2017, whereas in sub-Saharan Africa, population growth rates were almost at the highest reported levels ever in 2017, when they were at 2·7%. The global average age increased from 26·6 years in 1950 to 32·1 years in 2017, and the proportion of the population that is of working age (age 15–64 years) increased from 59·9% to 65·3%. At the national level, the TFR decreased in all countries and territories between 1950 and 2017; in 2017, TFRs ranged from a low of 1·0 livebirths (95% UI 0·9–1·2) in Cyprus to a high of 7·1 livebirths (6·8–7·4) in Niger. The TFR under age 25 years (TFU25; number of livebirths expected by age 25 years for a hypothetical woman who survived the age group and was exposed to current ASFRs) in 2017 ranged from 0·08 livebirths (0·07–0·09) in South Korea to 2·4 livebirths (2·2–2·6) in Niger, and the TFR over age 30 years (TFO30; number of livebirths expected for a hypothetical woman ageing from 30 to 54 years who survived the age group and was exposed to current ASFRs) ranged from a low of 0·3 livebirths (0·3–0·4) in Puerto Rico to a high of 3·1 livebirths (3·0–3·2) in Niger. TFO30 was higher than TFU25 in 145 countries and territories in 2017. 33 countries had a negative population growth rate from 2010 to 2017, most of which were located in central, eastern, and western Europe, whereas population growth rates of more than 2·0% were seen in 33 of 46 countries in sub-Saharan Africa. In 2017, less than 65% of the national population was of working age in 12 of 34 high-income countries, and less than 50% of the national population was of working age in Mali, Chad, and Niger. Interpretation: Population trends create demographic dividends and headwinds (ie, economic benefits and detriments) that affect national economies and determine national planning needs. Although TFRs are decreasing, the global population continues to grow as mortality declines, with diverse patterns at the national level and across age groups. To our knowledge, this is the first study to provide transparent and replicable estimates of population and fertility, which can be used to inform decision making and to monitor progress