Job Management Requirements for NAS Parallel Systems and Clusters

A job management system is a critical component of a production supercomputing environment, permitting oversubscribed resources to be shared fairly and effi-ciently. Job management systems that were originally designed for traditional vector supercomputers are not appropriate for the distributed-memory parallel supercomputers that are becoming increasingly important in the high performance computing industry. Newer job management systems offer new functionality but do not solve fundamental problems. We address some of the main issues in resource allocation and job scheduling we have encountered on two parallel com-puters-- a 160-node IBM SP2 and a cluster of 20 high performance workstations located at the Numerical Aerodynamic Simulation facility. We describe the requirements for resource allocation and job management that are necessary to provide a production supercomputing environment on these machines, prioritizing according to difficulty and importance, and advocating a return to fundamental issues. Supercomputer centers have historically used batch queuing systems such as NQS [Kin86] to manage oversubscribed resources and schedule computer time fairly

Computing and Data Grids for Science and Engineering

We use the term "Grid" to refer to a software system that provides uniform and location independent access to geographically and organizationally dispersed, heterogeneous resources that are persistent and supported. While, in general, Grids will provide the infrastructure to support a wide range of services in the scientific environment (e.g. collaboration and remote instrument control) in this paper we focus on services for high performance computing and data handling. We describe the services and architecture of NASA's Information Power Grid ("IPG") -- an early example of a large-scale Grid -- and some of the issues that have come up in its implementation. Keywords: Grids, distributed computing architecture, distributed resource management 1 Introduction "Grids" (see [1]) are an approach for building dynamically constructed problem solving environments using distributed and federated, high performance computing and data handling infrastructure that manages geographically and organ..

NASA's Information Power Grid: Large Scale Distributed Computing and Data Management

Large-scale science and engineering are done through the interaction of people, heterogeneous computing resources, information systems, and instruments, all of which are geographically and organizationally dispersed. The overall motivation for Grids is to facilitate the routine interactions of these resources in order to support large-scale science and engineering. Multi-disciplinary simulations provide a good example of a class of applications that are very likely to require aggregation of widely distributed computing, data, and intellectual resources. Such simulations - e.g. whole system aircraft simulation and whole system living cell simulation - require integrating applications and data that are developed by different teams of researchers frequently in different locations. The research team's are the only ones that have the expertise to maintain and improve the simulation code and/or the body of experimental data that drives the simulations. This results in an inherently distributed computing and data management environment

Global, regional, and national comparative risk assessment of 84 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016

Background The Global Burden of Diseases, Injuries, and Risk Factors Study 2016 (GBD 2016) provides a comprehensive assessment of risk factor exposure and attributable burden of disease. By providing estimates over a long time series, this study can monitor risk exposure trends critical to health surveillance and inform policy debates on the importance of addressing risks in context. Methods We used the comparative risk assessment framework developed for previous iterations of GBD to estimate levels and trends in exposure, attributable deaths, and attributable disability-adjusted life-years (DALYs), by age group, sex, year, and location for 84 behavioural, environmental and occupational, and metabolic risks or clusters of risks from 1990 to 2016. This study included 481 risk-outcome pairs that met the GBD study criteria for convincing or probable evidence of causation. We extracted relative risk (RR) and exposure estimates from 22 717 randomised controlled trials, cohorts, pooled cohorts, household surveys, census data, satellite data, and other sources, according to the GBD 2016 source counting methods. Using the counterfactual scenario of theoretical minimum risk exposure level (TMREL), we estimated the portion of deaths and DALYs that could be attributed to a given risk. Finally, we explored four drivers of trends in attributable burden: population growth, population ageing, trends in risk exposure, and all other factors combined. Findings Since 1990, exposure increased significantly for 30 risks, did not change significantly for four risks, and decreased significantly for 31 risks. Among risks that are leading causes of burden of disease, child growth failure and household air pollution showed the most significant declines, while metabolic risks, such as body-mass index and high fasting plasma glucose, showed significant increases. In 2016, at Level 3 of the hierarchy, the three leading risk factors in terms of attributable DALYs at the global level for men were smoking (124·1 million DALYs [95% UI 111·2 million to 137·0 million]), high systolic blood pressure (122·2 million DALYs [110·3 million to 133·3 million], and low birthweight and short gestation (83·0 million DALYs [78·3 million to 87·7 million]), and for women, were high systolic blood pressure (89·9 million DALYs [80·9 million to 98·2 million]), high body-mass index (64·8 million DALYs [44·4 million to 87·6 million]), and high fasting plasma glucose (63·8 million DALYs [53·2 million to 76·3 million]). In 2016 in 113 countries, the leading risk factor in terms of attributable DALYs was a metabolic risk factor. Smoking remained among the leading five risk factors for DALYs for 109 countries, while low birthweight and short gestation was the leading risk factor for DALYs in 38 countries, particularly in sub-Saharan Africa and South Asia. In terms of important drivers of change in trends of burden attributable to risk factors, between 2006 and 2016 exposure to risks explains an 9·3% (6·9–11·6) decline in deaths and a 10·8% (8·3–13·1) decrease in DALYs at the global level, while population ageing accounts for 14·9% (12·7–17·5) of deaths and 6·2% (3·9–8·7) of DALYs, and population growth for 12·4% (10·1–14·9) of deaths and 12·4% (10·1–14·9) of DALYs. The largest contribution of trends in risk exposure to disease burden is seen between ages 1 year and 4 years, where a decline of 27·3% (24·9–29·7) of the change in DALYs between 2006 and 2016 can be attributed to declines in exposure to risks. Interpretation Increasingly detailed understanding of the trends in risk exposure and the RRs for each risk-outcome pair provide insights into both the magnitude of health loss attributable to risks and how modification of risk exposure has contributed to health trends. Metabolic risks warrant particular policy attention, due to their large contribution to global disease burden, increasing trends, and variable patterns across countries at the same level of development. GBD 2016 findings show that, while it has huge potential to improve health, risk modification has played a relatively small part in the past decade. Funding The Bill & Melinda Gates Foundation, Bloomberg Philanthropies

Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990-2013: quantifying the epidemiological transition.

International audienceThe Global Burden of Disease Study 2013 (GBD 2013) aims to bring together all available epidemiological data using a coherent measurement framework, standardised estimation methods, and transparent data sources to enable comparisons of health loss over time and across causes, age-sex groups, and countries. The GBD can be used to generate summary measures such as disability-adjusted life-years (DALYs) and healthy life expectancy (HALE) that make possible comparative assessments of broad epidemiological patterns across countries and time. These summary measures can also be used to quantify the component of variation in epidemiology that is related to sociodemographic development. We used the published GBD 2013 data for age-specific mortality, years of life lost due to premature mortality (YLLs), and years lived with disability (YLDs) to calculate DALYs and HALE for 1990, 1995, 2000, 2005, 2010, and 2013 for 188 countries. We calculated HALE using the Sullivan method; 95% uncertainty intervals (UIs) represent uncertainty in age-specific death rates and YLDs per person for each country, age, sex, and year. We estimated DALYs for 306 causes for each country as the sum of YLLs and YLDs; 95% UIs represent uncertainty in YLL and YLD rates. We quantified patterns of the epidemiological transition with a composite indicator of sociodemographic status, which we constructed from income per person, average years of schooling after age 15 years, and the total fertility rate and mean age of the population. We applied hierarchical regression to DALY rates by cause across countries to decompose variance related to the sociodemographic status variable, country, and time. Worldwide, from 1990 to 2013, life expectancy at birth rose by 6·2 years (95% UI 5·6-6·6), from 65·3 years (65·0-65·6) in 1990 to 71·5 years (71·0-71·9) in 2013, HALE at birth rose by 5·4 years (4·9-5·8), from 56·9 years (54·5-59·1) to 62·3 years (59·7-64·8), total DALYs fell by 3·6% (0·3-7·4), and age-standardised DALY rates per 100 000 people fell by 26·7% (24·6-29·1). For communicable, maternal, neonatal, and nutritional disorders, global DALY numbers, crude rates, and age-standardised rates have all declined between 1990 and 2013, whereas for non-communicable diseases, global DALYs have been increasing, DALY rates have remained nearly constant, and age-standardised DALY rates declined during the same period. From 2005 to 2013, the number of DALYs increased for most specific non-communicable diseases, including cardiovascular diseases and neoplasms, in addition to dengue, food-borne trematodes, and leishmaniasis; DALYs decreased for nearly all other causes. By 2013, the five leading causes of DALYs were ischaemic heart disease, lower respiratory infections, cerebrovascular disease, low back and neck pain, and road injuries. Sociodemographic status explained more than 50% of the variance between countries and over time for diarrhoea, lower respiratory infections, and other common infectious diseases; maternal disorders; neonatal disorders; nutritional deficiencies; other communicable, maternal, neonatal, and nutritional diseases; musculoskeletal disorders; and other non-communicable diseases. However, sociodemographic status explained less than 10% of the variance in DALY rates for cardiovascular diseases; chronic respiratory diseases; cirrhosis; diabetes, urogenital, blood, and endocrine diseases; unintentional injuries; and self-harm and interpersonal violence. Predictably, increased sociodemographic status was associated with a shift in burden from YLLs to YLDs, driven by declines in YLLs and increases in YLDs from musculoskeletal disorders, neurological disorders, and mental and substance use disorders. In most country-specific estimates, the increase in life expectancy was greater than that in HALE. Leading causes of DALYs are highly variable across countries. Global health is improving. Population growth and ageing have driven up numbers of DALYs, but crude rates have remained relatively constant, showing that progress in health does not mean fewer demands on health systems. The notion of an epidemiological transition--in which increasing sociodemographic status brings structured change in disease burden--is useful, but there is tremendous variation in burden of disease that is not associated with sociodemographic status. This further underscores the need for country-specific assessments of DALYs and HALE to appropriately inform health policy decisions and attendant actions. Bill & Melinda Gates Foundation