Distributed Training Large-Scale Deep Architectures

Scale of data and scale of computation infrastructures together enable the current deep learning renaissance. However, training large-scale deep architectures demands both algorithmic improvement and careful system configuration. In this paper, we focus on employing the system approach to speed up large-scale training. Via lessons learned from our routine benchmarking effort, we first identify bottlenecks and overheads that hinter data parallelism. We then devise guidelines that help practitioners to configure an effective system and fine-tune parameters to achieve desired speedup. Specifically, we develop a procedure for setting minibatch size and choosing computation algorithms. We also derive lemmas for determining the quantity of key components such as the number of GPUs and parameter servers. Experiments and examples show that these guidelines help effectively speed up large-scale deep learning training

Measuring progress from 1990 to 2017 and projecting attainment to 2030 of the health-related Sustainable Development Goals for 195 countries and territories: a systematic analysis for the Global Burden of Disease Study 2017

Background: Efforts to establish the 2015 baseline and monitor early implementation of the UN Sustainable Development Goals (SDGs) highlight both great potential for and threats to improving health by 2030. To fully deliver on the SDG aim of “leaving no one behind”, it is increasingly important to examine the health-related SDGs beyond national-level estimates. As part of the Global Burden of Diseases, Injuries, and Risk Factors Study 2017 (GBD 2017), we measured progress on 41 of 52 health-related SDG indicators and estimated the health-related SDG index for 195 countries and territories for the period 1990–2017, projected indicators to 2030, and analysed global attainment. Methods: We measured progress on 41 health-related SDG indicators from 1990 to 2017, an increase of four indicators since GBD 2016 (new indicators were health worker density, sexual violence by non-intimate partners, population census status, and prevalence of physical and sexual violence [reported separately]). We also improved the measurement of several previously reported indicators. We constructed national-level estimates and, for a subset of health-related SDGs, examined indicator-level differences by sex and Socio-demographic Index (SDI) quintile. We also did subnational assessments of performance for selected countries. To construct the health-related SDG index, we transformed the value for each indicator on a scale of 0–100, with 0 as the 2\ub75th percentile and 100 as the 97\ub75th percentile of 1000 draws calculated from 1990 to 2030, and took the geometric mean of the scaled indicators by target. To generate projections through 2030, we used a forecasting framework that drew estimates from the broader GBD study and used weighted averages of indicator-specific and country-specific annualised rates of change from 1990 to 2017 to inform future estimates. We assessed attainment of indicators with defined targets in two ways: first, using mean values projected for 2030, and then using the probability of attainment in 2030 calculated from 1000 draws. We also did a global attainment analysis of the feasibility of attaining SDG targets on the basis of past trends. Using 2015 global averages of indicators with defined SDG targets, we calculated the global annualised rates of change required from 2015 to 2030 to meet these targets, and then identified in what percentiles the required global annualised rates of change fell in the distribution of country-level rates of change from 1990 to 2015. We took the mean of these global percentile values across indicators and applied the past rate of change at this mean global percentile to all health-related SDG indicators, irrespective of target definition, to estimate the equivalent 2030 global average value and percentage change from 2015 to 2030 for each indicator. Findings: The global median health-related SDG index in 2017 was 59\ub74 (IQR 35\ub74–67\ub73), ranging from a low of 11\ub76 (95% uncertainty interval 9\ub76–14\ub70) to a high of 84\ub79 (83\ub71–86\ub77). SDG index values in countries assessed at the subnational level varied substantially, particularly in China and India, although scores in Japan and the UK were more homogeneous. Indicators also varied by SDI quintile and sex, with males having worse outcomes than females for non-communicable disease (NCD) mortality, alcohol use, and smoking, among others. Most countries were projected to have a higher health-related SDG index in 2030 than in 2017, while country-level probabilities of attainment by 2030 varied widely by indicator. Under-5 mortality, neonatal mortality, maternal mortality ratio, and malaria indicators had the most countries with at least 95% probability of target attainment. Other indicators, including NCD mortality and suicide mortality, had no countries projected to meet corresponding SDG targets on the basis of projected mean values for 2030 but showed some probability of attainment by 2030. For some indicators, including child malnutrition, several infectious diseases, and most violence measures, the annualised rates of change required to meet SDG targets far exceeded the pace of progress achieved by any country in the recent past. We found that applying the mean global annualised rate of change to indicators without defined targets would equate to about 19% and 22% reductions in global smoking and alcohol consumption, respectively; a 47% decline in adolescent birth rates; and a more than 85% increase in health worker density per 1000 population by 2030. Interpretation: The GBD study offers a unique, robust platform for monitoring the health-related SDGs across demographic and geographic dimensions. Our findings underscore the importance of increased collection and analysis of disaggregated data and highlight where more deliberate design or targeting of interventions could accelerate progress in attaining the SDGs. Current projections show that many health-related SDG indicators, NCDs, NCD-related risks, and violence-related indicators will require a concerted shift away from what might have driven past gains—curative interventions in the case of NCDs—towards multisectoral, prevention-oriented policy action and investments to achieve SDG aims. Notably, several targets, if they are to be met by 2030, demand a pace of progress that no country has achieved in the recent past. The future is fundamentally uncertain, and no model can fully predict what breakthroughs or events might alter the course of the SDGs. What is clear is that our actions—or inaction—today will ultimately dictate how close the world, collectively, can get to leaving no one behind by 2030

Measuring progress from 1990 to 2017 and projecting attainment to 2030 of the health-related Sustainable Development Goals for 195 countries and territories: a systematic analysis for the Global Burden of Disease Study 2017.

BACKGROUND: Efforts to establish the 2015 baseline and monitor early implementation of the UN Sustainable Development Goals (SDGs) highlight both great potential for and threats to improving health by 2030. To fully deliver on the SDG aim of 'leaving no one behind', it is increasingly important to examine the health-related SDGs beyond national-level estimates. As part of the Global Burden of Diseases, Injuries, and Risk Factors Study 2017 (GBD 2017), we measured progress on 41 of 52 health-related SDG indicators and estimated the health-related SDG index for 195 countries and territories for the period 1990-2017, projected indicators to 2030, and analysed global attainment. METHODS: We measured progress on 41 health-related SDG indicators from 1990 to 2017, an increase of four indicators since GBD 2016 (new indicators were health worker density, sexual violence by non-intimate partners, population census status, and prevalence of physical and sexual violence [reported separately]). We also improved the measurement of several previously reported indicators. We constructed national-level estimates and, for a subset of health-related SDGs, examined indicator-level differences by sex and Socio-demographic Index (SDI) quintile. We also did subnational assessments of performance for selected countries. To construct the health-related SDG index, we transformed the value for each indicator on a scale of 0-100, with 0 as the 2·5th percentile and 100 as the 97·5th percentile of 1000 draws calculated from 1990 to 2030, and took the geometric mean of the scaled indicators by target. To generate projections through 2030, we used a forecasting framework that drew estimates from the broader GBD study and used weighted averages of indicator-specific and country-specific annualised rates of change from 1990 to 2017 to inform future estimates. We assessed attainment of indicators with defined targets in two ways: first, using mean values projected for 2030, and then using the probability of attainment in 2030 calculated from 1000 draws. We also did a global attainment analysis of the feasibility of attaining SDG targets on the basis of past trends. Using 2015 global averages of indicators with defined SDG targets, we calculated the global annualised rates of change required from 2015 to 2030 to meet these targets, and then identified in what percentiles the required global annualised rates of change fell in the distribution of country-level rates of change from 1990 to 2015. We took the mean of these global percentile values across indicators and applied the past rate of change at this mean global percentile to all health-related SDG indicators, irrespective of target definition, to estimate the equivalent 2030 global average value and percentage change from 2015 to 2030 for each indicator

Global, regional, and national age-sex-specific mortality and life expectancy, 1950–2017: a systematic analysis for the Global Burden of Disease Study 2017

© 2018 The Author(s). Background: Assessments of age-specifc mortality and life expectancy have been done by the UN Population Division, Department of Economics and Social Afairs (UNPOP), the United States Census Bureau, WHO, and as part of previous iterations of the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD). Previous iterations of the GBD used population estimates from UNPOP, which were not derived in a way that was internally consistent with the estimates of the numbers of deaths in the GBD. The present iteration of the GBD, GBD 2017, improves on previous assessments and provides timely estimates of the mortality experience of populations globally. Methods: The GBD uses all available data to produce estimates of mortality rates between 1950 and 2017 for 23 age groups, both sexes, and 918 locations, including 195 countries and territories and subnational locations for 16 countries. Data used include vital registration systems, sample registration systems, household surveys (complete birth histories, summary birth histories, sibling histories), censuses (summary birth histories, household deaths), and Demographic Surveillance Sites. In total, this analysis used 8259 data sources. Estimates of the probability of death between birth and the age of 5 years and between ages 15 and 60 years are generated and then input into a model life table system to produce complete life tables for all locations and years. Fatal discontinuities and mortality due to HIV/AIDS are analysed separately and then incorporated into the estimation. We analyse the relationship between age-specifc mortality and development status using the Socio-demographic Index, a composite measure based on fertility under the age of 25 years, education, and income. There are four main methodological improvements in GBD 2017 compared with GBD 2016: 622 additional data sources have been incorporated; new estimates of population, generated by the GBD study, are used; statistical methods used in diferent components of the analysis have been further standardised and improved; and the analysis has been extended backwards in time by two decades to start in 1950. Findings: Globally, 18·7% (95% uncertainty interval 18·4-19·0) of deaths were registered in 1950 and that proportion has been steadily increasing since, with 58·8% (58·2-59·3) of all deaths being registered in 2015. At the global level, between 1950 and 2017, life expectancy increased from 48·1 years (46·5-49·6) to 70·5 years (70·1-70·8) for men and from 52·9 years (51·7-54·0) to 75·6 years (75·3-75·9) for women. Despite this overall progress, there remains substantial variation in life expectancy at birth in 2017, which ranges from 49·1 years (46·5-51·7) for men in the Central African Republic to 87·6 years (86·9-88·1) among women in Singapore. The greatest progress across age groups was for children younger than 5 years; under-5 mortality dropped from 216·0 deaths (196·3-238·1) per 1000 livebirths in 1950 to 38·9 deaths (35·6-42·83) per 1000 livebirths in 2017, with huge reductions across countries. Nevertheless, there were still 5·4 million (5·2-5·6) deaths among children younger than 5 years in the world in 2017. Progress has been less pronounced and more variable for adults, especially for adult males, who had stagnant or increasing mortality rates in several countries. The gap between male and female life expectancy between 1950 and 2017, while relatively stable at the global level, shows distinctive patterns across super-regions and has consistently been the largest in central Europe, eastern Europe, and central Asia, and smallest in south Asia. Performance was also variable across countries and time in observed mortality rates compared with those expected on the basis of development. Interpretation: This analysis of age-sex-specifc mortality shows that there are remarkably complex patterns in population mortality across countries. The fndings of this study highlight global successes, such as the large decline in under-5 mortality, which refects signifcant local, national, and global commitment and investment over several decades. However, they also bring attention to mortality patterns that are a cause for concern, particularly among adult men and, to a lesser extent, women, whose mortality rates have stagnated in many countries over the time period of this study, and in some cases are increasing

Boundary-energy sensitive visual de-blocking for H.264/AVC coder

Finding out the better parameter set (OffsetA and OffsetB) for conducting the de-blocking process of H.264/AVC, is capable of improving visual quality, said eliminating the resultant blocking artifact. Identifying which edges belong to blocking regions relies on the perceptual judging process of human beings. In fact, this subjective assessment may not exactly match existing objective assessing measurements, and the meaning of high PSNR does not always stand for less blocking artifacts. In this paper, we first introduce a new criterion for measuring the block boundary distortion by comparing the source video and the reconstructed video prior to the deblocking process. By jointly optimizing the objective picture quality and the blocky energy, the deblocking parameters decision process can find out a good balance between signal matching and blocky elimination, and therefore, maximize the effect of the built-in deblocking process. In our experiments, the proposed method can efficiently pick a better deblocking parameter set from all 169 possibilities for each coded frame and result in a better visual quality. Figure 1: The block diagram of hybrid video coder, H.264/AVC. The loop filter is an additional new tool as compared with other previous coding standards. 1

Vitrectomy with or without internal limiting membrane peeling for idiopathic epiretinal membrane: A meta-analysis

<div><p>Background</p><p>Studies on vitrectomy with and without internal limiting membrane (ILM) peeling for idiopathic epiretinal membrane (ERM) have yielded uncertain results regarding clinical outcomes and recurrence rates.</p><p>Objective</p><p>To compare the clinical outcomes of vitrectomy with and without ILM peeling for idiopathic ERM.</p><p>Methods</p><p>Databases, including PubMed, Embase, Cochrane, Web of Science, Google Scholar, CNKI databases, FDA.gov, and ClinicalTrials.gov, published until July 2016, were searched to identify studies comparing the clinical outcomes following vitrectomy with ERM and ILM peeling and with only ERM peeling, for treating idiopathic ERM. Studies with sufficient data were selected. Pooled results were expressed as mean differences (MDs) and risk ratios (RRs) with corresponding 95% confidence intervals (CI) for vitrectomy with and without ILM peeling with regard to postoperative best corrected visual acuity (BCVA), central retinal thickness (CRT), and ERM recurrence rate.</p><p>Results</p><p>Eleven retrospective studies and one randomized controlled trial involving 756 eyes were identified. This demonstrated that the postoperative BCVA within 12 months was significantly better in the non-ILM peeling group (MD = 0.04, 95% CI: 0.00 to 0.08; <i>P</i> = 0.0460), but that the patients in the ILM peeling group had significantly better postoperative BCVA after 18 months (MD = −0.13, 95% CI: −0.23 to −0.04; <i>P</i> = 0.0049) than did those in the non-ILM peeling group. The non-ILM peeling group exhibited a higher reduction in postoperative CRT (MD = 51.55, 95% CI:−84.23 to −18.88; <i>P</i> = 0.0020) and a higher recurrence rate of ERM (RR = 0.34, 95% CI:0.16 to 0.72; <i>P</i> = 0.0048) than did the ILM peeling group. However, the improvement rates of BCVA (RR = 1.03, 95% CI:0.72 to 1.47; <i>P</i> = 0.8802) and postoperative CRTs (MD = 18.15, 95% CI:−2.29 to 38.60; <i>P</i> = 0.0818) were similar between the two groups.</p><p>Conclusions</p><p>Vitrectomy with ILM peeling results in better visual improvement in long-term follow-ups and lower ERM recurrence rates, and vitrectomy with only ERM peeling is more efficacious in reduction of CRT than is vitrectomy with ILM peeling.</p></div

Tumorigenesis and Neoplastic Progression NOLC1, an Enhancer of Nasopharyngeal Carcinoma Progression, Is Essential for TP53 to Regulate MDM2 Expression

Nasopharyngeal carcinoma (NPC) is one of the most common cancers among Chinese living in South China , Singapore , and Taiwan. At present , its etiological factors are not well defined. To identify which genetic alterations might be involved in NPC pathogenesis , we identified genes that were differentially expressed in NPC cell lines and normal nasomucosal cells using subtractive hybridization and microarray analysis. Most NPC cell lines and biopsy specimens were found to have higher expression levels of the gene encoding nucleolar and coiled-body phosphoprotein 1 (NOLC1) as compared with normal cells. Severe combined immunodeficiency mice bearing NPC xenografts derived from NOLC1-short hairpin-RNA-transfected animals were found to have 82% lower levels of tumor growth than control mice as well as marked tumor cell apoptosis. Measuring the expression levels of genes related to cell growth, apoptosis , and angiogenesis , we found that the MDM2 gene was down-regulated in the transfectants. Both co-transfection and chromatin immunoprecipitation experiments showed that tumor protein 53-regulated expression of the MDM2 gene requires co-activation of NOLC1. These findings suggest that NOLC1 plays a role in the regulation of tumorigenesis of NPC and demonstrate that both NOLC1 and tumor protein 53 work together synergistically to activate the MDM2 promoter i