Mastering the game of Go without human knowledge

A long-standing goal of artificial intelligence is an algorithm that learns, tabula rasa, superhuman proficiency in challenging domains. Recently, AlphaGo became the first program to defeat a world champion in the game of Go. The tree search in AlphaGo evaluated positions and selected moves using deep neural networks. These neural networks were trained by supervised learning from human expert moves, and by reinforcement learning from self-play. Here we introduce an algorithm based solely on reinforcement learning, without human data, guidance or domain knowledge beyond game rules. AlphaGo becomes its own teacher: a neural network is trained to predict AlphaGo’s own move selections and also the winner of AlphaGo’s games. This neural network improves the strength of the tree search, resulting in higher quality move selection and stronger self-play in the next iteration. Starting tabula rasa, our new program AlphaGo Zero achieved superhuman performance, winning 100–0 against the previously published, champion-defeating AlphaGo

Automated analysis of retinal imaging using machine learning techniques for computer vision

There are almost two million people in the United Kingdom living with sight loss, including around 360,000 people who are registered as blind or partially sighted. Sight threatening diseases, such as diabetic retinopathy and age related macular degeneration have contributed to the 40% increase in outpatient attendances in the last decade but are amenable to early detection and monitoring. With early and appropriate intervention, blindness may be prevented in many cases. Ophthalmic imaging provides a way to diagnose and objectively assess the progression of a number of pathologies including neovascular (“wet”) age-related macular degeneration (wet AMD) and diabetic retinopathy. Two methods of imaging are commonly used: digital photographs of the fundus (the ‘back’ of the eye) and Optical Coherence Tomography (OCT, a modality that uses light waves in a similar way to how ultrasound uses sound waves). Changes in population demographics and expectations and the changing pattern of chronic diseases creates a rising demand for such imaging. Meanwhile, interrogation of such images is time consuming, costly, and prone to human error. The application of novel analysis methods may provide a solution to these challenges. This research will focus on applying novel machine learning algorithms to automatic analysis of both digital fundus photographs and OCT in Moorfields Eye Hospital NHS Foundation Trust patients. Through analysis of the images used in ophthalmology, along with relevant clinical and demographic information, Google DeepMind Health will investigate the feasibility of automated grading of digital fundus photographs and OCT and provide novel quantitative measures for specific disease features and for monitoring the therapeutic success

Water waves generated by a moving bottom

Tsunamis are often generated by a moving sea bottom. This paper deals with the case where the tsunami source is an earthquake. The linearized water-wave equations are solved analytically for various sea bottom motions. Numerical results based on the analytical solutions are shown for the free-surface profiles, the horizontal and vertical velocities as well as the bottom pressure.Comment: 41 pages, 13 figures. Accepted for publication in a book: "Tsunami and Nonlinear Waves", Kundu, Anjan (Editor), Springer 2007, Approx. 325 p., 170 illus., Hardcover, ISBN: 978-3-540-71255-8, available: May 200

Dynamics of multi-stage infections on networks

This paper investigates the dynamics of infectious diseases with a nonexponentially distributed infectious period. This is achieved by considering a multistage infection model on networks. Using pairwise approximation with a standard closure, a number of important characteristics of disease dynamics are derived analytically, including the final size of an epidemic and a threshold for epidemic outbreaks, and it is shown how these quantities depend on disease characteristics, as well as the number of disease stages. Stochastic simulations of dynamics on networks are performed and compared to output of pairwise models for several realistic examples of infectious diseases to illustrate the role played by the number of stages in the disease dynamics. These results show that a higher number of disease stages results in faster epidemic outbreaks with a higher peak prevalence and a larger final size of the epidemic. The agreement between the pairwise and simulation models is excellent in the cases we consider

Convergence of asymptotic systems of non-autonomous neural network models with infinite distributed delays

In this paper we investigate the global convergence of solutions of non-autonomous Hopfield neural network models with discrete time-varying delays, infinite distributed delays, and possible unbounded coefficient functions. Instead of using Lyapunov functionals, we explore intrinsic features between the non-autonomous systems and their asymptotic systems to ensure the boundedness and global convergence of the solutions of the studied models. Our results are new and complement known results in the literature. The theoretical analysis is illustrated with some examples and numerical simulations.The paper was supported by the Research Centre of Mathematics of the University of Minho with the Portuguese Funds from the "Fundacao para a Ciencia e a Tecnologia", through the Project PEstOE/MAT/UI0013/2014. The author thanks the referee for valuable comments.info:eu-repo/semantics/publishedVersio

Community-Based Measures for Mitigating the 2009 H1N1 Pandemic in China

Since the emergence of influenza A/H1N1 pandemic virus in March–April 2009, very stringent interventions including Fengxiao were implemented to prevent importation of infected cases and decelerate the disease spread in mainland China. The extent to which these measures have been effective remains elusive. We sought to investigate the effectiveness of Fengxiao that may inform policy decisions on improving community-based interventions for management of on-going outbreaks in China, in particular during the Spring Festival in mid-February 2010 when nationwide traveling will be substantially increased. We obtained data on initial laboratory-confirmed cases of H1N1 in the province of Shaanxi and used Markov-chain Monte-Carlo (MCMC) simulations to estimate the reproduction number. Given the estimates for the exposed and infectious periods of the novel H1N1 virus, we estimated a mean reproduction number of 1.68 (95% CI 1.45–1.92) and other A/H1N1 epidemiological parameters. Our results based on a spatially stratified population dynamical model show that the early implementation of Fengxiao can delay the epidemic peak significantly and prevent the disease spread to the general population but may also, if not implemented appropriately, cause more severe outbreak within universities/colleges, while late implementation of Fengxiao can achieve nothing more than no implementation. Strengthening local control strategies (quarantine and hygiene precaution) is much more effective in mitigating outbreaks and inhibiting the successive waves than implementing Fengxiao. Either strong mobility or high transport-related transmission rate during the Spring Festival holiday will not reverse the ongoing outbreak, but both will result in a large new wave. The findings suggest that Fengxiao and travel precautions should not be relaxed unless strict measures of quarantine, isolation, and hygiene precaution practices are put in place. Integration and prompt implementation of these interventions can significantly reduce the overall attack rate of pandemic outbreaks

Age groups and spread of influenza: implications for vaccination strategy

<p>Abstract</p> <p>Background</p> <p>The unpredictable nature of the potentially devastating impact of 2009 pH1N1 influenza pandemic highlights the need for pandemic preparedness planning, where modeling studies could be most useful for simulations of possible future scenarios.</p> <p>Methods</p> <p>A compartmental model with pre-symptomatic and asymptomatic influenza infections is proposed which incorporates age groups as well as intervention measures such as age-specific vaccination, in order to study spread of influenza in a community.</p> <p>Results</p> <p>We derive the basic reproduction number and other effective reproduction numbers under various intervention measures. For illustration, we make use of the Pneumonia and Influenza (P&I) mortality data and vaccination data of the very young (age 0-2) and the very old (age >64) during 2004-2005 Taiwan winter influenza season to fit our model and to compute the relevant reproduction numbers. The reproduction number for this winter flu season is estimated to be slightly above one (~1.0001).</p> <p>Conclusions</p> <p>Comparatively large errors in fitting the P&I mortality data of the elderly (>64) were observed shortly after winter school closings in January, which may indicate the impact of younger, more active age groups transmitting influenza to other age groups outside of the school settings; in particular, to the elderly in the households. Pre-symptomatic infections seemed to have little effect on the model fit, while asymptomatic infection by asymptomatic infectives has a more pronounced impact on the model fit for the elderly mortality, perhaps indicating a larger role in disease transmission by asymptomatic infection. Simulations indicate that the impact of vaccination on the disease incidence might not be fully revealed in the change (or the lack thereof) in the effective reproduction number with interventions, but could still be substantial. The estimated per contact transmission probability for susceptible elderly is significantly higher than that of any other age group, perhaps highlighting the vulnerability of the elderly due to close contacts with their caretakers from other age groups. The relative impact of targeting the very young and the very old for vaccination was weakened by their relative inactivity, thus giving evidence of the lack of impact of vaccinating these two groups on the overall transmissibility of the disease in the community. This further underscores the need for morbidity-based strategy to prevent elderly mortality.</p

The spatial resolution of epidemic peaks

The emergence of novel respiratory pathogens can challenge the capacity of key health care resources, such as intensive care units, that are constrained to serve only specific geographical populations. An ability to predict the magnitude and timing of peak incidence at the scale of a single large population would help to accurately assess the value of interventions designed to reduce that peak. However, current disease-dynamic theory does not provide a clear understanding of the relationship between: epidemic trajectories at the scale of interest (e.g. city); population mobility; and higher resolution spatial effects (e.g. transmission within small neighbourhoods). Here, we used a spatially-explicit stochastic meta-population model of arbitrary spatial resolution to determine the effect of resolution on model-derived epidemic trajectories. We simulated an influenza-like pathogen spreading across theoretical and actual population densities and varied our assumptions about mobility using Latin-Hypercube sampling. Even though, by design, cumulative attack rates were the same for all resolutions and mobilities, peak incidences were different. Clear thresholds existed for all tested populations, such that models with resolutions lower than the threshold substantially overestimated population-wide peak incidence. The effect of resolution was most important in populations which were of lower density and lower mobility. With the expectation of accurate spatial incidence datasets in the near future, our objective was to provide a framework for how to use these data correctly in a spatial meta-population model. Our results suggest that there is a fundamental spatial resolution for any pathogen-population pair. If underlying interactions between pathogens and spatially heterogeneous populations are represented at this resolution or higher, accurate predictions of peak incidence for city-scale epidemics are feasible

Analysis of Rabies in China: Transmission Dynamics and Control

Human rabies is one of the major public-health problems in China. The number of human rabies cases has increased dramatically in the last 15 years, partially due to the poor understanding of the transmission dynamics of rabies and the lack of effective control measures of the disease. In this article, in order to explore effective control and prevention measures we propose a deterministic model to study the transmission dynamics of rabies in China. The model consists of susceptible, exposed, infectious, and recovered subpopulations of both dogs and humans and describes the spread of rabies among dogs and from infectious dogs to humans. The model simulations agree with the human rabies data reported by the Chinese Ministry of Health. We estimate that the basic reproduction number for the rabies transmission in China and predict that the number of the human rabies is decreasing but may reach another peak around 2030. We also perform some sensitivity analysis of in terms of the model parameters and compare the effects of culling and immunization of dogs. Our study demonstrates that (i) reducing dog birth rate and increasing dog immunization coverage rate are the most effective methods for controlling rabies in China; and (ii) large scale culling of susceptible dogs can be replaced by immunization of them