Decentralized control of Markovian decision processes: Existence Sigma-admissable policies

The problem of formulating and analyzing Markov decision models having decentralized information and decision patterns is examined. Included are basic examples as well as the mathematical preliminaries needed to understand Markov decision models and, further, to superimpose decentralized decision structures on them. The notion of a variance admissible policy for the model is introduced and it is proved that there exist (possibly nondeterministic) optional policies from the class of variance admissible policies. Directions for further research are explored

Mortality in Parkinson's disease : A systematic review and meta-analysis

© 2014 International Parkinson and Movement Disorder Society.Peer reviewedPublisher PD

Accreditation of The Hydrographic Surveying Course at UCL and The PLA

In September 1999, the Department of Geomatic Engineering at University College London (UCL) introduced a new MSc in Hydrographic Surveying, in partnership with the Port of London Authority (PLA). In May 2001 this degree programme was approved by the courses board of the International Hydrographic Organisation and the International Federation of Surveyors as a Category A course. The aim of this article is to explain the background to the partnership between UCL and the PLA, and to describe how the course has been designed to meet the IHO/FIG criteria

Electrocardiographic repolarization-related variables as predictors of coronary heart disease death in the women's health initiative study.

BackgroundWe evaluated 25 repolarization-related ECG variables for the risk of coronary heart disease (CHD) death in 52 994 postmenopausal women from the Women's Health Initiative study.Methods and resultsHazard ratios from Cox regression were computed for subgroups of women with and without cardiovascular disease (CVD). During the average follow-up of 16.9 years, 941 CHD deaths occurred. Based on electrophysiological considerations, 2 sets of ECG variables with low correlations were considered as candidates for independent predictors of CHD death: Set 1, Ѳ(Tp|Tref), the spatial angle between T peak (Tp) and normal T reference (Tref) vectors; Ѳ(Tinit|Tterm), the angle between the initial and terminal T vectors; STJ depression in V6 and rate-adjusted QTp interval (QTpa); and Set 2, TaVR and TV1 amplitudes, heart rate, and QRS duration. Strong independent predictors with over 2-fold increased risk for CHD death in women with and without CVD were Ѳ(Tp|Tref) >42° from Set 1 and TaVR amplitude >-100 μV from Set 2. The risk for these CHD death predictors remained significant after multivariable adjustment for demographic/clinical factors. Other significant predictors for CHD death in fully adjusted risk models were Ѳ(Tinit|Tterm) >30°, TV1 >175 μV, and QRS duration >100 ms.ConclusionsѲ(Tp|Tref) angle and TaVR amplitude are associated with CHD mortality in postmenopausal women. The use of these measures to identify high-risk women for further diagnostic evaluation or more intense preventive intervention warrants further study.Clinical trial registration urlhttp://www.clinicaltrials.gov. Unique identifier: NCT00000611

Intrauterine exposure to mild analgesics during pregnancy and the occurrence of cryptorchidism and hypospadia in the offspring: The Generation R Study

This article is available open access through the publisher’s website. Copyright @ 2012 The Authors.BACKGROUND - Recently, over-the-counter mild analgesic use during pregnancy has been suggested to influence the risk of reproductive disorders in the offspring. We examined the influence of maternal exposure to mild analgesics during pregnancy on the occurrence of cryptorchidism and hypospadia in their offspring. METHODS - Associations between maternal exposure to mild analgesics during pregnancy and cryptorchidism or hypospadia in the offspring were studied in 3184 women participating in a large population-based prospective birth cohort study from early pregnancy onwards in the Netherlands (2002–2006), the Generation R Study. Cryptorchidism and hypospadia were identified during routine screening assessments performed in child health care centres by trained physicians. The use of mild analgesics was assessed in three prenatal questionnaires in pregnancy, resulting in four periods of use, namely, periconception period, first 14 weeks of gestation, 14–22 weeks of gestation and 20–32 weeks of gestation. Logistic regression analyses were used to study the associations between maternal exposure to mild analgesics and cryptorchidism and hypospadia. RESULTS - The cumulative prevalence over 30 months of follow up was 2.1% for cryptorchidism and 0.7% for hypospadia. Use of mild analgesics in the second period of pregnancy (14–22 weeks) increased the risk of congenital cryptorchidism [adjusted odds ratio (OR) 2.12; 95% confidence interval (CI) 1.17–3.83], primarily due to the use of acetaminophen (paracetamol) (adjusted OR 1.89; 95% CI 1.01–3.51). Among mothers of cryptorchid sons, 33.8% reported (23 of 68) the use of mild analgesics during pregnancy, compared with 31.8% (7 of 22) of mothers with a boy with hypospadia and 29.9% (926 of 3094) of mothers with healthy boys. CONCLUSIONS - Our results suggest that intrauterine exposure to mild analgesics, primarily paracetamol, during the period in pregnancy when male sexual differentiation takes place, increases the risk of cryptorchidism.Erasmus University Rotterdam, School of Law and Faculty of Social Sciences, the Municipal Health Service Rotterdam area, Rotterdam, the Rotterdam Homecare Foundation, Rotterdam and the Stichting Trombosedienst & Artsenlaboratorium Rijnmond (STAR), Rotterdam

Generative Invertible Networks (GIN): Pathophysiology-Interpretable Feature Mapping and Virtual Patient Generation

Machine learning methods play increasingly important roles in pre-procedural planning for complex surgeries and interventions. Very often, however, researchers find the historical records of emerging surgical techniques, such as the transcatheter aortic valve replacement (TAVR), are highly scarce in quantity. In this paper, we address this challenge by proposing novel generative invertible networks (GIN) to select features and generate high-quality virtual patients that may potentially serve as an additional data source for machine learning. Combining a convolutional neural network (CNN) and generative adversarial networks (GAN), GIN discovers the pathophysiologic meaning of the feature space. Moreover, a test of predicting the surgical outcome directly using the selected features results in a high accuracy of 81.55%, which suggests little pathophysiologic information has been lost while conducting the feature selection. This demonstrates GIN can generate virtual patients not only visually authentic but also pathophysiologically interpretable

Re-interpreting conventional interval estimates taking into account bias and extra-variation

BACKGROUND: The study design with the smallest bias for causal inference is a perfect randomized clinical trial. Since this design is often not feasible in epidemiologic studies, an important challenge is to model bias properly and take random and systematic variation properly into account. A value for a target parameter might be said to be "incompatible" with the data (under the model used) if the parameter's confidence interval excludes it. However, this "incompatibility" may be due to bias and/or extra-variation. DISCUSSION: We propose the following way of re-interpreting conventional results. Given a specified focal value for a target parameter (typically the null value, but possibly a non-null value like that representing a twofold risk), the difference between the focal value and the nearest boundary of the confidence interval for the parameter is calculated. This represents the maximum correction of the interval boundary, for bias and extra-variation, that would still leave the focal value outside the interval, so that the focal value remained "incompatible" with the data. We describe a short example application concerning a meta analysis of air versus pure oxygen resuscitation treatment in newborn infants. Some general guidelines are provided for how to assess the probability that the appropriate correction for a particular study would be greater than this maximum (e.g. using knowledge of the general effects of bias and extra-variation from published bias-adjusted results). SUMMARY: Although this approach does not yet provide a method, because the latter probability can not be objectively assessed, this paper aims to stimulate the re-interpretation of conventional confidence intervals, and more and better studies of the effects of different biases

The various power decays of the survival probability at long times for free quantum particle

The long time behaviour of the survival probability of initial state and its dependence on the initial states are considered, for the one dimensional free quantum particle. We derive the asymptotic expansion of the time evolution operator at long times, in terms of the integral operators. This enables us to obtain the asymptotic formula for the survival probability of the initial state $\psi (x)$, which is assumed to decrease sufficiently rapidly at large $|x|$. We then show that the behaviour of the survival probability at long times is determined by that of the initial state $\psi$ at zero momentum $k=0$. Indeed, it is proved that the survival probability can exhibit the various power-decays like $t^{-2m-1}$ for an arbitrary non-negative integers $m$ as $t \to \infty$, corresponding to the initial states with the condition $\hat{\psi} (k) = O(k^m)$ as $k\to 0$.Comment: 15 pages, to appear in J. Phys.

Nonexponential decay of an unstable quantum system: Small-QQ-value s-wave decay

We study the decay process of an unstable quantum system, especially the deviation from the exponential decay law. We show that the exponential period no longer exists in the case of the s-wave decay with small $Q$ value, where the $Q$ value is the difference between the energy of the initially prepared state and the minimum energy of the continuous eigenstates in the system. We also derive the quantitative condition that this kind of decay process takes place and discuss what kind of system is suitable to observe the decay.Comment: 17 pages, 6 figure