Deep Policy Dynamic Programming for Vehicle Routing Problems

Routing problems are a class of combinatorial problems with many practical applications. Recently, end-to-end deep learning methods have been proposed to learn approximate solution heuristics for such problems. In contrast, classical dynamic programming (DP) algorithms guarantee optimal solutions, but scale badly with the problem size. We propose Deep Policy Dynamic Programming (DPDP), which aims to combine the strengths of learned neural heuristics with those of DP algorithms. DPDP prioritizes and restricts the DP state space using a policy derived from a deep neural network, which is trained to predict edges from example solutions. We evaluate our framework on the travelling salesman problem (TSP), the vehicle routing problem (VRP) and TSP with time windows (TSPTW) and show that the neural policy improves the performance of (restricted) DP algorithms, making them competitive to strong alternatives such as LKH, while also outperforming most other 'neural approaches' for solving TSPs, VRPs and TSPTWs with 100 nodes.Comment: 21 page

The effect of ozone exposure on the release of eicosanoids in guinea-pig BAL fluid in relation to cellular damage and inflammation

The observed effects after ozone exposure strongly depend on ozone concentration and exposure time. We hypothesized that depending on the O3 exposure protocol, mainly either an oxidant damage or an inflammation will determine the O3 toxicity. We compared two different ozone exposure protocols: an acute exposure (3 ppm 2 h) for studying the oxidant damage and an exposure (1 ppm 12 h) where an inflammatory component is also probably involved. We measured LDH activity and protein and albumin exudation as markers for cellular damage. After the acute exposure an increase in LDH activity was measured and after exposure to 1 ppm ozone for 12 h the exudation of protein and albumin was also enhanced. The histological examinations showed a neutrophilic inflammatory response only after exposure to 1 ppm ozone for 12 h. The acute exposure protocol resulted in an increased release of PGE2, PGD2, PGF2α and 6-ketoPGF1α whereas exposure to 1 ppm ozone for 12 h led to an additional release of LTB4. No effects were measured on the release of TxB2 and LTC4/D4/E4. These changed amounts of eicosanoids will probably contribute to the ozone-induced lung function changes

Policy search with high-dimensional context variables

Direct contextual policy search methods learn to improve policy parameters and simultaneously generalize these parameters to different context or task variables. However, learning from high-dimensional context variables, such as camera images, is still a prominent problem in many real-world tasks. A naive application of unsupervised dimensionality reduction methods to the context variables, such as principal component analysis, is insufficient as task-relevant input may be ignored. In this paper, we propose a contextual policy search method in the model-based relative entropy stochastic search framework with integrated dimensionality reduction. We learn a model of the reward that is locally quadratic in both the policy parameters and the context variables. Furthermore, we perform supervised linear dimensionality reduction on the context variables by nuclear norm regularization. The experimental results show that the proposed method outperforms naive dimensionality reduction via principal component analysis and a state-of-the-art contextual policy search method

Picture your nursing home: Exploring the sense of home of older residents through photography

The quality of the built environment can impact the quality of life and the sense of home of nursing home residents. This study investigated (1) which factors in the physical and social environment correlate with the sense of home of the residents and (2) which environmental factors are most meaningful. Twelve participants engaged in a qualitative study, in which photography was as a supportive tool for subsequent interviews. The data were analysed based on the six phases by Braun and Clarke. The four themes identified are (1) the physical view; (2) mobility and accessibility; (3) space, place, and personal belongings; and (4) the social environment and activities. A holistic understanding of which features of the built environment are appreciated by the residents can lead to the design and retrofitting of nursing homes that are more in line with personal wishes

OH-selected AGB and post-AGB objects I.Infrared and maser properties

Using 766 compact objects from a survey of the galactic Plane in the 1612-MHz OH line, new light is cast on the infrared properties of evolved stars on the TP-AGB and beyond. The usual mid-infrared selection criteria, based on IRAS colours, largely fail to distinguish early post-AGB stages. A two-colour diagram from narrower-band MSX flux densities, with bimodal distributions, provides a better tool to do the latter. Four mutually consistent selection criteria for OH-masing red PPNe are given, as well as two for early post-AGB masers and one for all post--AGB masers, including the earliest ones. All these criteria miss a group of blue, high-outflow post-AGB sources with 60-mum excess; these will be discussed in detail in Paper II. The majority of post-AGB sources show regular double-peaked spectra in the OH 1612-MHz line, with fairly low outflow velocities, although the fractions of single peaks and irregular spectra may vary with age and mass. The OH flux density shows a fairly regular relation with the stellar flux and the envelope optical depth, with the maser efficiency increasing with IRAS colour R21. The OH flux density is linearly correlated with the 60-mum flux density.Comment: 16 pages, LaTex, 22 figures, AJ (accepted

The Importance of Personal Possessions for the Development of a Sense of Home of Nursing Home Residents

Personal possessions of nursing home residents can contribute to their sense of home. This study investigated which of the personal belongings were considered most important, and if these items indeed contributed to a sense of home. A qualitative research was conducted with 27 nursing home residents. Photographs, paintings, and pieces of furniture are objects with sentimental value. The television set is valued for its practical function. Residents of larger rooms have more flexibility in bringing along personal items, including pieces of furniture. The results of this study can be used for the design of nursing homes or for making informed choices during the process of institutionalization

Herschel imaging of the dust in the Helix Nebula (NGC 7293)

In our series of papers presenting the Herschel imaging of evolved planetary nebulae, we present images of the dust distribution in the Helix nebula (NGC 7293). Images at 70, 160, 250, 350, and 500 micron were obtained with the PACS and SPIRE instruments on board the Herschel satellite. The broadband maps show the dust distribution over the main Helix nebula to be clumpy and predominantly present in the barrel wall. We determined the spectral energy distribution of the main nebula in a consistent way using Herschel, IRAS, and Planck flux values. The emissivity index of 0.99 +/- 0.09, in combination with the carbon rich molecular chemistry of the nebula, indicates that the dust consists mainly of amorphous carbon. The dust excess emission from the central star disk is detected at 70 micron and the flux measurement agree with previous measurement. We present the temperature and dust column density maps. The total dust mass across the Helix nebula (without its halo) is determined to be 0.0035 solar mass at a distance of 216 pc. The temperature map shows dust temperatures between 22 and 42 K, which is similar to the kinetic temperature of the molecular gas, strengthening the fact that the dust and gas co-exist in high density clumps. Archived images are used to compare the location of the dust emission in the far infrared (Herschel) with the ionized (GALEX, Hbeta) and molecular hydrogen component. The different emission components are consistent with the Helix consisting of a thick walled barrel-like structure inclined to the line of sight. The radiation field decreases rapidly through the barrel wall.Comment: 8 pages, 9 figures, revised version A&A in pres

H2O Maser Observations of Candidate Post-AGB Stars and Discovery of Three High-velocity Water Sources

We present the results of 22 GHz H_2O maser observations of a sample of 85 post-Asymptotic Giant Branch (post-AGB) candidate stars, selected on the basis of their OH 1612 MHz maser and far-infrared properties. All sources were observed with the Tidbinbilla 70-m radio telescope and 21 detections were made. 86 GHz SiO Mopra observations of a subset of the sample are also presented. Of the 21 H_2O detections, 15 are from sources that are likely to be massive AGB stars and most of these show typical, regular H_2O maser profiles. In contrast, nearly all the detections of more evolved stars exhibited high-velocity H_2O maser emission. Of the five sources seen, v223 (W43A, IRAS 18450-0148) is a well known `water-fountain' source which belongs to a small group of post-AGB stars with highly collimated, high-velocity H_2O maser emission. A second source in our sample, v270 (IRAS 18596+0315), is also known to have high-velocity emission. We report the discovery of similar emission from a further three sources, d46 (IRAS 15445-5449), d62 (IRAS 15544-5332) and b292 (IRAS 18043-2116). The source d46 is an evolved post-AGB star with highly unusual maser properties. The H_2O maser emission from d62 is probably associated with a massive star. The source b292 is a young post-AGB star that is highly likely to be a water-fountain source, with masers detected over a velocity range of 210 km s^{-1}.Comment: 47 pages, 9 figures, 4 tables, accepted by Ap