Contractive De-noising Auto-encoder

Auto-encoder is a special kind of neural network based on reconstruction. De-noising auto-encoder (DAE) is an improved auto-encoder which is robust to the input by corrupting the original data first and then reconstructing the original input by minimizing the reconstruction error function. And contractive auto-encoder (CAE) is another kind of improved auto-encoder to learn robust feature by introducing the Frobenius norm of the Jacobean matrix of the learned feature with respect to the original input. In this paper, we combine de-noising auto-encoder and contractive auto- encoder, and propose another improved auto-encoder, contractive de-noising auto- encoder (CDAE), which is robust to both the original input and the learned feature. We stack CDAE to extract more abstract features and apply SVM for classification. The experiment result on benchmark dataset MNIST shows that our proposed CDAE performed better than both DAE and CAE, proving the effective of our method.Comment: Figures edite

Energy-based temporal neural networks for imputing missing values

Imputing missing values in high dimensional time series is a difficult problem. There have been some approaches to the problem [11,8] where neural architectures were trained as probabilistic models of the data. However, we argue that this approach is not optimal. We propose to view temporal neural networks with latent variables as energy-based models and train them for missing value recovery directly. In this paper we introduce two energy-based models. The first model is based on a one dimensional convolution and the second model utilizes a recurrent neural network. We demonstrate how ideas from the energy-based learning framework can be used to train these models to recover missing values. The models are evaluated on a motion capture dataset

The H.E.S.S. View of the Central 200 Parsecs

The inner few hundred parsecs of our galaxy provide a laboratory for the study of the production and propagation of energetic particles. Very-high-energy gamma-rays provide an effective probe of these processes and, especially when combined with data from other wave-bands, gamma-rays observations are a powerful diagnostic tool. Within this central region, data from the H.E.S.S. instrument have revealed three discrete sources of very-high-energy gamma-rays and diffuse emission correlated with the distribution of molecular material. Here I provide an overview of these recent results from H.E.S.S.Comment: Proceedings of the Galactic Centre Workshop 200

Low-cost representation for restricted Boltzmann machines

This paper presents a method for extracting a low-cost representation from restricted Boltzmann machines. The new representation can be considered as a compression of the network, requiring much less storage capacity while reasonably preserving the network's performance at feature learning. We show that the compression can be done by converting the weight matrix of real numbers into a matrix of three values {-1, 0, 1} associated with a score vector of real numbers. This set of values is similar enough to Boolean values which help us further translate the representation into logical rules. In the experiments reported in this paper, we evaluate the performance of our compression method on image datasets, obtaining promising results. Experiments on the MNIST handwritten digit classification dataset, for example, have shown that a 95% saving in memory can be achieved with no significant drop in accuracy

The relationship of marine stratus to synoptic conditions

The marine stratus which persistently covered most of the eastern Pacific Ocean, had large clear areas during the FIRE Intensive Field Operations (IFO) in 1987. Clear zones formed inside the large oceanic cloud mass on almost every day during the IFO. The location and size of the clear zones varied from day to day implying that they were related to dynamic weather conditions and not to oceanic conditions. Forecasting of cloud cover for aircraft operations during the IFO was directed towards predicting when and where the clear and broken zones would form inside the large marine stratus cloud mass. The clear zones often formed to the northwest of the operations area and moved towards it. However, on some days the clear zones appeared to form during the day in the operations area as part of the diurnal cloud burn off. The movement of the clear zones from day to day were hard to follow because of the large diurnal changes in cloud cover. Clear and broken cloud zones formed during the day only to distort in shape and fill during the following night. The field forecasters exhibited some skill in predicting when the clear and broken cloud patterns would form in the operations area. They based their predictions on the analysis and simulations of the models run by NOAA's Numeric Meteorological Center. How the atmospheric conditions analyzed by one NOAA/NMC model related to the cloud cover is discussed

VConv-DAE: Deep Volumetric Shape Learning Without Object Labels

With the advent of affordable depth sensors, 3D capture becomes more and more ubiquitous and already has made its way into commercial products. Yet, capturing the geometry or complete shapes of everyday objects using scanning devices (e.g. Kinect) still comes with several challenges that result in noise or even incomplete shapes. Recent success in deep learning has shown how to learn complex shape distributions in a data-driven way from large scale 3D CAD Model collections and to utilize them for 3D processing on volumetric representations and thereby circumventing problems of topology and tessellation. Prior work has shown encouraging results on problems ranging from shape completion to recognition. We provide an analysis of such approaches and discover that training as well as the resulting representation are strongly and unnecessarily tied to the notion of object labels. Thus, we propose a full convolutional volumetric auto encoder that learns volumetric representation from noisy data by estimating the voxel occupancy grids. The proposed method outperforms prior work on challenging tasks like denoising and shape completion. We also show that the obtained deep embedding gives competitive performance when used for classification and promising results for shape interpolation

Protocol for a mixed-methods exploratory investigation of care following intensive care discharge: the REFLECT study

© Author(s) 2019. Re-use permitted under CC BY. Published by BMJ.INTRODUCTION: A substantial number of patients discharged from intensive care units (ICUs) subsequently die without leaving hospital. It is unclear how many of these deaths are preventable. Ward-based management following discharge from ICU is an area that patients and healthcare staff are concerned about. The primary aim of REFLECT (Recovery Following Intensive Care Treatment) is to develop an intervention plan to reduce in-hospital mortality rates in patients who have been discharged from ICU. METHODS AND ANALYSIS: REFLECT is a multicentre mixed-methods exploratory study examining ward care delivery to adult patients discharged from ICU. The study will be made up of four substudies. Medical notes of patients who were discharged from ICU and subsequently died will be examined using a retrospective case records review (RCRR) technique. Patients and their relatives will be interviewed about their post-ICU care, including relatives of patients who died in hospital following ICU discharge. Staff involved in the care of patients post-ICU discharge will be interviewed about the care of this patient group. The medical records of patients who survived their post-ICU stay will also be reviewed using the RCRR technique. The analyses of the substudies will be both descriptive and use a modified grounded theory approach to identify emerging themes. The evidence generated in these four substudies will form the basis of the intervention development, which will take place through stakeholder and clinical expert meetings. ETHICS AND DISSEMINATION: Ethical approval has been obtained through the Wales Research and Ethics Committee 4 (17/WA/0107). We aim to disseminate the findings through international conferences, international peer-reviewed journals and social media. TRIAL REGISTRATION NUMBER: ISRCTN14658054.Peer reviewedFinal Published versio