Hierarchical Surface Prediction for 3D Object Reconstruction

Recently, Convolutional Neural Networks have shown promising results for 3D geometry prediction. They can make predictions from very little input data such as a single color image. A major limitation of such approaches is that they only predict a coarse resolution voxel grid, which does not capture the surface of the objects well. We propose a general framework, called hierarchical surface prediction (HSP), which facilitates prediction of high resolution voxel grids. The main insight is that it is sufficient to predict high resolution voxels around the predicted surfaces. The exterior and interior of the objects can be represented with coarse resolution voxels. Our approach is not dependent on a specific input type. We show results for geometry prediction from color images, depth images and shape completion from partial voxel grids. Our analysis shows that our high resolution predictions are more accurate than low resolution predictions.Comment: 3DV 201

Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis

We introduce a data-driven approach to complete partial 3D shapes through a combination of volumetric deep neural networks and 3D shape synthesis. From a partially-scanned input shape, our method first infers a low-resolution -- but complete -- output. To this end, we introduce a 3D-Encoder-Predictor Network (3D-EPN) which is composed of 3D convolutional layers. The network is trained to predict and fill in missing data, and operates on an implicit surface representation that encodes both known and unknown space. This allows us to predict global structure in unknown areas at high accuracy. We then correlate these intermediary results with 3D geometry from a shape database at test time. In a final pass, we propose a patch-based 3D shape synthesis method that imposes the 3D geometry from these retrieved shapes as constraints on the coarsely-completed mesh. This synthesis process enables us to reconstruct fine-scale detail and generate high-resolution output while respecting the global mesh structure obtained by the 3D-EPN. Although our 3D-EPN outperforms state-of-the-art completion method, the main contribution in our work lies in the combination of a data-driven shape predictor and analytic 3D shape synthesis. In our results, we show extensive evaluations on a newly-introduced shape completion benchmark for both real-world and synthetic data

Vision Science and Technology at NASA: Results of a Workshop

A broad review is given of vision science and technology within NASA. The subject is defined and its applications in both NASA and the nation at large are noted. A survey of current NASA efforts is given, noting strengths and weaknesses of the NASA program

Light Field Denoising via Anisotropic Parallax Analysis in a CNN Framework

Light field (LF) cameras provide perspective information of scenes by taking directional measurements of the focusing light rays. The raw outputs are usually dark with additive camera noise, which impedes subsequent processing and applications. We propose a novel LF denoising framework based on anisotropic parallax analysis (APA). Two convolutional neural networks are jointly designed for the task: first, the structural parallax synthesis network predicts the parallax details for the entire LF based on a set of anisotropic parallax features. These novel features can efficiently capture the high frequency perspective components of a LF from noisy observations. Second, the view-dependent detail compensation network restores non-Lambertian variation to each LF view by involving view-specific spatial energies. Extensive experiments show that the proposed APA LF denoiser provides a much better denoising performance than state-of-the-art methods in terms of visual quality and in preservation of parallax details

Simulation of site-specific irrigation control strategies with sparse input data

Crop and irrigation water use efficiencies may be improved by managing irrigation application timing and volumes using physical and agronomic principles. However, the crop water requirement may be spatially variable due to different soil properties and genetic variations in the crop across the field. Adaptive control strategies can be used to locally control water applications in response to in-field temporal and spatial variability with the aim of maximising both crop development and water use efficiency. A simulation framework ‘VARIwise’ has been created to aid the development, evaluation and management of spatially and temporally varied adaptive irrigation control strategies (McCarthy et al., 2010). VARIwise enables alternative control strategies to be simulated with different crop and environmental conditions and at a range of spatial resolutions. An iterative learning controller and model predictive controller have been implemented in VARIwise to improve the irrigation of cotton. The iterative learning control strategy involves using the soil moisture response to the previous irrigation volume to adjust the applied irrigation volume applied at the next irrigation event. For field implementation this controller has low data requirements as only soil moisture data is required after each irrigation event. In contrast, a model predictive controller has high data requirements as measured soil and plant data are required at a high spatial resolution in a field implementation. Model predictive control involves using a calibrated model to determine the irrigation application and/or timing which results in the highest predicted yield or water use efficiency. The implementation of these strategies is described and a case study is presented to demonstrate the operation of the strategies with various levels of data availability. It is concluded that in situations of sparse data, the iterative learning controller performs significantly better than a model predictive controller

Air pollution and livestock production

The air in a livestock farming environment contains high concentrations of dust particles and gaseous pollutants. The total inhalable dust can enter the nose and mouth during normal breathing and the thoracic dust can reach into the lungs. However, it is the respirable dust particles that can penetrate further into the gas-exchange region, making it the most hazardous dust component. Prolonged exposure to high concentrations of dust particles can lead to respiratory health issues for both livestock and farming staff. Ammonia, an example of a gaseous pollutant, is derived from the decomposition of nitrous compounds. Increased exposure to ammonia may also have an effect on the health of humans and livestock. There are a number of technologies available to ensure exposure to these pollutants is minimised. Through proactive means, (the optimal design and management of livestock buildings) air quality can be improved to reduce the likelihood of risks associated with sub-optimal air quality. Once air problems have taken hold, other reduction methods need to be applied utilising a more reactive approach. A key requirement for the control of concentration and exposure of airborne pollutants to an acceptable level is to be able to conduct real-time measurements of these pollutants. This paper provides a review of airborne pollution including methods to both measure and control the concentration of pollutants in livestock buildings