Real-Time Stereo Vision for Road Surface 3-D Reconstruction

Stereo vision techniques have been widely used in civil engineering to acquire 3-D road data. The two important factors of stereo vision are accuracy and speed. However, it is very challenging to achieve both of them simultaneously and therefore the main aim of developing a stereo vision system is to improve the trade-off between these two factors. In this paper, we present a real-time stereo vision system used for road surface 3-D reconstruction. The proposed system is developed from our previously published 3-D reconstruction algorithm where the perspective view of the target image is first transformed into the reference view, which not only increases the disparity accuracy but also improves the processing speed. Then, the correlation cost between each pair of blocks is computed and stored in two 3-D cost volumes. To adaptively aggregate the matching costs from neighbourhood systems, bilateral filtering is performed on the cost volumes. This greatly reduces the ambiguities during stereo matching and further improves the precision of the estimated disparities. Finally, the subpixel resolution is achieved by conducting a parabola interpolation and the subpixel disparity map is used to reconstruct the 3-D road surface. The proposed algorithm is implemented on an NVIDIA GTX 1080 GPU for the real-time purpose. The experimental results illustrate that the reconstruction accuracy is around 3 mm.Comment: 6 pages, 4 figures, IEEE International Conference on Imaging System and Techniques (IST) 2018. arXiv admin note: substantial text overlap with arXiv:1807.0204

High SNR full brain relaxometry at 7T by accelerated MR-STAT

Purpose: To demonstrate the feasibility and robustness of the Magnetic Resonance Spin TomogrAphy in Time-domain (MR-STAT) framework for fast, high SNR relaxometry at 7T. Methods: To deploy MR-STAT on 7T-systems, we designed optimized flip-angles using the BLAKJac-framework that incorporates the SAR-constraints. Transmit RF-inhomogeneities were mitigated by including a measured (Formula presented.) -map in the reconstruction. Experiments were performed on a gel-phantom and on five volunteers to explore the robustness of the sequence and its sensitivity to (Formula presented.) inhomogeneities. The SNR-gain at 7T was explored by comparing phantom and in vivo results to MR-STAT at 3T in terms of SNR-efficiency. Results: The higher SNR at 7T enabled two-fold acceleration with respect to current 2D MR-STAT protocols at lower field strengths. The resulting scan had whole-brain coverage, with 1 x 1 x 3 mm3 resolution (1.5 mm slice-gap) and was acquired within 3 min including the (Formula presented.) -mapping. After (Formula presented.) -correction, the estimated T1 and T2 in a phantom showed a mean relative error of, respectively, 1.7% and 4.4%. In vivo, the estimated T1 and T2 in gray and white matter corresponded to the range of values reported in literature with a variation over the subjects of 1.0%–2.1% (WM-GM) for T1 and 4.3%–5.3% (WM-GM) for T2. We measured a higher SNR-efficiency at 7T (R = 2) than at 3T for both T1 and T2 with, respectively, a 4.1 and 2.3 times increase in SNR-efficiency. Conclusion: We presented an accelerated version of MR-STAT tailored to high field (7T) MRI using a low-SAR flip-angle train and showed high quality parameter maps with an increased SNR-efficiency compared to MR-STAT at 3T

Segmentation and Classification of Multimodal Imagery

Segmentation and classification are two important computer vision tasks that transform input data into a compact representation that allow fast and efficient analysis. Several challenges exist in generating accurate segmentation or classification results. In a video, for example, objects often change the appearance and are partially occluded, making it difficult to delineate the object from its surroundings. This thesis proposes video segmentation and aerial image classification algorithms to address some of the problems and provide accurate results. We developed a gradient driven three-dimensional segmentation technique that partitions a video into spatiotemporal objects. The algorithm utilizes the local gradient computed at each pixel location together with the global boundary map acquired through deep learning methods to generate initial pixel groups by traversing from low to high gradient regions. A local clustering method is then employed to refine these initial pixel groups. The refined sub-volumes in the homogeneous regions of video are selected as initial seeds and iteratively combined with adjacent groups based on intensity similarities. The volume growth is terminated at the color boundaries of the video. The over-segments obtained from the above steps are then merged hierarchically by a multivariate approach yielding a final segmentation map for each frame. In addition, we also implemented a streaming version of the above algorithm that requires a lower computational memory. The results illustrate that our proposed methodology compares favorably well, on a qualitative and quantitative level, in segmentation quality and computational efficiency with the latest state of the art techniques. We also developed a convolutional neural network (CNN)-based method to efficiently combine information from multisensor remotely sensed images for pixel-wise semantic classification. The CNN features obtained from multiple spectral bands are fused at the initial layers of deep neural networks as opposed to final layers. The early fusion architecture has fewer parameters and thereby reduces the computational time and GPU memory during training and inference. We also introduce a composite architecture that fuses features throughout the network. The methods were validated on four different datasets: ISPRS Potsdam, Vaihingen, IEEE Zeebruges, and Sentinel-1, Sentinel-2 dataset. For the Sentinel-1,-2 datasets, we obtain the ground truth labels for three classes from OpenStreetMap. Results on all the images show early fusion, specifically after layer three of the network, achieves results similar to or better than a decision level fusion mechanism. The performance of the proposed architecture is also on par with the state-of-the-art results

Machine Learning with Kay

Computational power is very important when training Deep Learning (DL) models with large amounts of data (Wooldridge, 2021). Hence, High-Performance Computing (HPC) can be leveraged to reduce computational cost, and the Irish Centre for High-End Computing (ICHEC) provides significant infrastructure and services for research and development to both academia and industry. A portion of ICHEC\u27s HPC system has been allocated for institutional access, and this paper presents a case study of how to use Kay (Ireland\u27s national supercomputer) in the remote sensing domain. Specifically, this study uses clusters of Kay Graphics Processing Units (GPUs) for training DL models to extract buildings from satellite imagery using a large number of input data samples

Natural ventilation design attributes application effect on, indoor natural ventilation performance of a double storey, single unit residential building

In establishing a good indoor thermal condition, air movement is one of the important parameter to be considered to provide indoor fresh air for occupants. Due to the public awareness on environment impact, people has been increasingly attentive to passive design in achieving good condition of indoor building ventilation. Throughout case studies, significant building attributes were found giving effect on building indoor natural ventilation performance. The studies were categorized under vernacular houses, contemporary houses with vernacular element and contemporary houses. The indoor air movement of every each spaces in the houses were compared with the outdoor air movement surrounding the houses to indicate the space’s indoor natural ventilation performance. Analysis found the wind catcher element appears to be the most significant attribute to contribute most to indoor natural ventilation. Wide opening was also found to be significant especially those with louvers. Whereas it is also interesting to find indoor layout design is also significantly giving impact on the performance. The finding indicates that a good indoor natural ventilation is not only dictated by having proper openings at proper location of a building, but also on how the incoming air movement is managed throughout the interior spaces by proper layout. Understanding on the air pressure distribution caused by indoor windward and leeward side is important in directing the air flow to desired spaces in producing an overall good indoor natural ventilation performance