46 research outputs found

    Modeling and Implementation of an Asynchronous Approach to Integrating HPC and Big Data Analysis

    Get PDF
    With the emergence of exascale computing and big data analytics, many important scientific applications require the integration of computationally intensive modeling and simulation with data-intensive analysis to accelerate scientific discovery. In this paper, we create an analytical model to steer the optimization of the end-to-end time-to-solution for the integrated computation and data analysis. We also design and develop an intelligent data broker to efficiently intertwine the computation stage and the analysis stage to practically achieve the optimal time-to-solution predicted by the analytical model. We perform experiments on both synthetic applications and real-world computational fluid dynamics (CFD) applications. The experiments show that the analytic model exhibits an average relative error of less than 10%, and the application performance can be improved by up to 131% for the synthetic programs and by up to 78% for the real-world CFD application

    Designing a Parallel Memory-Aware Lattice Boltzmann Algorithm on Manycore Systems

    Get PDF
    Lattice Boltzmann method (LBM) is an important computational fluid dynamics (CFD) approach to solving the Naiver-Stokes equations and simulating complex fluid flows. LBM is also well known as a memory bound problem and its performance is limited by the memory access time on modern computer systems. In this paper, we design and develop both sequential and parallel memory-aware algorithms to optimize the performance of LBM. The new memory-aware algorithms can enhance data reuses across multiple time steps to further improve the performance of the original and fused LBM. We theoretically analyze the algorithms to provide an insight into how data reuses occur in each algorithm. Finally, we conduct experiments and detailed performance analysis on two different manycore systems. Based on the experimental results, the parallel memory-aware LBM algorithm can outperform the fused LBM by up to 292% on the Intel Haswell system when using 28 cores, and by 302 % on the Intel Skylake system when using 48 cores

    A Hybrid Wavelet de-noising and Rank-Set Pair Analysis approach for forecasting hydro-meteorological time series

    Get PDF
    Accurate, fast forecasting of hydro-meteorological time series is presently a major challenge in drought and flood mitigation. This paper proposes a hybrid approach, wavelet de-noising (WD) and Rank-Set Pair Analysis (RSPA), that takes full advantage of a combination of the two approaches to improve forecasts of hydro-meteorological time series. WD allows decomposition and reconstruction of a time series by the wavelet transform, and hence separation of the noise from the original series. RSPA, a more reliable and efficient version of Set Pair Analysis, is integrated with WD to form the hybrid WD-RSPA approach. Two types of hydro-meteorological data sets with different characteristics and different levels of human influences at some representative stations are used to illustrate the WD-RSPA approach. The approach is also compared to three other generic methods: the conventional Auto Regressive Integrated Moving Average (ARIMA) method, Artificial Neural Networks (ANNs) (BP-error Back Propagation, MLP-Multilayer Perceptron and RBF-Radial Basis Function), and RSPA alone. Nine error metrics are used to evaluate the model performance. Compared to three other generic methods, the results generated by WD-REPA model presented invariably smaller error measures which means the forecasting capability of the WD-REPA model is better than other models. The results show that WD-RSPA is accurate, feasible, and effective. In particular, WD-RSPA is found to be the best among the various generic methods compared in this paper, even when the extreme events are included within a time series

    Transparent and conductive indium doped cadmium oxide thin films prepared by pulsed filtered cathodic arc deposition

    No full text
    Indium doped cadmium oxide (CdO:In) films with different In concentrations were prepared on low-cost glass substrates by pulsed filtered cathodic arc deposition (PFCAD). It is shown that polycrystalline CdO:In films with smooth surface and dense structure are obtained. In-doping introduces extra electrons leading to remarkable improvements of electron mobility and conductivity, as well as improvement in the optical transmittance due to the Burstein Moss effect. CdO:In films on glass substrates with thickness near 230 nm show low resistivity of 7.23 10-5 cm, high electron mobility of 142 cm2/Vs, and mean transmittance over 80percent from 500-1250 nm (including the glass substrate). These high quality pulsed arc-grown CdO:In films are potentially suitable for high efficiency multi-junction solar cells that harvest a broad range of the solar spectrum

    Dopant-induced band filling and bandgap renormalization in CdO:In films

    No full text
    corecore