35,096 research outputs found
Partitioned integrators for thermodynamic parameterization of neural networks
Traditionally, neural networks are parameterized using optimization
procedures such as stochastic gradient descent, RMSProp and ADAM. These
procedures tend to drive the parameters of the network toward a local minimum.
In this article, we employ alternative "sampling" algorithms (referred to here
as "thermodynamic parameterization methods") which rely on discretized
stochastic differential equations for a defined target distribution on
parameter space. We show that the thermodynamic perspective already improves
neural network training. Moreover, by partitioning the parameters based on
natural layer structure we obtain schemes with very rapid convergence for data
sets with complicated loss landscapes.
We describe easy-to-implement hybrid partitioned numerical algorithms, based
on discretized stochastic differential equations, which are adapted to
feed-forward neural networks, including a multi-layer Langevin algorithm,
AdLaLa (combining the adaptive Langevin and Langevin algorithms) and LOL
(combining Langevin and Overdamped Langevin); we examine the convergence of
these methods using numerical studies and compare their performance among
themselves and in relation to standard alternatives such as stochastic gradient
descent and ADAM. We present evidence that thermodynamic parameterization
methods can be (i) faster, (ii) more accurate, and (iii) more robust than
standard algorithms used within machine learning frameworks
Multivariate time series analysis for short-term forecasting of ground level ozone (O3) in Malaysia
The declining of air quality mostly affects the elderly, children, people with asthma,
as well as a restriction on outdoor activities. Therefore, there is an importance to
provide a statistical modelling to forecast the future values of surface layer ozone (O3)
concentration. The objectives of this study are to obtain the best multivariate time
series (MTS) model and develop an online air quality forecasting system for O3
concentration in Malaysia. The implementations of MTS model improve the recent
statistical model on air quality for short-term prediction. Ten air quality monitoring
stations situated at four (4) different types of location were selected in this study. The
first type is industrial represent by Pasir Gudang, Perai, and Nilai, second type is urban
represent by Kuala Terengganu, Kota Bharu, and Alor Setar. The third is suburban
located in Banting, Kangar, and Tanjung Malim, also the only background station at
Jerantut. The hourly record data from 2010 to 2017 were used to assess the
characteristics and behaviour of O3 concentration. Meanwhile, the monthly record data
of O3, particulate matter (PM10), nitrogen dioxide (NO2), sulphur dioxide (SO2),
carbon monoxide (CO), temperature (T), wind speed (WS), and relative humidity (RH)
were used to examine the best MTS models. Three methods of MTS namely vector
autoregressive (VAR), vector moving average (VMA), and vector autoregressive
moving average (VARMA), has been applied in this study. Based on the performance
error, the most appropriate MTS model located in Pasir Gudang, Kota Bharu and
Kangar is VAR(1), Kuala Terengganu and Alor Setar for VAR(2), Perai and Nilai for
VAR(3), Tanjung Malim for VAR(4) and Banting for VAR(5). Only Jerantut obtained
the VMA(2) as the best model. The lowest root mean square error (RMSE) and
normalized absolute error is 0.0053 and <0.0001 which is for MTS model in Perai and
Kuala Terengganu, respectively. Meanwhile, for mean absolute error (MAE), the
lowest is in Banting and Jerantut at 0.0013. The online air quality forecasting system
for O3 was successfully developed based on the best MTS models to represent each
monitoring station
Mechanical properties of the concrete containing porcelain waste as sand
The demand of concrete have been increases on a daily bases which consume a lot of natural resource such as sand and gravel, there is an immediate need for finding suitable alternative which can be used to replace sand partially with another materials with high propor-tion . Ceramic waste is one of the strongest research areas that include the activity of replacement in all the sides of construction materi-als. This research aims to improve the performance of concrete using ceramic waste, and demonstrate the performance of mechanical properties to the concrete with partial replacement of sand by using waste porcelain. For these, we analyzed the mechanical properties of the concrete such as compressive strength, split tensile and flexural strength, the specimen were measured based on 10% ,20% ,30% ,40%, and 50% weight ratio of replace sand with waste porcelain at different time under water for 7 days , 28 days , 60 days . The optimum consideration were given to mechanical properties of the concrete, at different amount of ceramic waste as sand
Medical imaging analysis with artificial neural networks
Given that neural networks have been widely reported in the research community of medical imaging, we provide a focused literature survey on recent neural network developments in computer-aided diagnosis, medical image segmentation and edge detection towards visual content analysis, and medical image registration for its pre-processing and post-processing, with the aims of increasing awareness of how neural networks can be applied to these areas and to provide a foundation for further research and practical development. Representative techniques and algorithms are explained in detail to provide inspiring examples illustrating: (i) how a known neural network with fixed structure and training procedure could be applied to resolve a medical imaging problem; (ii) how medical images could be analysed, processed, and characterised by neural networks; and (iii) how neural networks could be expanded further to resolve problems relevant to medical imaging. In the concluding section, a highlight of comparisons among many neural network applications is included to provide a global view on computational intelligence with neural networks in medical imaging
Causative factors of construction and demolition waste generation in Iraq Construction Industry
The construction industry has hurt the environment from the waste generated during
construction activities. Thus, it calls for serious measures to determine the causative
factors of construction waste generated. There are limited studies on factors causing
construction, and demolition (C&D) waste generation, and these limited studies only
focused on the quantification of construction waste. This study took the opportunity to
identify the causative factors for the C&D waste generation and also to determine the
risk level of each causal factor, and the most important minimization methods to
avoiding generating waste. This study was carried out based on the quantitative
approach. A total of 39 factors that causes construction waste generation that has been
identified from the literature review were considered which were then clustered into 4
groups. Improved questionnaire surveys by 38 construction experts (consultants,
contractors and clients) during the pilot study. The actual survey was conducted with
a total of 380 questionnaires, received with a response rate of 83.3%. Data analysis
was performed using SPSS software. Ranking analysis using the mean score approach
found the five most significant causative factors which are poor site management, poor
planning, lack of experience, rework and poor controlling. The result also indicated
that the majority of the identified factors having a high-risk level, in addition, the better
minimization method is environmental awareness. A structural model was developed
based on the 4 groups of causative factors using the Partial Least Squared-Structural
Equation Modelling (PLS-SEM) technique. It was found that the model fits due to the
goodness of fit (GOF ≥ 0.36= 0.658, substantial). Based on the outcome of this study,
39 factors were relevant to the generation of construction and demolition waste in Iraq.
These groups of factors should be avoided during construction works to reduce the
waste generated. The findings of this study are helpful to authorities and stakeholders
in formulating laws and regulations. Furthermore, it provides opportunities for future
researchers to conduct additional research’s on the factors that contribute to
construction waste generation
Training a Feed-forward Neural Network with Artificial Bee Colony Based Backpropagation Method
Back-propagation algorithm is one of the most widely used and popular
techniques to optimize the feed forward neural network training. Nature
inspired meta-heuristic algorithms also provide derivative-free solution to
optimize complex problem. Artificial bee colony algorithm is a nature inspired
meta-heuristic algorithm, mimicking the foraging or food source searching
behaviour of bees in a bee colony and this algorithm is implemented in several
applications for an improved optimized outcome. The proposed method in this
paper includes an improved artificial bee colony algorithm based
back-propagation neural network training method for fast and improved
convergence rate of the hybrid neural network learning method. The result is
analysed with the genetic algorithm based back-propagation method, and it is
another hybridized procedure of its kind. Analysis is performed over standard
data sets, reflecting the light of efficiency of proposed method in terms of
convergence speed and rate.Comment: 14 Pages, 11 figure
- …