13,811 research outputs found
Comparative performance of some popular ANN algorithms on benchmark and function approximation problems
We report an inter-comparison of some popular algorithms within the
artificial neural network domain (viz., Local search algorithms, global search
algorithms, higher order algorithms and the hybrid algorithms) by applying them
to the standard benchmarking problems like the IRIS data, XOR/N-Bit parity and
Two Spiral. Apart from giving a brief description of these algorithms, the
results obtained for the above benchmark problems are presented in the paper.
The results suggest that while Levenberg-Marquardt algorithm yields the lowest
RMS error for the N-bit Parity and the Two Spiral problems, Higher Order
Neurons algorithm gives the best results for the IRIS data problem. The best
results for the XOR problem are obtained with the Neuro Fuzzy algorithm. The
above algorithms were also applied for solving several regression problems such
as cos(x) and a few special functions like the Gamma function, the
complimentary Error function and the upper tail cumulative
-distribution function. The results of these regression problems
indicate that, among all the ANN algorithms used in the present study,
Levenberg-Marquardt algorithm yields the best results. Keeping in view the
highly non-linear behaviour and the wide dynamic range of these functions, it
is suggested that these functions can be also considered as standard benchmark
problems for function approximation using artificial neural networks.Comment: 18 pages 5 figures. Accepted in Pramana- Journal of Physic
Robust learning with implicit residual networks
In this effort, we propose a new deep architecture utilizing residual blocks
inspired by implicit discretization schemes. As opposed to the standard
feed-forward networks, the outputs of the proposed implicit residual blocks are
defined as the fixed points of the appropriately chosen nonlinear
transformations. We show that this choice leads to the improved stability of
both forward and backward propagations, has a favorable impact on the
generalization power and allows to control the robustness of the network with
only a few hyperparameters. In addition, the proposed reformulation of ResNet
does not introduce new parameters and can potentially lead to a reduction in
the number of required layers due to improved forward stability. Finally, we
derive the memory-efficient training algorithm, propose a stochastic
regularization technique and provide numerical results in support of our
findings
Chemical and biological reactions of solidification of peat using ordinary portland cement (OPC) and coal ashes
Construction over peat area have often posed a challenge to geotechnical engineers.
After decades of study on peat stabilisation techniques, there are still no absolute
formulation or guideline that have been established to handle this issue. Some
researchers have proposed solidification of peat but a few researchers have also
discovered that solidified peat seemed to decrease its strength after a certain period of
time. Therefore, understanding the chemical and biological reaction behind the peat
solidification is vital to understand the limitation of this treatment technique. In this
study, all three types of peat; fabric, hemic and sapric were mixed using Mixing 1 and
Mixing 2 formulation which consisted of ordinary Portland cement, fly ash and bottom
ash at various ratio. The mixtures of peat-binder-filler were subjected to the
unconfined compressive strength (UCS) test, bacterial count test and chemical
elemental analysis by using XRF, XRD, FTIR and EDS. Two pattern of strength over
curing period were observed. Mixing 1 samples showed a steadily increase in strength
over curing period until Day 56 while Mixing 2 showed a decrease in strength pattern
at Day 28 and Day 56. Samples which increase in strength steadily have less bacterial
count and enzymatic activity with increase quantity of crystallites. Samples with lower
strength recorded increase in bacterial count and enzymatic activity with less
crystallites. Analysis using XRD showed that pargasite
(NaCa2[Mg4Al](Si6Al2)O22(OH)2) was formed in the higher strength samples while in
the lower strength samples, pargasite was predicted to be converted into monosodium
phosphate and Mg(OH)2 as bacterial consortium was re-activated. The Michaelis�Menten coefficient, Km of the bio-chemical reaction in solidified peat was calculated
as 303.60. This showed that reaction which happened during solidification work was
inefficient. The kinetics for crystallite formation with enzymatic effect is modelled as
135.42 (1/[S] + 0.44605) which means, when pargasite formed is lower, the amount
of enzyme secretes is higher
- …