Backprojection for Training Feedforward Neural Networks in the Input and Feature Spaces

After the tremendous development of neural networks trained by backpropagation, it is a good time to develop other algorithms for training neural networks to gain more insights into networks. In this paper, we propose a new algorithm for training feedforward neural networks which is fairly faster than backpropagation. This method is based on projection and reconstruction where, at every layer, the projected data and reconstructed labels are forced to be similar and the weights are tuned accordingly layer by layer. The proposed algorithm can be used for both input and feature spaces, named as backprojection and kernel backprojection, respectively. This algorithm gives an insight to networks with a projection-based perspective. The experiments on synthetic datasets show the effectiveness of the proposed method.Comment: Accepted (to appear) in International Conference on Image Analysis and Recognition (ICIAR) 2020, Springe

Antipodean Theory for Educational Research

published_or_final_versio

Load-settlement modelling of axially loaded drilled shafts using CPT-based recurrent neural networks

The design of pile foundations requires good estimation of the pile load-carrying capacity and settlement. Design for bearing capacity and design for settlement have been traditionally carried out separately. However, soil resistance and settlement are influenced by each other, and the design of pile foundations should thus consider the bearing capacity and settlement inseparably. This requires the full load–settlement response of piles to be well predicted. However, it is well known that the actual load–settlement response of pile foundations can be obtained only by load tests carried out in situ, which are expensive and time-consuming. In this paper, recurrent neural networks (RNNs) were used to develop a prediction model that can resemble the full load–settlement response of drilled shafts (bored piles) subjected to axial loading. The developed RNN model was calibrated and validated using several in situ full-scale pile load tests, as well as cone penetration test (CPT) data. The results indicate that the developed RNN model has the ability to reliably predict the load–settlement response of axially loaded drilled shafts and can thus be used by geotechnical engineers for routine design practice

Identification of the molecular signatures integral to regenerating photoreceptors in the retina of the zebra fish

Investigating neuronal and photoreceptor regeneration in the retina of zebra fish has begun to yield insights into both the cellular and molecular means by which this lower vertebrate is able to repair its central nervous system. However, knowledge about the signaling molecules in the local microenvironment of a retinal injury and the transcriptional events they activate during neuronal death and regeneration is still lacking. To identify genes involved in photoreceptor regeneration, we combined light-induced photoreceptor lesions, laser-capture microdissection of the outer nuclear layer (ONL) and analysis of gene expression to characterize transcriptional changes for cells in the ONL as photoreceptors die and are regenerated. Using this approach, we were able to characterize aspects of the molecular signature of injured and dying photoreceptors, cone photoreceptor progenitors, and microglia within the ONL. We validated changes in gene expression and characterized the cellular expression for three novel, extracellular signaling molecules that we hypothesize are involved in regulating regenerative events in the retina

Characterization of clastic sedimentary enviroments by clustering algorithm and several statistical approaches — case study, Sava Depression in Northern Croatia

Abstract This study demonstrates a method to identify and characterize some facies of turbiditic depositional environments. The study area is a hydrocarbon field in the Sava Depression (Northern Croatia). Its Upper Miocene reservoirs have been proved to represent a lacustrine turbidite system. In the workflow, first an unsupervised neural network was applied as clustering method for two sandstone reservoirs. The elements of the input vectors were the basic petrophysical parameters. In the second step autocorrelation surfaces were used to reveal the hidden anisotropy of the grid. This anisotropy is supposed to identify the main continuity directions in the geometrical analyses of sandstone bodies. Finally, in the description of clusters several parametric and nonparametric statistics were used to characterize the identified facies. Obtained results correspond to the previously published interpretation of those reservoir facies

The effects of meteorological factors on the occurrence of Ganoderma sp. spores in the air

Ganoderma sp. is an airborne fungal spore type known to trigger respiratory allergy symptoms in sensitive patients. Aiming to reduce the risk for allergic individuals, we analysed fungal spore circulation in Szczecin, Poland, and its dependence on meteorological conditions. Statistical models for the airborne spore concentrations of Ganoderma sp.—one of the most abundant fungal taxa in the area—were developed. Aerobiological sampling was conducted over 2004–2008 using a volumetric Lanzoni trap. Simultaneously, the following meteorological parameters were recorded: daily level of precipitation, maximum and average wind speed, relative humidity and maximum, minimum, average and dew point temperatures. These data were used as the explaining variables. Due to the non-linearity and non-normality of the data set, the applied modelling techniques were artificial neural networks (ANN) and mutlivariate regression trees (MRT). The obtained classification and MRT models predicted threshold conditions above which Ganoderma sp. appeared in the air. It turned out that dew point temperature was the main factor influencing the presence or absence of Ganoderma sp. spores. Further analysis of spore seasons revealed that the airborne fungal spore concentration depended only slightly on meteorological factors

Defects in ErbB-Dependent Establishment of Adult Melanocyte Stem Cells Reveal Independent Origins for Embryonic and Regeneration Melanocytes

Adult stem cells are responsible for maintaining and repairing tissues during the life of an organism. Tissue repair in humans, however, is limited compared to the regenerative capabilities of other vertebrates, such as the zebrafish (Danio rerio). An understanding of stem cell mechanisms, such as how they are established, their self-renewal properties, and their recruitment to produce new cells is therefore important for the application of regenerative medicine. We use larval melanocyte regeneration following treatment with the melanocytotoxic drug MoTP to investigate these mechanisms in Melanocyte Stem Cell (MSC) regulation. In this paper, we show that the receptor tyrosine kinase, erbb3b, is required for establishing the adult MSC responsible for regenerating the larval melanocyte population. Both the erbb3b mutant and wild-type fish treated with the ErbB inhibitor, AG1478, develop normal embryonic melanocytes but fail to regenerate melanocytes after MoTP-induced melanocyte ablation. By administering AG1478 at different time points, we show that ErbB signaling is only required for regeneration prior to MoTP treatment and before 48 hours of development, consistent with a role in establishing MSCs. We then show that overexpression of kitla, the Kit ligand, in transgenic larvae leads to recruitment of MSCs, resulting in overproliferation of melanocytes. Furthermore, kitla overexpression can rescue AG1478-blocked regeneration, suggesting that ErbB signaling is required to promote the progression and specification of the MSC from a pre–MSC state. This study provides evidence that ErbB signaling is required for the establishment of adult MSCs during embryonic development. That this requirement is not shared with the embryonic melanocytes suggests that embryonic melanocytes develop directly, without proceeding through the ErbB-dependent MSC. Moreover, the shared requirement of larval melanocyte regeneration and metamorphic melanocytes that develops at the larval-to-adult transition suggests that these post-embryonic melanocytes develop from the same adult MSC population. Lastly, that kitla overexpression can recruit the MSC to develop excess melanocytes raises the possibility that Kit signaling may be involved in MSC recruitment during regeneration

Using the Tg(nrd:egfp)/albino Zebrafish Line to Characterize In Vivo Expression of neurod

In this study, we used a newly-created transgenic zebrafish, Tg(nrd:egfp)/albino, to further characterize the expression of neurod in the developing and adult retina and to determine neurod expression during adult photoreceptor regeneration. We also provide observations regarding the expression of neurod in a variety of other tissues. In this line, EGFP is found in cells of the developing and adult retina, pineal gland, cerebellum, olfactory bulbs, midbrain, hindbrain, neural tube, lateral line, inner ear, pancreas, gut, and fin. Using immunohistochemistry and in situ hybridization, we compare the expression of the nrd:egfp transgene to that of endogenous neurod and to known retinal cell types. Consistent with previous data based on in situ hybridizations, we show that during retinal development, the nrd:egfp transgene is not expressed in proliferating retinal neuroepithelium, and is expressed in a subset of retinal neurons. In contrast to previous studies, nrd:egfp is gradually re-expressed in all rod photoreceptors. During photoreceptor regeneration in adult zebrafish, in situ hybridization reveals that neurod is not expressed in Müller glial-derived neuronal progenitors, but is expressed in photoreceptor progenitors as they migrate to the outer nuclear layer and differentiate into new rod photoreceptors. During photoreceptor regeneration, expression of the nrd:egfp matches that of neurod. We conclude that Tg(nrd:egfp)/albino is a good representation of endogenous neurod expression, is a useful tool to visualize neurod expression in a variety of tissues and will aid investigating the fundamental processes that govern photoreceptor regeneration in adults