On-line Learning of an Unlearnable True Teacher through Mobile Ensemble Teachers

On-line learning of a hierarchical learning model is studied by a method from statistical mechanics. In our model a student of a simple perceptron learns from not a true teacher directly, but ensemble teachers who learn from the true teacher with a perceptron learning rule. Since the true teacher and the ensemble teachers are expressed as non-monotonic perceptron and simple ones, respectively, the ensemble teachers go around the unlearnable true teacher with the distance between them fixed in an asymptotic steady state. The generalization performance of the student is shown to exceed that of the ensemble teachers in a transient state, as was shown in similar ensemble-teachers models. Further, it is found that moving the ensemble teachers even in the steady state, in contrast to the fixed ensemble teachers, is efficient for the performance of the student.Comment: 18 pages, 8 figure

Superoxide dismutase analog (Tempol: 4-hydroxy-2, 2, 6, 6-tetramethylpiperidine 1-oxyl) treatment restores erectile function in diabetes-induced impotence.

We hypothesized that the administration of the superoxide dismutase (SOD) mimetic Tempol (4-hydroxy-2, 2, 6, 6-tetramethylpiperidine 1-oxyl) may reverse diabetes-induced erectile dysfunction. To test this hypothesis, reactive oxygen species-related genes (SOD1, SOD2, GP x 1, CAT, NOS2, NOS3) were tested, erectile functional studies and immunohistochemical analysis were carried out in diabetic rats treated with or without Tempol. Thirty Sprague-Dawley (3-4 months old) rats were divided into three groups (n=10 each), 20 with diabetes (diabetic control and Tempol treatment) and 10 healthy controls. At 12 weeks after the induction of diabetes by streptozotocin and Tempol treatment, all groups underwent in vivo cavernous nerve stimulation. Rat crura were harvested and the expression of antioxidative defense enzymes were examined by semi-quantitative reverse transcriptase PCR (RT-PCR). To confirm the RT-PCR results, we carried out immunohistochemistry (IHC) for catalase (CAT) and iNOS (NOS2). Nitration of tyrosine groups in proteins was also examined by IHC. Mean intracavernous pressure in the diabetic group was significantly lower than in the healthy controls (P <0.001) and was reversed by Tempol treatment (P <0.0108). NOS2 protein expression was significantly increased in diabetic animals compared with healthy controls and Tempol restored NOS2 protein level. Nitrotyrosine was also higher in diabetic animals and although Tempol treatment decreased its formation, it remained higher than that found in healthy controls. This study suggests that Tempol treatment increased erectile function through modulating oxidative stress-related genes in diabetic rats. This is the first report about the relationship between diabetes-induced erectile dysfunction and oxidative stress, and antioxidative therapy using the superoxide dismutase mimetic, Tempol, to restore erectile function

Statistical Mechanics of Nonlinear On-line Learning for Ensemble Teachers

We analyze the generalization performance of a student in a model composed of nonlinear perceptrons: a true teacher, ensemble teachers, and the student. We calculate the generalization error of the student analytically or numerically using statistical mechanics in the framework of on-line learning. We treat two well-known learning rules: Hebbian learning and perceptron learning. As a result, it is proven that the nonlinear model shows qualitatively different behaviors from the linear model. Moreover, it is clarified that Hebbian learning and perceptron learning show qualitatively different behaviors from each other. In Hebbian learning, we can analytically obtain the solutions. In this case, the generalization error monotonically decreases. The steady value of the generalization error is independent of the learning rate. The larger the number of teachers is and the more variety the ensemble teachers have, the smaller the generalization error is. In perceptron learning, we have to numerically obtain the solutions. In this case, the dynamical behaviors of the generalization error are non-monotonic. The smaller the learning rate is, the larger the number of teachers is; and the more variety the ensemble teachers have, the smaller the minimum value of the generalization error is.Comment: 13 pages, 9 figure

Simulation of Lattice Polymers with Multi-Self-Overlap Ensemble

A novel family of dynamical Monte Carlo algorithms for lattice polymers is proposed. Our central idea is to simulate an extended ensemble in which the self-avoiding condition is systematically weakened. The degree of the self-overlap is controlled in a similar manner as the multicanonical ensemble. As a consequence, the ensemble --the multi-self-overlap ensemble-- contains adequate portions of self-overlapping conformations as well as higher energy ones. It is shown that the multi-self-overlap ensemble algorithm reproduce correctly the canonical averages at finite temperatures of the HP model of lattice proteins. Moreover, it outperforms massively a standard multicanonical algorithm for a difficult example of a polymer with 8-stickers. Alternative algorithm based on exchange Monte Carlo method is also discussed.Comment: 5 Pages, 4 Postscript figures, uses epsf.st

Deep Vascular Imaging in Wounds by Two-Photon Fluorescence Microscopy

Deep imaging within tissue (over 300 mu m) at micrometer resolution has become possible with the advent of two-photon fluorescence microscopy (2PFM). The advantages of 2PFM have been used to interrogate endogenous and exogenous fluorophores in the skin. Herein, we employed the integrin (cell-adhesion proteins expressed by invading angiogenic blood vessels) targeting characteristics of a two-photon absorbing fluorescent probe to image new vasculature and fibroblasts up to approximate to 1600 mu m within wound (neodermis)/granulation tissue in lesions made on the skin of mice. Reconstruction revealed three dimensional (3D) architecture of the vascular plexus forming at the regenerating wound tissue and the presence of a fibroblast bed surrounding the capillaries. Biologically crucial events, such as angiogenesis for wound healing, may be illustrated and analyzed in 3D on the whole organ level, providing novel tools for biomedical applications

Genome Comparison and Phylogenetic Analysis of Orientia tsutsugamushi Strains

Orientia tsutsugamushi (OT) is an obligate intracellular bacterium belonging to the family Rickettsiaceae and is the causative agent of scrub typhus, or Tsutsugamushi disease. The complete genome sequences of two OT strains (Boryong and Ikeda) have recently been determined. In the present study, we performed a fine genome sequence comparison of these strains. Our results indicate that although the core gene set of the family Rickettsiaceae is highly conserved between the two strains, a common set of repetitive sequences have been explosively amplified in both genomes. These amplified repetitive sequences have induced extensive genome shuffling and duplications and deletions of many genes. On the basis of the results of the genome sequence comparison, we selected 11 housekeeping genes and carried out multilocus sequence analysis of OT strains using the nucleotide sequences of these genes. This analysis revealed for the first time the phylogenetic relationships of representative OT strains. Furthermore, the results suggest the presence of an OT lineage with higher potential for virulence, which may explain the clinical and epidemiological differences between ‘classic’ and ‘new’ types of Tsutsugamushi disease in Japan

Protective role of nitric oxide in ischemia and reperfusion injury of the liver

Background: The suppressed production of nitric oxide (NO), associated with endothelial dysfunction, is thought to be a cause of ischemia and reperfusion injury of the liver. But findings of the salutary effects of NO enhancement on such injury have been conflicting. In this study, we tested our hypothesis that NO enhancement would attenuate ischemic liver injury. For this purpose, an NO precursor, L-arginine, and a novel NO donor, FK409, were applied to a 2-hour total hepatic vascular exclusion model in dogs. Study Design: L-arginine was administered IV at a dose of 100 mg/kg twice (n = 5), while 300 mg/kg twice of FK409 was infused continuously into the portal vein (n = 5). The drugs were given to the animals for 30 and 60 minutes before and after ischemia, respectively. Nontreated animals were used as the control (n = 10). Two-week survival, systemic and hepatic hemodynamics indices, liver function tests, energy metabolism, and histopathology were analyzed. Results: Both treatments comparably augmented hepatic tissue blood flow, decreased liver enzyme release, and increased high-energy phosphate restoration during the reperfusion period, all of which contributed to rescuing all of the treated animals from the 2-hour total hepatic ischemia. In contrast, ischemia caused 70% mortality in the control group. Histologically, structural abnormality and neutrophil infiltration were markedly attenuated by the treatments. Systemic hypotension was observed in the animals treated with FK409, however. Conclusions: Our data demonstrate that NO enhancement alleviates the liver injury caused by ischemia and reperfusion. The supplementation of L-arginine, rather than FK409, is considered more applicable to clinical use because of the absence of systemic adverse effects