Adaptive state construction for reinforcement learning and its application to robot navigation problems

This paper applies our state construction method by ART neural network to robot navigation problems. Agents in this paper consist of ART neural network and contradiction resolution mechanism. The ART neural network serves as a mean of state recognition which maps stimulus inputs to a certain state and state construction which creates a new state when a current stimulus input cannot be categorized into any known states. On the other hand, the contradiction resolution mechanism (CRM) uses agents' state transition table to detect inconsistency among constructed states. In the proposed method, two kinds of inconsistency for the CRM are introduced: &#34;Different results caused by the same states and the same actions&#34; and &#34;Contradiction due to ambiguous states.&#34; The simulation results on the robot navigation problems confirm the effectiveness of the proposed method</p

An incremental state-segmentation method for reinforcement learning using ART neural network

In this paper, we propose a new incremental state segmentation method by utilizing information of the agents' state transition table which consists of a tuple of (state; action, state) in order to reduce the effort of designers and which is generated using the ART neural network. In the proposed method, if an inconsistent situation in the state transition table is observed, agents refine their map from perceptual inputs to states such that inconsistency is resolved. We introduce two kinds of inconsistency, i.e., different results caused by the same states and the same actions, and contradiction due to ambiguous states. Several computational simulations on cart-pole problems confirm the effectiveness of the proposed method</p

Mixing time and simulated annealing for the stochastic cellular automata

Finding a ground state of a given Hamiltonian on a graph $G=(V,E)$ is an important but hard problem. One of the potential approaches is to use a Markov chain Monte Carlo to sample the Gibbs distribution whose highest peaks correspond to the ground states. In this paper, we investigate a particular kind of stochastic cellular automata, in which all spins are updated independently and simultaneously. We prove that (i) if the temperature is fixed sufficiently high, then the mixing time is at most of order $\log|V|$, and that (ii) if the temperature drops in time $n$ as $1/\log n$, then the limiting measure is uniformly distributed over the ground states.Comment: 16 pages, 8 figure

Robustness against fading fluctuation in Hermite-symmetric subcarrier coding for OFDM systems

Article2014 International Conference on Information and Communication Technology Convergence (ICTC). 834-835 (2014)journal articl

Smectic Pair Density Wave Order in EuRbFe4As4

The pair density wave (PDW) is a novel superconducting state in which Cooper pairs carry center-of-mass momentum in equilibrium, leading to the breaking of translational symmetry. Experimental evidence for such a state exists in high magnetic field and in some materials that feature density wave orders that explicitly break translational symmetry. However, evidence for a zero-field PDW state that exists independent of other spatially ordered states has so far been elusive. Here, we show that such a state exists in the iron pnictide superconductor EuRbFe4As4 (Eu-1144), a material that features coexisting superconductivity (Tc ~ 37K) and magnetism (Tm ~ 15 K). We show from the Spectroscopic Imaging Scanning Tunneling Microscopy (SI-STM) measurements that the superconducting gap at low temperature has long-range, unidirectional spatial modulations with an incommensurate period of ~8 unit cells. Upon raising the temperature above Tm, the modulated superconductor disappears, but a uniform superconducting gap survives to Tc. When an external magnetic field is applied, gap modulations disappear inside the vortex halo. The SI-STM and bulk measurements show the absence of other density wave orders, showing that the PDW state is a primary, zero-field superconducting state in this compound. Both four-fold rotational symmetry and translation symmetry are recovered above Tm, indicating that the PDW is a smectic order

Prognostic assessment of 1310 patients with non–small-cell lung cancer who underwent complete resection from 1980 to 1993

AbstractObjective: The TNM staging system of lung cancer is widely used as a guide for estimating prognosis and selecting treatment modality. In 1997, the International Union Against Cancer and the American Joint Committee on Cancer have adopted a revised stage grouping for lung cancer. However, the validity of the new stage grouping has not been fully established. We investigated the prognoses of patients who had resection of non–small-cell lung cancer to confirm the validity of the revised classification. Methods: A total of 1310 patients with non–small-cell lung cancer underwent complete resection and pathologic staging of the disease in our hospitals from 1980 through 1993. A pulmonary resection was performed with a systematic nodal dissection. The survivals were calculated with the Kaplan-Meier method on the basis of overall deaths, and the survival curves were compared by log rank test. Results: There were significant differences in survival between patients with T1 N0 M0 and T2 N0 M0 disease and between those with T1 N1 M0 and T2 N1 M0 disease. However, there was no significant difference between patients with T2 N0 M0 disease and those with T1 N1 M0 disease. No significant difference in survival was observed among patients with T2 N1 M0, T3 N0 M0, and T3 N1 M0 cancer. Patients with different invaded organs of T3 subdivision (pleura, chest wall, pericardium, or diaphragm) had a different prognosis. There was no significant difference between patients with T3 N2 M0 disease and those with stage IIIB disease. Conclusions: We supported most of the revision, such as dividing stage I, dividing stage II, and putting T3 N0 M0 to stage IIB. Furthermore, we found some candidates for a subsequent revision, such as putting T3 N1 M0 to stage IIB, putting T2 N0 M0 and T1 N1 M0 together, regarding diaphragm invasion as T4, and putting T3 N2 M0 to stage IIIB. (J Thorac Cardiovasc Surg 1998;116:407-11

Combined use of cellulose acetate polymer and retrievable platinum coils for the thrombosis of cervical carotid aneurysms.

Cellulose acetate polymer (CAP) solution is a new liquid embolic material, and it has been used clinically for the thrombosis of cerebral aneurysms. The purpose of the study was to test a method of aneurysm treatment. In an experimental model, retrievable interlocking detachable coils (IDCs) were used to create an intraaneurysmal frame or prop and then CAP was injected into 20 experimentally induced canine cervical aneurysms. Intraaneurysmal thrombosis was induced 1 week after aneurysm creation. Complete thrombosis was attempted in 12 aneurysms, and partial thrombosis was attempted in 4. Four other aneurysms served as controls. Follow-up angiography was performed for up to 8 weeks, and with the exception of 4 aneurysms, which were kept for a 2-year long-term follow-up study, the aneurysms were then harvested for histological examination. Thrombosis was successfully achieved in all cases except for 2 enlarged aneurysms that were initially partially thrombosed. No thromboembolism to distal vessels was observed. No compaction or shift of the CAP-IDC complex occurred even after 2 years. Histologically, CAP and IDCs conformed to the massive thrombotic complex without any fragmentation. By creating a frame or prop with retrievable microcoils, we were able to inject the CAP implies a comparison safely and precisely than has been previously reported. Our findings suggest that this method will be useful for the treatment of cerebral aneurysms.</p

Osteocrin ameliorates adriamycin nephropathy via p38 mitogen-activated protein kinase inhibition

Natriuretic peptides exert multiple effects by binding to natriuretic peptide receptors (NPRs). Osteocrin (OSTN) binds with high affinity to NPR-C, a clearance receptor for natriuretic peptides, and inhibits degradation of natriuretic peptides and consequently enhances guanylyl cyclase-A (GC-A/NPR1) signaling. However, the roles of OSTN in the kidney have not been well clarified. Adriamycin (ADR) nephropathy in wild-type mice showed albuminuria, glomerular basement membrane changes, increased podocyte injuries, infiltration of macrophages, and p38 mitogen-activated protein kinase (MAPK) activation. All these phenotypes were improved in OSTN- transgenic (Tg) mice and NPR3 knockout (KO) mice, with no further improvement in OSTN-Tg/NPR3 KO double mutant mice, indicating that OSTN works through NPR3. On the contrary, OSTN KO mice increased urinary albumin levels, and pharmacological blockade of p38 MAPK in OSTN KO mice ameliorated ADR nephropathy. In vitro, combination treatment with ANP and OSTN, or FR167653, p38 MAPK inhibitor, reduced Ccl2 and Des mRNA expression in murine podocytes (MPC5). OSTN increased intracellular cyclic guanosine monophosphate (cGMP) in MPC5 through GC-A. We have elucidated that circulating OSTN improves ADR nephropathy by enhancing GC-A signaling and consequently suppressing p38 MAPK activation. These results suggest that OSTN could be a promising therapeutic agent for podocyte injury