Game Solving with Online Fine-Tuning

Game solving is a similar, yet more difficult task than mastering a game. Solving a game typically means to find the game-theoretic value (outcome given optimal play), and optionally a full strategy to follow in order to achieve that outcome. The AlphaZero algorithm has demonstrated super-human level play, and its powerful policy and value predictions have also served as heuristics in game solving. However, to solve a game and obtain a full strategy, a winning response must be found for all possible moves by the losing player. This includes very poor lines of play from the losing side, for which the AlphaZero self-play process will not encounter. AlphaZero-based heuristics can be highly inaccurate when evaluating these out-of-distribution positions, which occur throughout the entire search. To address this issue, this paper investigates applying online fine-tuning while searching and proposes two methods to learn tailor-designed heuristics for game solving. Our experiments show that using online fine-tuning can solve a series of challenging 7x7 Killall-Go problems, using only 23.54% of computation time compared to the baseline without online fine-tuning. Results suggest that the savings scale with problem size. Our method can further be extended to any tree search algorithm for problem solving. Our code is available at https://rlg.iis.sinica.edu.tw/papers/neurips2023-online-fine-tuning-solver.Comment: Accepted by the 37th Conference on Neural Information Processing Systems (NeurIPS 2023

Drastic population fluctuations explain the rapid extinction of the passenger pigeon

To assess the role of human disturbances in species' extinction requires an understanding of the species population history before human impact. The passenger pigeon was once the most abundant bird in the world, with a population size estimated at 3-5 billion in the 1800s; its abrupt extinction in 1914 raises the question of how such an abundant bird could have been driven to extinction in mere decades. Although human exploitation is often blamed, the role of natural population dynamics in the passenger pigeon's extinction remains unexplored. Applying high-throughput sequencing technologies to obtain sequences from most of the genome, we calculated that the passenger pigeon's effective population size throughout the last million years was persistently about 1/10,000 of the 1800's estimated number of individuals, a ratio 1,000-times lower than typically found. This result suggests that the passenger pigeon was not always super abundant but experienced dramatic population fluctuations, resembling those of an "outbreak" species. Ecological niche models supported inference of drastic changes in the extent of its breeding range over the last glacial-interglacial cycle. An estimate of acorn-based carrying capacity during the past 21,000 y showed great year-to-year variations. Based on our results, we hypothesize that ecological conditions that dramatically reduced population size under natural conditions could have interacted with human exploitation in causing the passenger pigeon's rapid demise. Our study illustrates that even species as abundant as the passenger pigeon can be vulnerable to human threats if they are subject to dramatic population fluctuations, and provides a new perspective on the greatest human-caused extinction in recorded history

Cyclooxygenase-2 enhances α2β1 integrin expression and cell migration via EP1 dependent signaling pathway in human chondrosarcoma cells

<p>Abstract</p> <p>Background</p> <p>Cyclooxygenase (COX)-2, the inducible isoform of prostaglandin (PG) synthase, has been implicated in tumor metastasis. Interaction of COX-2 with its specific EP receptors on the surface of cancer cells has been reported to induce cancer invasion. However, the effects of COX-2 on migration activity in human chondrosarcoma cells are mostly unknown. In this study, we examined whether COX-2 and EP interaction are involved in metastasis of human chondrosarcoma.</p> <p>Results</p> <p>We found that over-expression of COX-2 or exogenous PGE₂increased the migration of human chondrosarcoma cells. We also found that human chondrosarcoma tissues and chondrosarcoma cell lines had significant expression of the COX-2 which was higher than that in normal cartilage. By using pharmacological inhibitors or activators or genetic inhibition by the EP receptors, we discovered that the EP1 receptor but not other PGE receptors is involved in PGE₂-mediated cell migration and α2β1 integrin expression. Furthermore, we found that human chondrosarcoma tissues expressed a higher level of EP1 receptor than normal cartilage. PGE₂-mediated migration and integrin up-regulation were attenuated by phospholipase C (PLC), protein kinase C (PKC) and c-Src inhibitor. Activation of the PLCβ, PKCα, c-Src and NF-κB signaling pathway after PGE₂treatment was demonstrated, and PGE₂-induced expression of integrin and migration activity were inhibited by the specific inhibitor, siRNA and mutants of PLC, PKC, c-Src and NF-κB cascades.</p> <p>Conclusions</p> <p>Our results indicated that PGE₂enhances the migration of chondrosarcoma cells by increasing α2β1 integrin expression through the EP1/PLC/PKCα/c-Src/NF-κB signal transduction pathway.</p

Concerted suppressive effects of carisbamate, an anti-epileptic alkyl-carbamate drug, on voltage-gated Na+ and hyperpolarization-activated cation currents

Carisbamate (CRS, RWJ-333369) is a new anti-seizure medication. It remains unclear whether and how CRS can perturb the magnitude and/or gating kinetics of membrane ionic currents, despite a few reports demonstrating its ability to suppress voltage-gated Na+ currents. In this study, we observed a set of whole-cell current recordings and found that CRS effectively suppressed the voltage-gated Na+ (INa) and hyperpolarization-activated cation currents (Ih) intrinsically in electrically excitable cells (GH3 cells). The effective IC50 values of CRS for the differential suppression of transient (INa(T)) and late INa (INa(L)) were 56.4 and 11.4 μM, respectively. However, CRS strongly decreased the strength (i.e., Δarea) of the nonlinear window component of INa (INa(W)), which was activated by a short ascending ramp voltage (Vramp); the subsequent addition of deltamethrin (DLT, 10 μM) counteracted the ability of CRS (100 μM, continuous exposure) to suppress INa(W). CRS strikingly decreased the decay time constant of INa(T) evoked during pulse train stimulation; however, the addition of telmisartan (10 μM) effectively attenuated the CRS (30 μM, continuous exposure)-mediated decrease in the decay time constant of the current. During continued exposure to deltamethrin (10 μM), known to be a pyrethroid insecticide, the addition of CRS resulted in differential suppression of the amplitudes of INa(T) and INa(L). The amplitude of Ih activated by a 2-s membrane hyperpolarization was diminished by CRS in a concentration-dependent manner, with an IC50 value of 38 μM. For Ih, CRS altered the steady-state I–V relationship and attenuated the strength of voltage-dependent hysteresis (Hys(V)) activated by an inverted isosceles-triangular Vramp. Moreover, the addition of oxaliplatin effectively reversed the CRS-mediated suppression of Hys(V). The predicted docking interaction between CRS and with a model of the hyperpolarization-activated cyclic nucleotide-gated (HCN) channel or between CRS and the hNaV1.7 channel reflects the ability of CRS to bind to amino acid residues in HCN or hNaV1.7 channel via hydrogen bonds and hydrophobic interactions. These findings reveal the propensity of CRS to modify INa(T) and INa(L) differentially and to effectively suppress the magnitude of Ih. INa and Ih are thus potential targets of the actions of CRS in terms of modulating cellular excitability

Pioglitazone, a PPAR-γ Activator, Stimulates BKCa but Suppresses IKM in Hippocampal Neurons

Pioglitazone (PIO), a thiazolidinedone, was reported to stimulate peroxisome proliferator-activated receptor-γ (PPAR-γ) with anti-inflammatory, anti-proliferative, anti-diabetic, and antidepressive activities. However, whether this compound exerts any perturbations on Ca2+-activated K+ and M-type K+ currents in central neurons remains largely unresolved. In this study, we investigated the effects of PIO on these potassium currents in hippocampal neurons (mHippoE-14). In whole-cell current recordings, the presence of PIO (10 μM) increased the amplitude of Ca2+-activated K+ current [IK(Ca)] in mHippoE-14 cells. PIO-induced stimulation of IK(Ca) observed in these cells was reversed by subsequent addition of paxilline, yet not by TRAM-39 or apamin. In inside-out current recordings, PIO applied to the bath concentration-dependently increased the activity of large-conductance Ca2+-activated K+ (BKCa) channels with an EC50 value of 7.6 μM. Its activation of BKCa channels in mHippoE-14 cells was voltage-dependent and accompanied by both a lengthening in mean open time and a shortening in slow component of mean closed time. The activation curve of BKCa channels after addition of PIO was shifted to less depolarized potential without any change in the gating charge. PIO also suppressed the amplitude of M-type K+ currents inherently in mHippoE-14 neurons. Taken together, in addition to its agonistic action on PPAR-γ, PIO-induced perturbation of these potassium channels may be responsible for its widely pharmacological actions on hippocampal neurons

Effects of epinephrine on heart rate variability and cytokines in a rat sepsis model

Catecholamines have both anti-inflammatory and vasoactive properties. A decreased cardiac response to catecholamines has been associated with a high risk of death in sepsis and septic shock. The aim of this study was to investigate the effects of epinephrine (EPI) on heart rate variability and autonomic balance, as well as cytokine levels, in a rat sepsis model. Thirty-six male Sprague-Dawley rats were assigned to 4 experimental groups and 2 control groups of 6 rats each. The rats in the experimental groups were inoculated with a lipopolysaccharide (LPS, endotoxin) to establish a sepsis model. Group A received only LPS; group B received LPS, antecedent EPI and the nonselective beta-blocker propranolol; group C received LPS and antecedent EPI; and group D received LPS, antecedent EPI and the selective beta1-blocker esmolol. One control group received EPI and the other received saline placebo. Heart rate variability was analyzed and tumor necrosis factor-α (TNF-α), interleukin-6 (IL-6) and interleukin-1β (IL-1β) levels were measured. Measurements were carried out at baseline and 0, 0.5, 2, and 4 hours after LPS inoculation. There were significant differences in heart rate variability and cytokine levels between the groups, indicating that LPS infusion caused autonomic imbalance. Antecedent EPI significantly decreased the level of TNF-α in group C compared with group A in which TNF-α level peaked at 2 hours and then declined. Propranolol (group B) but not esmolol (group D) administration resulted in elevated TNF-α levels, comparable to those observed in group A. In conclusion, antecedent administration of EPI in a rat sepsis model inhibits the production of TNF-α possibly via the β2-adrenoreceptor

Functional characterization of cellulases identified from the cow rumen fungus Neocallimastix patriciarum W5 by transcriptomic and secretomic analyses

<p>Abstract</p> <p>Background</p> <p><it>Neocallimastix patriciarum</it> is one of the common anaerobic fungi in the digestive tracts of ruminants that can actively digest cellulosic materials, and its cellulases have great potential for hydrolyzing cellulosic feedstocks. Due to the difficulty in culture and lack of a genome database, it is not easy to gain a global understanding of the glycosyl hydrolases (<it>GHs</it>) produced by this anaerobic fungus.</p> <p>Results</p> <p>We have developed an efficient platform that uses a combination of transcriptomic and proteomic approaches to <it>N. patriciarum </it>to accelerate gene identification, enzyme classification and application in rice straw degradation. By conducting complementary studies of transcriptome (Roche 454 GS and Illumina GA IIx) and secretome (ESI-Trap LC-MS/MS), we identified 219 putative <it>GH </it>contigs and classified them into 25 <it>GH</it> families. The secretome analysis identified four major enzymes involved in rice straw degradation: β-glucosidase, endo-1,4-β-xylanase, xylanase B and Cel48A exoglucanase. From the sequences of assembled contigs, we cloned 19 putative cellulase genes, including the <it>GH1</it>, <it>GH3</it>, <it>GH5</it>, <it>GH6</it>, <it>GH9</it>, <it>GH18</it>, <it>GH43 </it>and <it>GH48 </it>gene families, which were highly expressed in <it>N. patriciarum </it>cultures grown on different feedstocks.</p> <p>Conclusions</p> <p>These <it>GH </it>genes were expressed in Pichia pastoris and/or Saccharomyces cerevisiae for functional characterization. At least five novel cellulases displayed cellulytic activity for glucose production. One β-glucosidase (W5-16143) and one exocellulase (W5-CAT26) showed strong activities and could potentially be developed into commercial enzymes.</p