MiniZero: Comparative Analysis of AlphaZero and MuZero on Go, Othello, and Atari Games

This paper presents MiniZero, a zero-knowledge learning framework that supports four state-of-the-art algorithms, including AlphaZero, MuZero, Gumbel AlphaZero, and Gumbel MuZero. While these algorithms have demonstrated super-human performance in many games, it remains unclear which among them is most suitable or efficient for specific tasks. Through MiniZero, we systematically evaluate the performance of each algorithm in two board games, 9x9 Go and 8x8 Othello, as well as 57 Atari games. For two board games, using more simulations generally results in higher performance. However, the choice of AlphaZero and MuZero may differ based on game properties. For Atari games, both MuZero and Gumbel MuZero are worth considering. Since each game has unique characteristics, different algorithms and simulations yield varying results. In addition, we introduce an approach, called progressive simulation, which progressively increases the simulation budget during training to allocate computation more efficiently. Our empirical results demonstrate that progressive simulation achieves significantly superior performance in two board games. By making our framework and trained models publicly available, this paper contributes a benchmark for future research on zero-knowledge learning algorithms, assisting researchers in algorithm selection and comparison against these zero-knowledge learning baselines. Our code and data are available at https://rlg.iis.sinica.edu.tw/papers/minizero.Comment: Submitted to IEEE Transactions on Games, under revie

The Efficient Synthesis and Biological Evaluation of Novel Bi-Functionalized Sarcophagine for 64Cu Radiopharmaceuticals

Purpose We and others have reported that Sarcophagine-based bifunctional chelators could be effectively used in the syntheses of 64Cu radiopharmaceuticals. The resulted 64Cu-Sarcophagine complexes demonstrated great in vivo stability. The goal of this study was to further derivatize Sarcophagine cage with amino and maleimide functional groups for conjugation with bioligands

Effects of Hemodynamic Response Function Selection on Rat fMRI Statistical Analyses

The selection of the appropriate hemodynamic response function (HRF) for signal modeling in functional magnetic resonance imaging (fMRI) is important. Although the use of the boxcar-shaped hemodynamic response function (BHRF) and canonical hemodynamic response (CHRF) has gained increasing popularity in rodent fMRI studies, whether the selected HRF affects the results of rodent fMRI has not been fully elucidated. Here we investigated the signal change and t-statistic sensitivities of BHRF, CHRF, and impulse response function (IRF). The effect of HRF selection on different tasks was analyzed by using data collected from two groups of rats receiving either 3 mA whisker pad or 3 mA forepaw electrical stimulations (n = 10 for each group). Under whisker pad stimulation with large blood-oxygen-level dependent (BOLD) signal change (4.31 ± 0.42%), BHRF significantly underestimated signal changes (P < 0.001) and t-statistics (P < 0.001) compared with CHRF or IRF. CHRF and IRF did not provide significantly different t-statistics (P > 0.05). Under forepaw stimulation with small BOLD signal change (1.71 ± 0.34%), different HRFs provided insignificantly different t-statistics (P > 0.05). Therefore, the selected HRF can influence data analysis in rodent fMRI experiments with large BOLD responses but not in those with small BOLD responses

Exploring Markers of Exhausted CD8 T Cells to Predict Response to Immune Checkpoint Inhibitor Therapy for Hepatocellular Carcinoma

Background: Reversal of CD8 T-cell exhaustion was considered a major antitumor mechanism of anti-programmed cell death-1 (PD-1)/ anti-programmed death ligand-1 (PD-L1)-based immune checkpoint inhibitor (ICI) therapy. Objectives: The aim of this study was to identify markers of T-cell exhaustion that is best associated with ICI treatment efficacy for advanced hepatocellular carcinoma (HCC). Methods: Immune cell composition of archival tumor samples was analyzed by transcriptomic analysis and multiplex immunofluorescence staining. Results: HCC patients with objective response after anti-PD-1/anti-PD-L1-based ICI therapy (n = 42) had higher expression of genes related to T-cell exhaustion. A 9-gene signature (LAG3, CD244, CCL5, CXCL9, CXCL13, MSR1, CSF3R, CYBB, and KLRK1) was defined, whose expression was higher in patients with response to ICI therapy, correlated with density of CD8+LAG3+ cells in tumor microenvironment, and independently predicted better progression-free and overall survival. This 9-gene signature had similar predictive values for patients who received single-agent or combination ICI therapy and was not associated with prognosis in HCC patients who received surgery, suggesting that it may outperform other T-cell signatures for predicting efficacy of ICI therapy for HCC. For HCC patients who underwent surgery for both the primary liver and metastatic lung tumors (n = 31), lung metastatic HCC was associated with a higher exhausted CD8 T-cell signature, consistent with prior observation that patients with lung metastatic HCC may have higher probability of response to ICI therapy. Conclusions: CD8 T-cell exhaustion in tumor microenvironment may predict better efficacy of ICI therapy for HCC

Altered Striatocerebellar Metabolism and Systemic Inflammation in Parkinson’s Disease

Parkinson’s disease (PD) is the most second common neurodegenerative movement disorder. Neuroinflammation due to systemic inflammation and elevated oxidative stress is considered a major factor promoting the pathogenesis of PD, but the relationship of structural brain imaging parameters to clinical inflammatory markers has not been well studied. Our aim was to evaluate the association of magnetic resonance spectroscopy (MRS) measures with inflammatory markers. Blood samples were collected from 33 patients with newly diagnosed PD and 30 healthy volunteers. MRS data including levels of N-acetylaspartate (NAA), creatine (Cre), and choline (Cho) were measured in the bilateral basal ganglia and cerebellum. Inflammatory markers included plasma nuclear DNA, plasma mitochondrial DNA, and apoptotic leukocyte levels. The Cho/Cre ratio in the dominant basal ganglion, the dominant basal ganglia to cerebellum ratios of two MRS parameters NAA/Cre and Cho/Cre, and levels of nuclear DNA, mitochondrial DNA, and apoptotic leukocytes were significantly different between PD patients and normal healthy volunteers. Significant positive correlations were noted between MRS measures and inflammatory marker levels. In conclusion, patients with PD seem to have abnormal levels of inflammatory markers in the peripheral circulation and deficits in MRS measures in the dominant basal ganglion and cerebellum

A Nanodot Array Modulates Cell Adhesion and Induces an Apoptosis-Like Abnormality in NIH-3T3 Cells

Micro-structures that mimic the extracellular substratum promote cell growth and differentiation, while the cellular reaction to a nanostructure is poorly defined. To evaluate the cellular response to a nanoscaled surface, NIH 3T3 cells were grown on nanodot arrays with dot diameters ranging from 10 to 200 nm. The nanodot arrays were fabricated by AAO processing on TaN-coated wafers. A thin layer of platinum, 5 nm in thickness, was sputtered onto the structure to improve biocompatibility. The cells grew normally on the 10-nm array and on flat surfaces. However, 50-nm, 100-nm, and 200-nm nanodot arrays induced apoptosis-like events. Abnormality was triggered after as few as 24 h of incubation on a 200-nm dot array. For cells grown on the 50-nm array, the abnormality started after 72 h of incubation. The number of filopodia extended from the cell bodies was lower for the abnormal cells. Immunostaining using antibodies against vinculin and actin filament was performed. Both the number of focal adhesions and the amount of cytoskeleton were decreased in cells grown on the 100-nm and 200-nm arrays. Pre-coatings of fibronectin (FN) or type I collagen promoted cellular anchorage and prevented the nanotopography-induced programed cell death. In summary, nanotopography, in the form of nanodot arrays, induced an apoptosis-like abnormality for cultured NIH 3T3 cells. The occurrence of the abnormality was mediated by the formation of focal adhesions

Identification of a Functional Genetic Variant at 16q12.1 for Breast Cancer Risk: Results from the Asia Breast Cancer Consortium

Genetic factors play an important role in the etiology of breast cancer. We carried out a multi-stage genome-wide association (GWA) study in over 28,000 cases and controls recruited from 12 studies conducted in Asian and European American women to identify genetic susceptibility loci for breast cancer. After analyzing 684,457 SNPs in 2,073 cases and 2,084 controls in Chinese women, we evaluated 53 SNPs for fast-track replication in an independent set of 4,425 cases and 1,915 controls of Chinese origin. Four replicated SNPs were further investigated in an independent set of 6,173 cases and 6,340 controls from seven other studies conducted in Asian women. SNP rs4784227 was consistently associated with breast cancer risk across all studies with adjusted odds ratios (95% confidence intervals) of 1.25 (1.20−1.31) per allele (P = 3.2×10−25) in the pooled analysis of samples from all Asian samples. This SNP was also associated with breast cancer risk among European Americans (per allele OR  = 1.19, 95% CI  = 1.09−1.31, P = 1.3×10−4, 2,797 cases and 2,662 controls). SNP rs4784227 is located at 16q12.1, a region identified previously for breast cancer risk among Europeans. The association of this SNP with breast cancer risk remained highly statistically significant in Asians after adjusting for previously-reported SNPs in this region. In vitro experiments using both luciferase reporter and electrophoretic mobility shift assays demonstrated functional significance of this SNP. These results provide strong evidence implicating rs4784227 as a functional causal variant for breast cancer in the locus 16q12.1 and demonstrate the utility of conducting genetic association studies in populations with different genetic architectures

Exploring the role of anticipatory postural adjustment duration within APA2 subphase as a potential mediator between clinical disease severity and fall risk in Parkinson’s disease

IntroductionPeople with Parkinson’s Disease (PD) often show reduced anticipatory postural adjustments (APAs) before voluntary steps, impacting their stability. The specific subphase within the APA stage contributing significantly to fall risk remains unclear.MethodsWe analyzed center of pressure (CoP) trajectory parameters, including duration, length, and velocity, throughout gait initiation. This examination encompassed both the postural phase, referred to as anticipatory postural adjustment (APA) (APA1, APA2a, APA2b), and the subsequent locomotor phases (LOC). Participants were instructed to initiate a step and then stop (initiating a single step). Furthermore, we conducted assessments of clinical disease severity using the Unified Parkinson’s Disease Rating Scale (UPDRS) and evaluated fall risk using Tinetti gait and balance scores during off-medication periods.ResultsFreezing of gait (FOG) was observed in 18 out of 110 participants during the measurement of CoP trajectories. The Ramer-Douglas-Peucker algorithm successfully identified CoP displacement trajectories in 105 participants (95.5%), while the remaining 5 cases could not be identified due to FOG. Tinetti balance and gait score showed significant associations with levodopa equivalent daily dose, UPDRS total score, disease duration, duration (s) in APA2a (s) and LOC (s), length in APA1 (cm) and APA2b (cm), mediolateral velocity in APA1 (X) (cm/s), APA2a (X) (cm/s), APA2b (X) (cm/s) and LOC (X) (cm/s), and anterior–posterior velocity in APA2a (Z) (cm/s) and APA2b (Z) (cm/s). Multiple linear regression revealed that only duration (s) in APA2a and UPDRS total score was independently associated with Tinetti gait and balance score. Further mediation analysis showed that the duration (s) in APA2a served as a mediator between UPDRS total score and Tinetti balance and gait score (Sobel test, p = 0.047).ConclusionAPA2 subphase duration mediates the link between disease severity and fall risk in PD, suggesting that longer APA2a duration may indicate reduced control during gait initiation, thereby increasing fall risk

Genetic variation at CYP3A is associated with age at menarche and breast cancer risk : a case-control study

Abstract Introduction We have previously shown that a tag single nucleotide polymorphism (rs10235235), which maps to the CYP3A locus (7q22.1), was associated with a reduction in premenopausal urinary estrone glucuronide levels and a modest reduction in risk of breast cancer in women age ≤50 years. Methods We further investigated the association of rs10235235 with breast cancer risk in a large case control study of 47,346 cases and 47,570 controls from 52 studies participating in the Breast Cancer Association Consortium. Genotyping of rs10235235 was conducted using a custom Illumina Infinium array. Stratified analyses were conducted to determine whether this association was modified by age at diagnosis, ethnicity, age at menarche or tumor characteristics. Results We confirmed the association of rs10235235 with breast cancer risk for women of European ancestry but found no evidence that this association differed with age at diagnosis. Heterozygote and homozygote odds ratios (ORs) were OR = 0.98 (95% CI 0.94, 1.01; P = 0.2) and OR = 0.80 (95% CI 0.69, 0.93; P = 0.004), respectively (P trend = 0.02). There was no evidence of effect modification by tumor characteristics. rs10235235 was, however, associated with age at menarche in controls (P trend = 0.005) but not cases (P trend = 0.97). Consequently the association between rs10235235 and breast cancer risk differed according to age at menarche (P het = 0.02); the rare allele of rs10235235 was associated with a reduction in breast cancer risk for women who had their menarche age ≥15 years (ORhet = 0.84, 95% CI 0.75, 0.94; ORhom = 0.81, 95% CI 0.51, 1.30; P trend = 0.002) but not for those who had their menarche age ≤11 years (ORhet = 1.06, 95% CI 0.95, 1.19, ORhom = 1.07, 95% CI 0.67, 1.72; P trend = 0.29). Conclusions To our knowledge rs10235235 is the first single nucleotide polymorphism to be associated with both breast cancer risk and age at menarche consistent with the well-documented association between later age at menarche and a reduction in breast cancer risk. These associations are likely mediated via an effect on circulating hormone levels