Efficient Last-iterate Convergence Algorithms in Solving Games

No-regret algorithms are popular for learning Nash equilibrium (NE) in two-player zero-sum normal-form games (NFGs) and extensive-form games (EFGs). Many recent works consider the last-iterate convergence no-regret algorithms. Among them, the two most famous algorithms are Optimistic Gradient Descent Ascent (OGDA) and Optimistic Multiplicative Weight Update (OMWU). However, OGDA has high per-iteration complexity. OMWU exhibits a lower per-iteration complexity but poorer empirical performance, and its convergence holds only when NE is unique. Recent works propose a Reward Transformation (RT) framework for MWU, which removes the uniqueness condition and achieves competitive performance with OMWU. Unfortunately, RT-based algorithms perform worse than OGDA under the same number of iterations, and their convergence guarantee is based on the continuous-time feedback assumption, which does not hold in most scenarios. To address these issues, we provide a closer analysis of the RT framework, which holds for both continuous and discrete-time feedback. We demonstrate that the essence of the RT framework is to transform the problem of learning NE in the original game into a series of strongly convex-concave optimization problems (SCCPs). We show that the bottleneck of RT-based algorithms is the speed of solving SCCPs. To improve the their empirical performance, we design a novel transformation method to enable the SCCPs can be solved by Regret Matching+ (RM+), a no-regret algorithm with better empirical performance, resulting in Reward Transformation RM+ (RTRM+). RTRM+ enjoys last-iterate convergence under the discrete-time feedback setting. Using the counterfactual regret decomposition framework, we propose Reward Transformation CFR+ (RTCFR+) to extend RTRM+ to EFGs. Experimental results show that our algorithms significantly outperform existing last-iterate convergence algorithms and RM+ (CFR+)

Full-Length Transcriptome Analysis Reveals Candidate Genes Involved in Terpenoid Biosynthesis in Artemisia argyi

Artemisia argyi is an important medicinal plant widely utilized for moxibustion heat therapy in China. The terpenoid biosynthesis process in A. argyi is speculated to play a key role in conferring its medicinal value. However, the molecular mechanism underlying terpenoid biosynthesis remains unclear, in part because the reference genome of A. argyi is unavailable. Moreover, the full-length transcriptome of A. argyi has not yet been sequenced. Therefore, in this study, de novo transcriptome sequencing of A. argyi's root, stem, and leaf tissues was performed to obtain those candidate genes related to terpenoid biosynthesis, by combining the PacBio single-molecule real-time (SMRT) and Illumina sequencing NGS platforms. And more than 55.4 Gb of sequencing data and 108,846 full-length reads (non-chimeric) were generated by the Illumina and PacBio platform, respectively. Then, 53,043 consensus isoforms were clustered and used to represent 36,820 non-redundant transcripts, of which 34,839 (94.62%) were annotated in public databases. In the comparison sets of leaves vs roots, and leaves vs stems, 13,850 (7,566 up-regulated, 6,284 down-regulated) and 9,502 (5,284 up-regulated, 4,218 down-regulated) differentially expressed transcripts (DETs) were obtained, respectively. Specifically, the expression profile and KEGG functional enrichment analysis of these DETs indicated that they were significantly enriched in the biosynthesis of amino acids, carotenoids, diterpenoids and flavonoids, as well as the metabolism processes of glycine, serine and threonine. Moreover, multiple genes encoding significant enzymes or transcription factors related to diterpenoid biosynthesis were highly expressed in the A. argyi leaves. Additionally, several transcription factor families, such as RLK-Pelle_LRR-L-1 and RLK-Pelle_DLSV, were also identified. In conclusion, this study offers a valuable resource for transcriptome information, and provides a functional genomic foundation for further research on molecular mechanisms underlying the medicinal use of A. argyi leaves

Physiological effects of combined NaCl and NaHCO3 stress on the seedlings of two maple species

Salt stress impacts growth and physiological processes in plants, and some plants exposed to salt stress will produce physiological mechanisms to adapt to the new environment. However, the effects of combined NaCl and NaHCO3 stress on the seedlings of Acer species are understudied. In this study, we designed an experiment to measure physiological characteristics by establishing a range of NaCl and NaHCO3 concentrations (0, 25, 50, 75, and 100 mmol L-1) to estimate the compound salt tolerance of Acer ginnala and Acer palmatum. When the concentrations of NaCl and NaHCO3 were 25 mmol L-1, the leaf water content, relative conductivity, malondialdehyde (MDA) content, proline content, soluble sugar content, and chlorophyll did not change (p > 0.05) in two maple seedlings. At concentrations greater than 50 mmol L-1, the relative conductivity and MDA content increased, proline and soluble sugars accumulated, and the potential activity of PS II (Fv/Fo), potential photochemical efficiency of PS II (Fv/Fm), PS II actual photochemical efficiency (Yield), and photosynthetic electron transfer efficiency (ETR) decreased (p < 0.05). The superoxide dismutase (SOD) and catalase (CAT) activities showed the same trend of first increasing and then decreasing (p < 0.05). The peroxidase (POD) activity increased only when concentrations of NaCl and NaHCO3 were 100 mmol L-1, while there was no statistical difference between the other treatments and the control. Therefore, the two maple seedlings adjusted their osmotic balance and alleviated oxidative stress by accumulating proline, soluble sugars and increasing CAT and SOD activities. Further analysis showed that both species are salt tolerant and the salt tolerance of Acer ginnala is better than that of Acer palmatum

Medication Non-adherence and Condomless Anal Intercourse Increased Substantially During the COVID-19 Pandemic Among MSM PrEP Users: A Retrospective Cohort Study in Four Chinese Metropolises

BackgroundThe coronavirus disease (COVID-19) pandemic has impacted HIV prevention strategies globally. However, changes in pre-exposure prophylaxis (PrEP) adherence and HIV-related behaviors, and their associations with medication adherence among men who have sex with men (MSM) PrEP users remain unclear since the onset of the COVID-19 pandemic.MethodsA Retrospective Cohort Study of HIV-negative MSM PrEP users was conducted in four Chinese metropolises from December 2018 to March 2020, assessing the changes in PrEP adherence and HIV-related behaviors before and during the COVID-19. The primary outcome was poor PrEP adherence determined from self-reported missing at least one PrEP dose in the previous month. We used multivariable logistic regression to determine factors correlated with poor adherence during COVID-19.ResultsWe enrolled 791 eligible participants (418 [52.8%] in daily PrEP and 373 [47.2%] in event-driven PrEP). Compared with the data conducted before the COVID-19, the proportion of PrEP users decreased from 97.9 to 64.3%, and the proportion of poor PrEP adherence increased from 23.6 to 50.1% during the COVID-19 [odds ratio (OR) 3.24, 95% confidence interval (CI) 2.62–4.02]. While the percentage of condomless anal intercourse (CAI) with regular partners (11.8 vs. 25.7%) and with casual partners (4.4 vs. 9.0%) both significantly increased. The proportion of those who were tested for HIV decreased from 50.1 to 25.9%. Factors correlated with poor PrEP adherence during the COVID-19 included not being tested for HIV (adjusted odds ratio [aOR] = 1.38 [95% CI: 1.00, 1.91]), using condoms consistently with regular partners (vs. never, aOR = 2.19 [95% CI: 1.16, 4.13]), and being married or cohabitating with a woman (vs. not married, aOR = 3.08 [95% CI: 1.60, 5.95]).ConclusionsIncreased poor PrEP adherence and CAI along with the decrease in HIV testing can lead to an increase in HIV acquisition and drug resistance to PrEP. Targeted interventions are needed to improve PrEP adherence and HIV prevention strategies

Precision Higgs physics at the CEPC

The discovery of the Higgs boson with its mass around 125 GeV by the ATLAS and CMS Collaborations marked the beginning of a new era in high energy physics. The Higgs boson will be the subject of extensive studies of the ongoing LHC program. At the same time, lepton collider based Higgs factories have been proposed as a possible next step beyond the LHC, with its main goal to precisely measure the properties of the Higgs boson and probe potential new physics associated with the Higgs boson. The Circular Electron Positron Collider~(CEPC) is one of such proposed Higgs factories. The CEPC is an $e^+e^-$ circular collider proposed by and to be hosted in China. Located in a tunnel of approximately 100~km in circumference, it will operate at a center-of-mass energy of 240~GeV as the Higgs factory. In this paper, we present the first estimates on the precision of the Higgs boson property measurements achievable at the CEPC and discuss implications of these measurements.Comment: 46 pages, 37 figure

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe