MA2CL:Masked Attentive Contrastive Learning for Multi-Agent Reinforcement Learning

Recent approaches have utilized self-supervised auxiliary tasks as representation learning to improve the performance and sample efficiency of vision-based reinforcement learning algorithms in single-agent settings. However, in multi-agent reinforcement learning (MARL), these techniques face challenges because each agent only receives partial observation from an environment influenced by others, resulting in correlated observations in the agent dimension. So it is necessary to consider agent-level information in representation learning for MARL. In this paper, we propose an effective framework called \textbf{M}ulti-\textbf{A}gent \textbf{M}asked \textbf{A}ttentive \textbf{C}ontrastive \textbf{L}earning (MA2CL), which encourages learning representation to be both temporal and agent-level predictive by reconstructing the masked agent observation in latent space. Specifically, we use an attention reconstruction model for recovering and the model is trained via contrastive learning. MA2CL allows better utilization of contextual information at the agent level, facilitating the training of MARL agents for cooperation tasks. Extensive experiments demonstrate that our method significantly improves the performance and sample efficiency of different MARL algorithms and outperforms other methods in various vision-based and state-based scenarios. Our code can be found in \url{https://github.com/ustchlsong/MA2CL

Microglia and Microglia-Like Cell Differentiated from DC Inhibit CD4 T Cell Proliferation

The central nervous system (CNS) is generally regarded as a site of immune privilege, whether the antigen presenting cells (APCs) are involved in the immune homeostasis of the CNS is largely unknown. Microglia and DCs are major APCs in physiological and pathological conditions, respectively. In this work, primary microglia and microglia-like cells obtained by co-culturing mature dendritic cells with CNS endothelial cells in vitro were functional evaluated. We found that microglia not only cannot prime CD4 T cells but also inhibit mature DCs (maDCs) initiated CD4 T cells proliferation. More importantly, endothelia from the CNS can differentiate maDCs into microglia-like cells (MLCs), which possess similar phenotype and immune inhibitory function as microglia. Soluble factors including NO lie behind the suppression of CD4 T cell proliferation induced by both microglia and MLCs. All the data indicate that under physiological conditions, microglia play important roles in maintaining immune homeostasis of the CNS, whereas in a pathological situation, the infiltrated DCs can be educated by the local microenvironment and differentiate into MLCs with inhibitory function

A acalculia case of mathematical concepts deficits from multiple lacunar infarction

This paper presents a acalculia case of mathematical concepts deficits from multiple lacunar infarction. The patient (ZHL) presented intact number processing and calculation skills except mathematical concepts deficits; the patient was also able to complete concept formation assessment. We discussed these symptoms in the context of the currently most accepted cognitive model: Triple-code model which attempts to illustrate the cognitive mechanisms underlying number processing and calculation skills. © 2017 IEEE

Antimicrobial Resistance and Molecular Epidemiology of ESBL-Producing Escherichia coli Isolated from Outpatients in Town Hospitals of Shandong Province, China

This study aimed to investigate antimicrobial resistance and molecular epidemiology of extended-spectrum β-lactamase (ESBL)-producing Escherichia coli (E. coli) isolated from outpatients in town hospitals of Shandong province, China. Antimicrobial susceptibility of ESBL-producing E. coli was tested using the disk diffusion and resistance genes encoding for β-lactamases (blaTEM, blaCTXM, and blaSHV) were detected by polymerase chain reaction (PCR). Multilocus sequence typing (ST) of ESBL-producing E. coli was analyzed in this study. Our results showed that of 320 E. coli isolates, 201 carried ESBL genes (201/320, 62.8%), and these isolates all carried blaCTX-M genes, the most common being blaCTX-M-14 (116/201, 57.7%), followed by blaCTX-M-55 (47/201, 23.4%) and blaCTX-M-15 (31/201, 15.4%). ESBL-producing E. coli exhibited highly resistant to penicillin derivatives, fluoroquinolones, folate pathway inhibitors, and third-generation cephalosporins, but no carbapenem-resistant isolates were found in this study. Forty-two STs were found among the 201 ESBL-producing E. coli, and the most common ST was ST131 (27/201, 13.4%), followed by ST405 (19/201, 9.5%) and ST69 (15/201, 7.5%). Taken together, a high isolation rate of ESBL-producing E. coli (62.8%) was found among outpatients in town hospitals. blaCTX-M gene was most dominant and was composed of a variety of subtypes. No dominant ST was detected among ESBL-producing E. coli, indicating that these ESBL-producing E. coli isolates derive from different clones

A collaborative collision avoidance strategy for autonomous ships under mixed scenarios

Ship collision avoidance has always been one of the classic topics in the field of marine research. In traditional encounter situations, officers on watch (OOWs) usually use a very high frequency (VHF) radio to coordinate each other. In recent years, with the continuous development of autonomous ships, there will be a mixed situation where ships of different levels of autonomy coexist at the same time. Under such a scenario, different decision makers have different perceptions of the current scene and different decision-making logic, so conventional collision avoidance methods may not be applicable. Therefore, this paper proposes a collaborative collision avoidance strategy for multi-ship collision avoidance under mixed scenarios. It builds a multi-ship cooperative network to determine cooperative objects and timing, at the same time. Based on a cooperative game model, a global collision avoidance responsibility distribution that satisfies group rationality and individual rationality is realised, and finally achieves a collaborative strategy according to the generalised reciprocal velocity obstacle (GRVO) algorithm. Case studies show that the strategy proposed in this paper can make all ships pass each other clearly and safely

Is proximal tibial tubercle osteotomy superior to distal tibial tubercle osteotomy for medial compartmental osteoarthritis? A meta-analysis

Abstract Background Open-wedge high tibial osteotomy (OWHTO) is commonly performed for the treatment of medial compartment knee osteoarthritis (KOA), and is classified into proximal tibial tubercle osteotomy (PTO) and distal tibial tubercle osteotomy (DTO). The PTO osteotomy point is generally located about 3–4 cm below the joint of the proximal tibia, and the osteotomy line points to the upper part of the proximal tibiofibular joint. The DTO osteotomy point is generally located about 0.5–1.0 cm below the tibial tubercle, and the osteotomy line points to the contralateral cortex. However, there is currently no consensus on which surgical technique is superior. The purpose of our study was to investigate which among the two is superior for medial KOA, with respect to knee joint parameters, clinical function, and complications. Methods This study was conducted as per the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. The Cochrane Central Library, MEDLINE, Embase, PubMed, CNKI, and WanFang databases were systematically searched for trials comparing PTO and DTO in patients with medial compartment KOA, from inception until March 2022. The meta-analysis was conducted using RevMan 5.2 software. The Cochrane risk-of-bias tool was used to assess methodological quality. Statistical analysis was performed with Stata 12.0. Outcomes of interest included the Insall-Salvati index (ISI), Caton-Deschamps index (CDI), Blackburne-Peel index (BPI), posterior tibial slope (PTS), and the Hospital for Special Surgery (HSS) knee-rating scale. Results A total of 15 retrospective studies (910 knees) were included. There were no significant differences in the age or sex of included patients. There was a significant difference in the ISI, CDI, BPI, and PTS between the two groups (all p ≤ 0.05). Further, DTO was associated with a significantly greater number of postoperative complications (p  0.05). Conclusions Compared with DTO, PTO is associated with a greater incidence of postoperative patella baja and increased PTS, whereas DTO is associated with more postoperative complications. Nevertheless, both can significantly correct knee varus deformity and improve knee function; their early knee function scores are also similar. Trial Registration. Prospective Register of Systematic Reviews (PROSPERO) registration number CRD42021284443

Experimental and Simulation Research of AC Ripple Losses in a High Temperature Superconductor Tape

Current leads in superconducting magnets are widely adopted for heavy current transmission, and HTS DC cables have great advantages when used as current leads for such purposes. However, as an important parameter of HTS DC cables, AC loss has a strong impact on the stability and operation cost of current leads. In this paper, experiments were conducted to measure AC ripple losses of HTS tapes and HTS cables, and simulations of HTS tapes were carried out. The paper has reached conclusions on the relation between AC losses and power frequencies