Fact-based Agent modeling for Multi-Agent Reinforcement Learning

In multi-agent systems, agents need to interact and collaborate with other agents in environments. Agent modeling is crucial to facilitate agent interactions and make adaptive cooperation strategies. However, it is challenging for agents to model the beliefs, behaviors, and intentions of other agents in non-stationary environment where all agent policies are learned simultaneously. In addition, the existing methods realize agent modeling through behavior cloning which assume that the local information of other agents can be accessed during execution or training. However, this assumption is infeasible in unknown scenarios characterized by unknown agents, such as competition teams, unreliable communication and federated learning due to privacy concerns. To eliminate this assumption and achieve agent modeling in unknown scenarios, Fact-based Agent modeling (FAM) method is proposed in which fact-based belief inference (FBI) network models other agents in partially observable environment only based on its local information. The reward and observation obtained by agents after taking actions are called facts, and FAM uses facts as reconstruction target to learn the policy representation of other agents through a variational autoencoder. We evaluate FAM on various Multiagent Particle Environment (MPE) and compare the results with several state-of-the-art MARL algorithms. Experimental results show that compared with baseline methods, FAM can effectively improve the efficiency of agent policy learning by making adaptive cooperation strategies in multi-agent reinforcement learning tasks, while achieving higher returns in complex competitive-cooperative mixed scenarios

Gender and Grade Differences in Knowledge and Behaviors Related to Active Living for Adolescents

The purpose of this study was to examine differences by gender and grade in middle school students’ physical activity and fitness (PAF) knowledge, physical activity, and sedentary behavior (SB). The study took place at one middle school located in the Southeastern region of the United States. Boys (n = 136) and girls (n = 166) in 6th (n =129), 7th (n = 96) and 8th (n = 77) completed a PE Metrics written test to assess PAF knowledge. They (N = 312) also completed the validated Youth Activity Profile to report physical activity at school (PAS), physical activity at home (PAH), and SB. Two-way (gender by grade) multivariate analysis of variances (MANOVA) followed by Bonferroni post-hoc multiple comparison analysis were conducted. Box’s M test of covariance matrices showed no statistical violation (M = 37.78, F = .73, p \u3e .05). The two-way MANOVA showed significant gender (Wilks’s λ = .94, F = 4.40, p \u3c .01, N(2/p) \u3c .06) and grade main effects (Wilks’s λ = .89, F = 4.20, p \u3c .01, N(2/p) \u3c .05). No significant gender by grade interaction effect was detected (p \u3e .05). Subsequent tests of between subjects effect located the significant gender difference in PAS favoring boys (F = 9.3, p \u3c .01, N(2/p) = .03). Boys and girls showed no significant difference on PAF knowledge, PAH, and SB. Significant grade differences were observed for PAS (F = 8.57, p \u3c .01, N(2/p) =.06), PAH (F = 8.18, p \u3c .01, N(2/p) =.05), and SB (F = 4.61, p = .01, N(2/p) \u3e = .03). Sixth grade students showed significantly higher levels of PAS and PAH than 7th and 8th grade students (p \u3c .05 or \u3c .01). Sixth grade students further showed significantly lower SB than 7th grade students (p \u3c .05). This study found boys to be more physically active during school hours than girls, and students in lower grades to be more active than higher grade students. Future school-based interventions should take into account gender and grade-based differences

NUMERICAL ANALYSIS OF VALVE STRUCTURE OF HIGH POWER MARINE ENGINE

Valve as an important part of the gas distribution mechanism, is an crucial part of the engine. When the engine works, the valve is subjected to high temperature, high impact, frictional wear and corrosion and other harsh working conditions, and the reliable and durable valve has an important impact on the safety and reliability of the engine. In this paper, a model of four-stroke marine diesel engine valve is used as the research object, and the intake valve set and exhaust valve set models are established respectively. Heat transfer simulation and failure analysis of inlet and exhaust valves of different structures and materials under different operating conditions were carried out using finite element analysis. The results show that the different valve structures and manufacturing materials have different effects on the reliability of the valves; Changing the valve structures and choosing different valve manufacturing materials have a greater impact on the heat transfer and deformation, thus affecting the overall reliability of the valves

Monitoring and predicting drought based on multiple indicators in an arid area, China

Droughts are one of the costliest natural disasters. Reliable drought monitoring and prediction are valuable for drought relief management. This study monitors and predicts droughts in Xinjiang, an arid area in China, based on the three drought indicators, i.e., the Standardized Precipitation Index (SPI), the Standardized Soil Moisture Index (SSMI) and the Multivariate Standardized Drought Index (MSDI). Results indicate that although these three indicators could capture severe historical drought events in the study area, the spatial coverage, persistence and severity of the droughts would vary regarding different indicators. The MSDI could best describe the overall drought conditions by incorporating the characteristics of the SPI and SSMI. For the drought prediction, the predictive skill of all indicators gradually decayed with the increasing lead time. Specifically, the SPI only showed the predictive skill at a 1-month lead time, the MSDI performed best in capturing droughts at 1- to 2-month lead times and the SSMI was accurate up to a 3-month lead time owing to its high persistence. These findings might provide scientific support for the local drought management

Magnetic field-modulated exciton generation in organic semiconductors: an intermolecular quantum correlation effect

Magnetoelectroluminescence (MEL) of organic semiconductor has been experimentally tuned by adopting blended emitting layer consisting of both hole and electron transporting materials. A theoretical model considering intermolecular quantum correlation is proposed to demonstrate two fundamental issues: (1) two mechanisms, spin scattering and spin mixing, dominate the two different steps respectively in the process of the magnetic field modulated generation of exciton; (2) the hopping rate of carriers determines the intensity of MEL. Calculation successfully predicts the increase of singlet excitons in low field with little change of triplet exciton population.Comment: 16 pages, 4 figure

The changes of cardiac energy metabolism with sodium-glucose transporter 2 inhibitor therapy

Background/aimsTo investigate the specific effects of s odium-glucose transporter 2 inhibitor (SGLT2i) on cardiac energy metabolism.MethodsA systematic literature search was conducted in eight databases. The retrieved studies were screened according to the inclusion and exclusion criteria, and relevant information was extracted according to the purpose of the study. Two researchers independently screened the studies, extracted information, and assessed article quality.ResultsThe results of the 34 included studies (including 10 clinical and 24 animal studies) showed that SGLT2i inhibited cardiac glucose uptake and glycolysis, but promoted fatty acid (FA) metabolism in most disease states. SGLT2i upregulated ketone metabolism, improved the structure and functions of myocardial mitochondria, alleviated oxidative stress of cardiomyocytes in all literatures. SGLT2i increased cardiac glucose oxidation in diabetes mellitus (DM) and cardiac FA metabolism in heart failure (HF). However, the regulatory effects of SGLT2i on cardiac FA metabolism in DM and cardiac glucose oxidation in HF varied with disease types, stages, and intervention duration of SGLT2i.ConclusionSGLT2i improved the efficiency of cardiac energy production by regulating FA, glucose and ketone metabolism, improving mitochondria structure and functions, and decreasing oxidative stress of cardiomyocytes under pathological conditions. Thus, SGLT2i is deemed to exert a benign regulatory effect on cardiac metabolic disorders in various diseases.Systematic review registrationhttps://www.crd.york.ac.uk/, PROSPERO (CRD42023484295)

Bioengineered human tissue regeneration and repair using endogenous stem cells

We describe a general approach to produce bone and cartilaginous structures utilizing the self-regenerative capacity of the intercostal rib space to treat a deformed metacarpophalangeal joint and microtia. Anatomically precise 3D molds were positioned on the perichondro-periosteal or perichondral flap of the intercostal rib without any other exogenous elements. We find anatomically precise metacarpal head and auricle constructs within the implanted molds after 6 months. The regenerated metacarpal head was used successfully to surgically repair the deformed metacarpophalangeal joint. Auricle reconstructive surgery in five unilateral microtia patients yielded good aesthetic and functional results. Long-term follow-up revealed the auricle constructs were safe and stable. Single-cell RNA sequencing analysis reveal early infiltration of a cell population consistent with mesenchymal stem cells, followed by IL-8-stimulated differentiation into chondrocytes. Our results demonstrate the repair and regeneration of tissues using only endogenous factors and a viable treatment strategy for bone and tissue structural defects.</p

An Investigation of an Acute Gastroenteritis Outbreak: Cronobacter sakazakii, a Potential Cause of Food-Borne Illness

Whole genome sequencing (WGS) has been widely used in traceability of food-borne outbreaks nowadays. Here, an interesting connection between Cronobacter sakazakii and food-borne acute gastroenteritis (AGE) was noticed. In October 2016, an AGE outbreak affecting 156 cases occurred in a local senior high school. Case-control study including 70 case-patients and 295 controls indicated a strong association between eating supper at school canteen of the outbreak onset and AGE, as revealed by the Odds Ratio (OR: 95.32). Six recovered Cronobacter strains were evaluated and compared using pulsed-field gel electrophoresis (PFGE), multilocus sequence typing (MLST) and WGS. A phylogenetic tree of whole genomic single nucleotide polymorphisms (wgSNPs) were generated to traceback the potential contamination source in this outbreak. C. sakazakii isolates S2 from a patient’s rectal swab and S4 from leftover food sample shared identical PFGE pattern and sequence type (ST73), and clustered tightly together in the SNP phylogenetic tree. C. sakazakii isolates S5 and S6 from food delivery containers were both ST4 but with different PFGE patterns. Cronobacter isolates S1 and S3 from two patients’ rectal swab were sequenced to be C. malonaticus and shared another PFGE pattern (ST567). The interesting feature of this study was the implication of C. sakazakii as a causative agent in food-borne AGE occurring in healthy adults, although C. sakazakii is considered as an opportunistic pathogen and generally affects neonates, infants and immunocompromised adults