H2O+: An Improved Framework for Hybrid Offline-and-Online RL with Dynamics Gaps

Solving real-world complex tasks using reinforcement learning (RL) without high-fidelity simulation environments or large amounts of offline data can be quite challenging. Online RL agents trained in imperfect simulation environments can suffer from severe sim-to-real issues. Offline RL approaches although bypass the need for simulators, often pose demanding requirements on the size and quality of the offline datasets. The recently emerged hybrid offline-and-online RL provides an attractive framework that enables joint use of limited offline data and imperfect simulator for transferable policy learning. In this paper, we develop a new algorithm, called H2O+, which offers great flexibility to bridge various choices of offline and online learning methods, while also accounting for dynamics gaps between the real and simulation environment. Through extensive simulation and real-world robotics experiments, we demonstrate superior performance and flexibility over advanced cross-domain online and offline RL algorithms

Puerarin protects renal ischemia-reperfusion injury in rats through NLRP3/Caspase-1/GSDMD pathway

ABSTRACT Purpose: To observe the effect of puerarin on renal ischemia-reperfusion (I/R) injury in rats, and to explore its mechanism based on NLRP3/Caspase-1/GSDMD pathway. Methods: Twenty-one Sprague-Dawley rats were divided into three groups: sham-operated group (sham), model group (RIRI), and puerarin treatment group (RIRI + Pue). The model of acute renal I/R injury was established by cutting the right kidney and clamping the left renal pedicle for 45 min. Results: Renal function parameters were statistically significant in group comparisons. The renal tissue structure of rats in sham group was basically normal. Pathological changes were observed in the RIRI group. The renal pathological damage score and apoptosis rate in the RIRI group were higher than those in the sham group, and significantly lower in the RIRI + Pue group than in the RIRI group. Indicators of oxidative stress–superoxide dismutase, malondialdehyde, and glutathione peroxidase–were statistically significant in group comparisons. Compared with the sham group, the relative expressions of NLRP3, Caspase-1 and GSDMD proteins in the RIRI group were increased. Compared with the RIRI group, the RIRI + Pue group had significant reductions. Conclusions: Puerarin can inhibit the activation of NLRP3/Caspase-1/GSDMD pathway, inhibit inflammatory response and pyroptosis, and enhance the antioxidant capacity of kidney, thereby protecting renal I/R injury in rats

Well-Being and COVID-19 Anxiety: A Three-Wave Longitudinal Study in China

Background: The coronavirus disease 2019 (COVID-19) pandemic threatens human beings’ livelihoods and mental health, which lowers their well-being and gives rise to anxiety. This study examines whether there is a causal relationship between people’s well-being and COVID-19 anxiety. Method: 222 participants (54.50% female, Mage = 31.53, SD = 8.17) from 26 provinces of China completed measures of well-being and COVID-19 anxiety at three key nodes of the development of COVID-19 in China. Results: The results showed that people’s well-being and COVID-19 anxiety fluctuated with the peak, decline and trough stages of the COVID-19 pandemic. Meanwhile, the cross-lagged analysis showed that the participants’ well-being at Time 1 significantly predicted their COVID-19 anxiety at Time 2. However, well-being at Time 2 was not associated with the COVID-19 anxiety at Time 3. Furthermore, COVID-19 anxiety could not predict subsequent well-being. Conclusions: People’s well-being and COVID-19 anxiety fluctuated with the development of the COVID-19 pandemic and people’s well-being at the peak stage of the COVID-19 pandemic predicted their subsequent anxiety. The current findings contribute to clarifying the causal relationship between well-being and anxiety, as well as finding ways to alleviate people’s COVID-19 anxiety

A multifunctional hydrogel fabricated via ultra-fast polymerization by graphene oxide-adsorbed liquid metal nanodroplets

Graphene structures have never been found to play a role in accelerating fabrication of functional hydrogels. In this work, it is initially discovered that multifunctional hydrogels are fabricated via ultra-fast polymerization (∼minutes) by graphene oxide-adsorbed liquid metal nanodroplets (LMNPs@GO) vs. by conventional approaches (∼hours/days). LMNPs@GO are used to rapidly initiate and further cross-link polyacrylic acid (PAA) chains into a three-dimensional (3D) network without any extra molecular initiators, cross-linkers, heat source, and/or protective gas. The polymerization process with LMNPs@GO is extremely faster than that without GO involved (20 s vs. 4 h of prepolymer formation, and then 10 min vs. 3 days of crosslinking) for free radical polymerization of PAA hydrogels. The resulting hydrogel with 2 wt% reduced graphene oxide (rGO) exhibits 600% increase in tensile strength and 950% enhancement in conductivity, as well as excellent self-healing capabilities, in comparison with that of the pure PAA. The sensitivity studies show its great potential for the application of flexible sensors. Furthermore, the hydrogel possesses good dissolving properties, which is greatly beneficial for recyclability of the LM. This creative study not only broadens a novel application of graphene for making advanced multifunctional polymer materials, but also provides a brand-new route to realization of ultra-fast manufacturing technology that is significantly promising for industrial production in wearable devices

CEPC Technical Design Report -- Accelerator

International audienceThe Circular Electron Positron Collider (CEPC) is a large scientific project initiated and hosted by China, fostered through extensive collaboration with international partners. The complex comprises four accelerators: a 30 GeV Linac, a 1.1 GeV Damping Ring, a Booster capable of achieving energies up to 180 GeV, and a Collider operating at varying energy modes (Z, W, H, and ttbar). The Linac and Damping Ring are situated on the surface, while the Booster and Collider are housed in a 100 km circumference underground tunnel, strategically accommodating future expansion with provisions for a Super Proton Proton Collider (SPPC). The CEPC primarily serves as a Higgs factory. In its baseline design with synchrotron radiation (SR) power of 30 MW per beam, it can achieve a luminosity of 5e34 /cm^2/s^1, resulting in an integrated luminosity of 13 /ab for two interaction points over a decade, producing 2.6 million Higgs bosons. Increasing the SR power to 50 MW per beam expands the CEPC's capability to generate 4.3 million Higgs bosons, facilitating precise measurements of Higgs coupling at sub-percent levels, exceeding the precision expected from the HL-LHC by an order of magnitude. This Technical Design Report (TDR) follows the Preliminary Conceptual Design Report (Pre-CDR, 2015) and the Conceptual Design Report (CDR, 2018), comprehensively detailing the machine's layout and performance, physical design and analysis, technical systems design, R&D and prototyping efforts, and associated civil engineering aspects. Additionally, it includes a cost estimate and a preliminary construction timeline, establishing a framework for forthcoming engineering design phase and site selection procedures. Construction is anticipated to begin around 2027-2028, pending government approval, with an estimated duration of 8 years. The commencement of experiments could potentially initiate in the mid-2030s

CEPC Technical Design Report -- Accelerator

International audienceThe Circular Electron Positron Collider (CEPC) is a large scientific project initiated and hosted by China, fostered through extensive collaboration with international partners. The complex comprises four accelerators: a 30 GeV Linac, a 1.1 GeV Damping Ring, a Booster capable of achieving energies up to 180 GeV, and a Collider operating at varying energy modes (Z, W, H, and ttbar). The Linac and Damping Ring are situated on the surface, while the Booster and Collider are housed in a 100 km circumference underground tunnel, strategically accommodating future expansion with provisions for a Super Proton Proton Collider (SPPC). The CEPC primarily serves as a Higgs factory. In its baseline design with synchrotron radiation (SR) power of 30 MW per beam, it can achieve a luminosity of 5e34 /cm^2/s^1, resulting in an integrated luminosity of 13 /ab for two interaction points over a decade, producing 2.6 million Higgs bosons. Increasing the SR power to 50 MW per beam expands the CEPC's capability to generate 4.3 million Higgs bosons, facilitating precise measurements of Higgs coupling at sub-percent levels, exceeding the precision expected from the HL-LHC by an order of magnitude. This Technical Design Report (TDR) follows the Preliminary Conceptual Design Report (Pre-CDR, 2015) and the Conceptual Design Report (CDR, 2018), comprehensively detailing the machine's layout and performance, physical design and analysis, technical systems design, R&D and prototyping efforts, and associated civil engineering aspects. Additionally, it includes a cost estimate and a preliminary construction timeline, establishing a framework for forthcoming engineering design phase and site selection procedures. Construction is anticipated to begin around 2027-2028, pending government approval, with an estimated duration of 8 years. The commencement of experiments could potentially initiate in the mid-2030s

CEPC Technical Design Report -- Accelerator

International audienceThe Circular Electron Positron Collider (CEPC) is a large scientific project initiated and hosted by China, fostered through extensive collaboration with international partners. The complex comprises four accelerators: a 30 GeV Linac, a 1.1 GeV Damping Ring, a Booster capable of achieving energies up to 180 GeV, and a Collider operating at varying energy modes (Z, W, H, and ttbar). The Linac and Damping Ring are situated on the surface, while the Booster and Collider are housed in a 100 km circumference underground tunnel, strategically accommodating future expansion with provisions for a Super Proton Proton Collider (SPPC). The CEPC primarily serves as a Higgs factory. In its baseline design with synchrotron radiation (SR) power of 30 MW per beam, it can achieve a luminosity of 5e34 /cm^2/s^1, resulting in an integrated luminosity of 13 /ab for two interaction points over a decade, producing 2.6 million Higgs bosons. Increasing the SR power to 50 MW per beam expands the CEPC's capability to generate 4.3 million Higgs bosons, facilitating precise measurements of Higgs coupling at sub-percent levels, exceeding the precision expected from the HL-LHC by an order of magnitude. This Technical Design Report (TDR) follows the Preliminary Conceptual Design Report (Pre-CDR, 2015) and the Conceptual Design Report (CDR, 2018), comprehensively detailing the machine's layout and performance, physical design and analysis, technical systems design, R&D and prototyping efforts, and associated civil engineering aspects. Additionally, it includes a cost estimate and a preliminary construction timeline, establishing a framework for forthcoming engineering design phase and site selection procedures. Construction is anticipated to begin around 2027-2028, pending government approval, with an estimated duration of 8 years. The commencement of experiments could potentially initiate in the mid-2030s

CEPC Technical Design Report -- Accelerator

The Circular Electron Positron Collider (CEPC) is a large scientific project initiated and hosted by China, fostered through extensive collaboration with international partners. The complex comprises four accelerators: a 30 GeV Linac, a 1.1 GeV Damping Ring, a Booster capable of achieving energies up to 180 GeV, and a Collider operating at varying energy modes (Z, W, H, and ttbar). The Linac and Damping Ring are situated on the surface, while the Booster and Collider are housed in a 100 km circumference underground tunnel, strategically accommodating future expansion with provisions for a Super Proton Proton Collider (SPPC). The CEPC primarily serves as a Higgs factory. In its baseline design with synchrotron radiation (SR) power of 30 MW per beam, it can achieve a luminosity of 5e34 /cm^2/s^1, resulting in an integrated luminosity of 13 /ab for two interaction points over a decade, producing 2.6 million Higgs bosons. Increasing the SR power to 50 MW per beam expands the CEPC's capability to generate 4.3 million Higgs bosons, facilitating precise measurements of Higgs coupling at sub-percent levels, exceeding the precision expected from the HL-LHC by an order of magnitude. This Technical Design Report (TDR) follows the Preliminary Conceptual Design Report (Pre-CDR, 2015) and the Conceptual Design Report (CDR, 2018), comprehensively detailing the machine's layout and performance, physical design and analysis, technical systems design, R&D and prototyping efforts, and associated civil engineering aspects. Additionally, it includes a cost estimate and a preliminary construction timeline, establishing a framework for forthcoming engineering design phase and site selection procedures. Construction is anticipated to begin around 2027-2028, pending government approval, with an estimated duration of 8 years. The commencement of experiments could potentially initiate in the mid-2030s