A Comparative Study on Regularization Strategies for Embedding-based Neural Networks

This paper aims to compare different regularization strategies to address a common phenomenon, severe overfitting, in embedding-based neural networks for NLP. We chose two widely studied neural models and tasks as our testbed. We tried several frequently applied or newly proposed regularization strategies, including penalizing weights (embeddings excluded), penalizing embeddings, re-embedding words, and dropout. We also emphasized on incremental hyperparameter tuning, and combining different regularizations. The results provide a picture on tuning hyperparameters for neural NLP models.Comment: EMNLP '1

Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Path

Relation classification is an important research arena in the field of natural language processing (NLP). In this paper, we present SDP-LSTM, a novel neural network to classify the relation of two entities in a sentence. Our neural architecture leverages the shortest dependency path (SDP) between two entities; multichannel recurrent neural networks, with long short term memory (LSTM) units, pick up heterogeneous information along the SDP. Our proposed model has several distinct features: (1) The shortest dependency paths retain most relevant information (to relation classification), while eliminating irrelevant words in the sentence. (2) The multichannel LSTM networks allow effective information integration from heterogeneous sources over the dependency paths. (3) A customized dropout strategy regularizes the neural network to alleviate overfitting. We test our model on the SemEval 2010 relation classification task, and achieve an $F_1$-score of 83.7\%, higher than competing methods in the literature.Comment: EMNLP '1

Effect of heat treatment on microstructure and mechanical properties of Fe60 coating by laser cladding on 304 stainless steel

Heat treatment has a direct effect on the microstructure and mechanical properties of laser cladding coatings. To investigate the influence of heat treatment on the microstructure and mechanical properties of Fe60 coating, the surface of 304 stainless steel was coated with Fe60 coating by laser cladding technology, and then normalizing treatments were conducted on the coatings at temperatures of 950 °C, 1000 °C, and 1050 °C, as well as a solution treatment at 1050 °C. The microstructure and phase composition of the coatings before and after heat treatment were analyzed using optical microscopy (OM), scanning electron microscopy (SEM), and X-ray diffractometry (XRD). In addition, the microhardness, tensile properties, and impact toughness of the coating were evaluated through experimental testing. Furthermore, SEM examination was performed to observe the tensile fracture morphology with subsequent analysis. The results show that no phase transition occurs in the coatings after heat treatment. Subsequent to normalizing treatments, the grains are gradually refined with the increase of normalizing temperature. Solution treatment leads to grain refinement in the coating and significantly eliminates precipitated phases. The heat treatment effectively reduces residual stress and lattice distortion in the coating, which reduces the microhardness and significantly improves tensile properties and impact resistance at the same time. Observation of the tensile fracture microstructure reveals ductile dimple fractures in the substrate and brittle cleavage fractures within the coated region. The results can provide a valuable reference for enhancing the mechanical properties of Fe60 coatings by laser cladding

Thermal Stability of Gel Foams Stabilized by Xanthan Gum, Silica Nanoparticles and Surfactants

The foams stabilized by nanoparticles (NPs), water-soluble polymers, and surfactants have potential application prospects in the development of new, environmentally friendly firefighting foams. In the present study, a gel foam containing a water-soluble polymer (xanthan gum, XG), hydrophilic silica NPs, hydrocarbon surfactant (SDS), and fluorocarbon surfactant (FS-50) were prepared. The surface activity, conductivity, viscosity, and foaming ability of foam dispersions were characterized. The gel foam stability under a radiation heat source and temperature distribution in the vertical foam layer were evaluated systematically. The results show that the addition of NPs and XG has a significant effect on the foaming ability, viscosity and foam thermal stability, but has a very subtle effect on the conductivity and surface activity. The foaming ability of the FS-50/SDS solution was enhanced by the addition of NPs, but decreased with increasing the XG concentration. The thermal stability of the foams stabilized by SDS/FS-50/NPs/XG increased with the addition of NPs and increasing XG concentration. Foam drainage and coarsening were significantly decelerated by the addition of NPs and XG. The slower foam drainage and coarsening are the main reason for the intensified foam thermal stability. The results obtained from this study can provide guidance for developing new firefighting foams

Study on Thermal Stability of Gel Foam Co-Stabilized by Hydrophilic Silica Nanoparticles and Surfactants

The combination of nanoparticles (NP) and surfactant has been intensively studied to improve the thermal stability and optimize the performance of foams. This study focuses on the influence of silica NPs with different concentration on the thermal stability of gel foams based on a mixture of fluorocarbon (FS-50) and hydrocarbon (APG0810) surfactants. The surface activity, conductivity, viscosity, and foaming ability of the APG0810/FS-50/NPs dispersions are characterized. The effects of NP concentration on coarsening, drainage, and decay, as well as of the gel foams under thermal action, are systematically studied. Results show that NP concentration has a significant effect on the molecular interactions of the APG0810/FS-50/NP dispersions. The surface tension and conductivity of the dispersions decrease but the viscosity increases with the increase in NP concentration. The foaming ability of APG0810/FS-50 solution is reduced by the addition of NPs and decreases with the increase in NP concentration. The coarsening, drainage, and decay of the gel foams under thermal action slow down significantly with increasing NP concentration. The thermal stability of the gel foams increases with the addition of NPs and further increases with the increase in NP concentration. This study provides a theoretical guidance for the application for gel foams containing NPs and surfactants in fire-extinguishing agents

Synthesis and F-18-labeling of the analogues of Omecamtiv Mecarbil as a potential cardiac myosin imaging agent with PET

National Natural Science Foundation of China [21271030, 20871020]; Fundamental Research Funds for the Central Universities of China; Beijing Natural Science Foundation [2092018]Introduction: Cardiac myosin is a potential molecular target for heart failure imaging since its changes can be used to assess the function of heart. In this study, two analogues of Omecamtiv Mecarbil, which is the first selective activator of cardiac myosin, were synthesized and radio-labeled with F-18. Then the radio-compounds were evaluated as potential cardiac myosin imaging agent. Methods: The labeling precursor and the nonradioactive compounds were synthesized and characterized by IR, H-1 NMR, C-13 NMR and MS analysis. By substituting bromo of precursors with F-18, the radiolabeled compounds [F-18]8 and [F-18]10 were prepared and further evaluated for their in vitro physicochemical properties, stabilities, protein binding assay and ex vivo biodistribution. Results: Starting with [F-18]F- Kryptofix 2.2.2./K2CO3 solution, the total reaction time for [F-18]8 and [F-18]10 was about 40 min respectively, with final high-performance liquid chromatography purification included. Typical decay-corrected radiochemical yield stayed at 12.47% +/- 3.30% (n = 8), the radiochemical purity, 98% or more. Their specific activity was estimated as 50 GBq/mu mol. Both [F-18]8 and [F-18]10 could be stable after incubation in water at room temperature and in serum or binding buffer at 37 degrees C for 3 h. Biodistribution in normal mice showed that both [F-18]8 and [F-18]10 have good heart uptake at 2 min post-injection time. Compound [F-18]10 has better heart retention and higher heart to background ratios than those of [F-18]8. In vitro protein binding assay demonstrates that [F-18]10 may have high affinity with myosin from bovine heart. Conclusion: [F-18]8 and [F-18]10 were synthesized with good radiochemical yield and high radiochemical purity (>98%). One of the compounds ([F-18]10) has higher bovine heart myosin binding affinity and better heart/liver ratio. It will be further evaluated as a potent cardiac myosin imaging agent in normal and systolic heart failure model with positron emission tomography in the future. (C) 2013 Elsevier Inc. All rights reserved

Human-elephant conflict in Xishuangbanna Prefecture, China: Distribution, diffusion, and mitigation

The conflict between humans and wild animals is a special type of phenomena between human development and wild animal conservation, not only leading to massive economic loss to local residents, but also imposing severe impacts upon the production and living activities and even personal safety of the residents. Human-elephant conflict has existed as a phenomenon of human settlement development for more than 20 years in Xishuangbanna, China. There are periodic incidents of wild elephants hurting/killing people as well as feeding on and destroying subsistence and cash crops. It is an increasingly urgent and important issue for China to resolve while protecting and managing Asian elephants. Our study employed an Ecological-Niche Factor Analysis model to perform a risk assessment of areas where the Asian elephant currently is distributed and to predict future risks. It employed a Circuit Theory model based on random walk theory to predict multiple potential movement or migration pathways of Asian elephants within Xishuangbanna. The results indicated that: (1) the regions with human-elephant conflict risk in Xishuangbanna Prefecture had an area of about 4349.08 km2, accounting for 22.77% of the total prefecture area, with the risk regions primarily present in the middle and north parts of Menghai County and Jinghong City and in Mengla County in which there was a wide geographical distribution covering from the south to the north; (2) The regions of agriculture and garden that were close to Asian elephant distribution and roads were likely occurring risk; (3) There were more potential movement paths of elephants within Mengyang and Menghai distribution regions, which indicated that the connection of these areas was better. While the potential movement paths of elephants within Mengla and Shangyong were little; (4) There were some potential movement paths between different distribution areas of Asian elephant, but the migration possibility of elephants in different distribution areas was decreasing due to natural barriers (Mengyang-Menghai has Lancang river) and discontinuous potential paths between Mengla and Shangyong. Additionally, we discussed that created ecological corridors between different natural reserves to allow more dispersal and gene flow of elephants and diminish conflict between human and elephant. We also put forward compensation suggestions in different risk area. We hope our analytical methods can be applied, improved and expanded to other areas with similar wildlife damage. Keywords: Compensation, Movement paths, Human-elephant conflict, Insurance schemes, Risk assessment, Wildlife damag

Bone-Differentiation-Associated Circ-Spen Regulates Death of Mouse Bone Marrow Mesenchymal Stem Cells by Inhibiting Apoptosis and Promoting Autophagy

The role of estrogen receptor β (ERβ) in bone health is closely associated with its function in vivo, and ERβ−/− mice have been widely utilized to explore the related influences. In this study, ERβ−/− female mice were established to investigate the differential expression of circular RNAs (circRNAs) by RNA-Sequencing (RNA-Seq). Among these circRNAs, mmu_circ_0011379 (named Circ-Spen) exhibited high expression in ERβ−/− female mice. However, the precise mechanism by which Circ-Spen regulates bone health remained unclear. This study identified Circ-Spen as a positive regulator of mouse bone marrow mesenchymal stem cell (mBMSC) viability. The expression of Circ-Spen was markedly increased in ERβ−/− mice femurs tested by RT-qPCR. Moreover, Circ-Spen exhibited an enhanced expression during the bone formation process of mBMSCs. Qualitative experiments also demonstrated that Circ-Spen possessed a circular structure and was localized within the nucleus of mBMSCs. Functionally, it inhibited apoptosis via caspase-3, BCL-2, and BAX, while also promoting autophagy through BECN1 and P62 in mBMSCs tested by MTT assays, transmission electron microscopy (TEM), and Western blotting. These findings reveal the potential of targeting Circ-Spen as a promising therapeutic strategy for rejuvenating senescent mBMSCs and enhancing the efficiency of mBMSC transplantation, which lays the foundation for advancements in the field of bone therapy

The Mechanism of Important Components in Canine Fecal Microbiota Transplantation

Fecal microbiota transplantation (FMT) is a potential treatment for many intestinal diseases. In dogs, FMT has been shown to have positive regulation effects in treating Clostridioides difficile infection (CDI), inflammatory bowel disease (IBD), canine parvovirus (CPV) enteritis, acute diarrhea (AD), and acute hemorrhagic diarrhea syndrome (AHDS). FMT involves transplanting the functional components of a donor’s feces into the gastrointestinal tract of the recipient. The effective components of FMT not only include commensal bacteria, but also include viruses, fungi, bacterial metabolites, and immunoglobulin A (IgA) from the donor feces. By affecting microbiota and regulating host immunity, these components can help the recipient to restore their microbial community, improve their intestinal barrier, and induce anti-inflammation in their intestines, thereby affecting the development of diseases. In addition to the above components, mucin proteins and intestinal epithelial cells (IECs) may be functional ingredients in FMT as well. In addition to the abovementioned indications, FMT is also thought to be useful in treating some other diseases in dogs. Consequently, when preparing FMT fecal material, it is important to preserve the functional components involved. Meanwhile, appropriate fecal material delivery methods should be chosen according to the mechanisms these components act by in FMT

A dual-mode NADH biosensor based on gold nanostars decorated CoFe₂ metal–organic frameworks to reveal dynamics of cell metabolism

Nicotinamide adenine dinucleotide (NADH) is central to metabolism and implicated in various diseases. Herein, nanohybrids of gold nanostars and metal-organic frameworks are devised and demonstrated as a dual-mode NADH sensor, for which colorimetric detection is enabled by its peroxidase-like nanozyme property and Raman detection is realized by its surface-enhanced Raman scattering property with the detection limit as low as 28 pM. More importantly, this probe enables real-time SERS monitoring in living cells, providing a unique tool to investigate dynamic cellular processes involving NADH. Our experiments reveal that metabolism dynamics is accelerated by glucose and is much higher in cancerous cells. The SERS results can also be verified by the colorimetric detection. This sensor provides a new potential to detect biomarkers and their dynamics in situ.Ministry of Education (MOE)This work was supported by the National Natural Science Foundation of China (21674085), National Postdoctoral Program for Innovative Talent (BX20190277), the Natural Science Basic Research Plan in Shaanxi Province of China (2020JZ-01), the China Postdoctoral Science Foundation (2020M673387, 2021M702557), the Key Laboratory Construction Program of Xi’an Municipal Bureau of Science and Technology (201805056ZD7CG40), the youth talent support program of Xi’an Jiaotong University (HX6J016) and Singapore Ministry of Education under its Academic Research Fund (AcRF) Tier-1 grants (RG110/20 and RT02/20) and AcRF Tier-2 grant (MOE2019-T2-2-004)