Scaling Up, Scaling Deep: Blockwise Graph Contrastive Learning

Oversmoothing is a common phenomenon in graph neural networks (GNNs), in which an increase in the network depth leads to a deterioration in their performance. Graph contrastive learning (GCL) is emerging as a promising way of leveraging vast unlabeled graph data. As a marriage between GNNs and contrastive learning, it remains unclear whether GCL inherits the same oversmoothing defect from GNNs. This work undertakes a fundamental analysis of GCL from the perspective of oversmoothing on the first hand. We demonstrate empirically that increasing network depth in GCL also leads to oversmoothing in their deep representations, and surprisingly, the shallow ones. We refer to this phenomenon in GCL as long-range starvation', wherein lower layers in deep networks suffer from degradation due to the lack of sufficient guidance from supervision (e.g., loss computing). Based on our findings, we present BlockGCL, a remarkably simple yet effective blockwise training framework to prevent GCL from notorious oversmoothing. Without bells and whistles, BlockGCL consistently improves robustness and stability for well-established GCL methods with increasing numbers of layers on real-world graph benchmarks. We believe our work will provide insights for future improvements of scalable and deep GCL frameworks.Comment: Preprint; Code is available at https://github.com/EdisonLeeeee/BlockGC

What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoders

The last years have witnessed the emergence of a promising self-supervised learning strategy, referred to as masked autoencoding. However, there is a lack of theoretical understanding of how masking matters on graph autoencoders (GAEs). In this work, we present masked graph autoencoder (MaskGAE), a self-supervised learning framework for graph-structured data. Different from standard GAEs, MaskGAE adopts masked graph modeling (MGM) as a principled pretext task - masking a portion of edges and attempting to reconstruct the missing part with partially visible, unmasked graph structure. To understand whether MGM can help GAEs learn better representations, we provide both theoretical and empirical evidence to comprehensively justify the benefits of this pretext task. Theoretically, we establish close connections between GAEs and contrastive learning, showing that MGM significantly improves the self-supervised learning scheme of GAEs. Empirically, we conduct extensive experiments on a variety of graph benchmarks, demonstrating the superiority of MaskGAE over several state-of-the-arts on both link prediction and node classification tasks.Comment: KDD 2023 research track. Code available at https://github.com/EdisonLeeeee/MaskGA

Antibody‐independent targeted quantification of TMPRSS2‐ERG fusion protein products in prostate cancer

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/135707/1/mol22014871169-sup-mmc1.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/135707/2/mol22014871169.pd

Purification and Identification of Antioxidant Peptides from Enzymatic Hydrolysates of Tilapia (Oreochromis niloticus) Frame Protein

Tilapia frame protein was hydrolyzed by different proteases, including properase E, pepsin, trypsin, flavourzyme, neutrase, gc106 and papain, to obtain antioxidant peptides. The tilapia frame protein hydrolysate (TFPH) obtained by trypsin exhibited the highest degree of hydrolysis and antioxidant activity. Three series of peptides (TFPH1, TFPH 2 and TFPH 3) were obtained by ultrafiltration of TFPH through molecular weight cut-off membranes of 5, 3 and 1 kDa, respectively, and their IC50 values on scavenging 1,1-diphenyl-2-picrylhydrazyl (DPPH) radical, superoxide anion radical (•O2), hydrogen peroxides (H2O2) and hydroxyl radical (•OH) activities were determined and compared with glutathione (GSH). The results showed that TFPH1 had the highest antioxidant activity. TFPH1 was further purified using ion exchange chromatography, gel filtration chromatography, and reversed phase high performance liquid chromatography (RP-HPLC). Finally, two antioxidant peptides were identified and the amino acid sequences were identified as Asp-Cys-Gly-Tyr (456.12 Da) and Asn-Tyr-Asp-Glu-Tyr (702.26 Da), respectively. The IC50 values of two peptides on hydroxyl radical scavenging activity were 27.6 and 38.4 μg/mL, respectively

Study on the Low-Temperature Rheology of Polar Drilling Fluid and Its Regulation Method

Drilling fluid is the blood of drilling engineering. In the polar drilling process, the ultra-low temperature environment puts high demands on the rheological performance of drilling fluids. In this paper, the effects of temperature, ice debris concentration and weighting agent on the rheological properties of drilling fluids were studied. It was found that the lower the temperature and the higher the ice debris concentration, the higher the drilling fluid viscosity, but when the ice debris concentration was below 2%, the drilling fluid rheology hardly changed. Secondly, the low temperature rheological properties of drilling fluid were adjusted by three different methods: base fluid ratio, organoclay, and polymers (dimer acid, polymethacrylate, ethylene propylene copolymer, and vinyl resin). The results showed that the base fluid rheological performance was optimal when the base fluid ratio was 7:3. Compared with polymers, organoclay has the most significant improvement on the low temperature rheological performance of drilling fluid. The main reason is that organoclay can transform the drilling fluid from Newtonian to non-Newtonian fluid, which exhibits excellent shear dilution of drilling fluid. The organoclay is also more uniformly dispersed in the oil, forming a denser weak gel mesh structure, so it is more effective in improving the cuttings carrying and suspension properties of drilling fluids. However, the drilling fluid containing polymer additives is still a Newtonian fluid, which cannot form a strong mesh structure at ultra-low temperatures, and thus cannot effectively improve the low-temperature rheological performance of drilling fluid. In addition, when the amount of organoclay is 2%, the improvement rate of the yield point reaches 250% at −55 °C, which can effectively improve the cuttings carrying and suspension performance of drilling fluid at ultra-low temperature

Open Access

Background: Acute gastroenteritis caused by bacteria, virus and parasite is an important cause of childhood morbidity and mortality in developing countries. Rotavirus and norovirus have been recognized as the most common pathogens causing acute gastroenteritis among children. However, there is still no valuable data about infections of rotavirus and norovirus in children in Ji’nan, an eastern city in China. The aims of the present study are to determine the incidence of rotavirus and norovirus associated acute gastroenteritis in Ji’nan among children, to characterize rotavirus and norovirus strains circulating during this period; and to provide useful epidemiological and clinical data. Methods: Fecal specimens and clinical data were collected from 767 children (502 outpatients and 265 inpatients) under 5 years of age with acute diarrhea at Shandong University Qilu Hospital and Qilu children’s HospitalinJi’nan, China between February 2011 and January 2012. Virus RNA was extracted, amplified, electrophoresed, sequenced and phylogenetically analyzed to determine the prevalent genotypes. Chi-square and U test were used to compare characteristics of clinical manifestation in each group. Results: Of the 767 specimens 263 (34.3%) were positive for rotavirus and 80 (10.4%) were positive for norovirus. Among 263 rotavirus positive cases, G3 (40.7%) was the most prevalent serotype, P[8] (46.8%) was the dominant genotype and G3P[8] (31.9%) was the most common combination. All of the norovirus strains belonged to GI

Study on Key Technical Route and Construction Mode of Low-Carbon Park

The potential for energy conservation and emission reduction in parks is enormous, promoting the popularization of low-carbon parks is a necessary means to promote the green and low-carbon transformation of energy consumption and achieve China’s ‘dual carbon’ goals. This article summarizes and extracts four main technical routes for building low-carbon parks through research on low-carbon parks and building cases at home and abroad: energy conservation and low-carbon construction of architectural noumenon, proactive energy conservation and operational carbon reduction, internal development of renewable energy, and external green energy input. Horizontal comparison and qualitative analysis of the four technical routes adopted in each typical case, summarizing and proposing eight models and typical application scenarios for building low-carbon parks, providing a theoretical basis and implementation suggestions for low-carbon development of the park

Facile growth of aluminum oxide thin film by chemical liquid deposition and its application in devices

Uniform and continuous Al2O3 thin films were prepared by the chemical liquid deposition (CLD) method. The breakdown field strength of the amorphous CLD-Al2O3 film is 1.74 MV/cm, making it could be used as a candidate dielectric film for electronic devices. It was further proposed to use the CLD-Al2O3 film as an electron blocking layer in a triboelectric nanogenerator (TENG) for output performances enhancement. Output voltages and currents of about 200 V and 9 µA were obtained, respectively, which were 2.6 times and 3 times, respectively, higher than TENG device without an Al2O3. A colloidal condensation-based procedure controlled by adjusting the pH value of the solution was proposed to be the mechanism of CLD, which was confirmed by the Tyndall effect observed in the growth liquid. The results indicated that the CLD could serve as a low-cost, room temperature, nontoxic and facile new method for the growth of functional thin films for semiconductor device applications

Simulation Analysis of Gas Bubble Formation and Escape in Non-Newtonian Drilling Fluids

In this study, the formation and escape movements of a bubble injected in non-Newtonian drilling fluid through a pore were numerically simulated using a volume of fluid method. The pattern of a single bubble and the pressure and velocity fields of the surrounding liquid phase during the bubble formation were analyzed and compared with experimental results; based on the comparison, the formation and escape properties of the bubble were further studied. In particular, the effects of static shear force, consistency coefficient, and flow behavior index on the growth and escape time of the bubble were analyzed. The results show that, owing to the effect of velocity on the viscosity of a non-Newtonian drilling fluid, the escape time and volume of the bubble increase with an increase in static shear force, consistency coefficient, and flow behavior index. Among the three parameters, the flow behavior index has the greatest effect. This is because the shear disturbance of a bubble to its surrounding fluid during its growth and escape, caused by the shear thinning of a yield-power-law fluid, reduces the fluid viscosity. The shear thinning decreases, and the resistance to the bubble increases as the flow behavior index approaches 1, leading to larger bubble formation times and separation volumes. An empirical formula for predicting the equivalent radius of bubbles considering the liquid yield stress, inertial force, viscous force, and surface tension is established. The average error of predicting the equivalent radius of detached bubble is 0.80%, which can provide a reference for the better study of bubble migration and flow pattern in non-Newtonian fluid

A Temperature-Sensitive Polymeric Rheology Modifier Used in Water-Based Drilling Fluid for Deepwater Drilling

Rheology modifiers are essential for the flat rheology of water-based drilling fluids in deepwater. The low temperature thickening of deepwater water-based drilling fluids results in dramatic rheological changes in the 20–30 °C range. To address such problems, NIPAM with a self-polymerized product LCST of 32–35 °C was selected as the main body for synthesis. While introducing the hydrophilic monomer AM to enhance the thickening properties, the hydrophobic monomer BA was selected to reduce the LCST of the product. In this paper, a temperature-sensitive polymeric rheology modifier (PNBAM) was synthesized by emulsion polymerization using N-isopropyl acrylamide, acrylamide, and butyl acrylate as monomers. The PNBAM was characterized using infrared spectroscopy (FT-IR), thermogravimetric analysis (TGA), and nuclear magnetic resonance hydrogen spectroscopy (NMR). The rheological properties, temperature resistance, and salt resistance of PNBAM in the base fluid (BF) were tested. The performance of PNBAM in the drilling fluid system was also evaluated, and a water-based drilling fluid system of flat rheology for deepwater was formulated. The rheological modification mechanism of PNBAM was analyzed by turbidity analysis, particle size analysis, and zeta analysis. Experimental results show that PNBAM has good rheological properties. PNBAM is temperature resistant to 150 °C, salt-resistant to 30 wt%, and calcium resistant to 1.0 wt%. PNBAM also has good flat rheology characteristics in drilling fluid systems: AV4°C:AV25°C = 1.27, PV4°C:PV25°C = 1.19. Mechanistic analysis showed that the LCST (Lower Critical Solution Temperature) of 0.2 wt% PNBAM in an aqueous solution was 31 °C. Through changes in hydrogen bonding forces with water, PNBAM can regulate its hydrophilic and hydrophobic properties before and after LCST, which thus assists BF to achieve a flat rheological effect. In summary, the temperature-sensitive effect of PNBAM has the property of enhancing with increasing temperature. While the tackifying effect of conventional rheology modifiers diminishes with increasing temperature, the temperature-sensitive effect of PNBAM gives it an enhanced thickening effect with increasing temperature, making it a more novel rheology modifier compared to conventional treatment additives. After LCST, compared to conventional rheology modifiers (XC), PNBAM has a more pronounced thermo-thickening effect, improving the main rheological parameters of BF by more than 100% or even up to 200% (XC less than 50%). This contributes to the flat rheology of drilling fluids. PNBAM has good application prospects and serves as a good reference for the development of other rheology modifiers