QuadraNet: Improving High-Order Neural Interaction Efficiency with Hardware-Aware Quadratic Neural Networks

Recent progress in computer vision-oriented neural network designs is mostly driven by capturing high-order neural interactions among inputs and features. And there emerged a variety of approaches to accomplish this, such as Transformers and its variants. However, these interactions generate a large amount of intermediate state and/or strong data dependency, leading to considerable memory consumption and computing cost, and therefore compromising the overall runtime performance. To address this challenge, we rethink the high-order interactive neural network design with a quadratic computing approach. Specifically, we propose QuadraNet -- a comprehensive model design methodology from neuron reconstruction to structural block and eventually to the overall neural network implementation. Leveraging quadratic neurons' intrinsic high-order advantages and dedicated computation optimization schemes, QuadraNet could effectively achieve optimal cognition and computation performance. Incorporating state-of-the-art hardware-aware neural architecture search and system integration techniques, QuadraNet could also be well generalized in different hardware constraint settings and deployment scenarios. The experiment shows thatQuadraNet achieves up to 1.5$\times$ throughput, 30% less memory footprint, and similar cognition performance, compared with the state-of-the-art high-order approaches.Comment: ASP-DAC 2024 Best Paper Nominatio

Single-crystal elastic moduli, anisotropy and the B1-B2 phase transition of NaCl at high pressures: Experiment vs. ab-initio calculations

Single-crystal elastic moduli, Cij, and the B1-B2 phase transition of NaCl were investigated experimentally, using time-domain Brillouin scattering (TDBS), and theoretically, via density-functional-theory (DFT), to 41 GPa. Thus, we largely extended pressure range where Cij and elastic anisotropy of the solid are measured, including the first experimental data for the high-pressure B2 phase, NaCl-B2. NaCl-B1 exhibits a strong and growing with pressure anisotropy, in contrast to NaCl-B2. Theoretical values obtained using different advanced DFT functionals were compared with our measurements but no one could satisfactorily reproduce our experimental data for NaCl-B1 and NaCl-B2 simultaneously. For all available DFT results on the principal shear moduli and anisotropy, the deviation became pronounced when the degree of compression increased significantly. Similar deviations could be also recognized for other cubic solids having the same B1-type structure and similar bonding, such as CaO, MgO, or (Mg1-x,Fex)O. Furthermore, the available experimental data suggest that the B1-B2 phase transition of NaCl and the above mentioned compounds are governed by the Born stability criterion C44(P) - P > 0.Comment: 15 pages and 5 figures for the Manuscript, 10 pages and 7 figures for the Supplemen

Geographic Distribution and Genetic Diversity of Rice Stripe Mosaic Virus in Southern China

Rice stripe mosaic virus (RSMV) transmitted by the leafhopper Recilia dorsalis is a tentative new species in the genus Cytorhabdovirus identified recently in South China. To explore its geographic distribution and genetic diversity, field investigation and viral whole-genome sequencing were conducted in this study. The results indicated that RSMV was present in the rice samples collected across southern China. Twelve representative samples from different geographical regions were selected for viral whole-genome sequencing and the viral genome variation was analyzed in combination with a previously reported RSMV isolate. Identity analysis showed that the genome sequences of 13 RSMV isolates were highly conserved with nucleotide identities over 99.4%. There was a strong negative selection pressure during the evolution of RSMV with more transitions (72.08%) than transversions (27.92%) found between the RSMV isolates. Among the seven genes encoded by RSMV, the P gene was the most variable, followed by N, M, L, and G; the P3 and P6 amino acid sequences were not found to be mutated and no mutations were found in the non-coding region. A phylogenetic tree based on the RSMV whole-genome nucleotide sequences revealed that all RSMV isolates clustered in two groups based on geographical origin. Notably, the L proteins of the Guangxi and Hainan isolates had five and one specific amino acid sites, respectively, suggesting that the L gene has undergone environmental adaptive variation during the dispersal of RSMV

The fate of concomitant mild mitral regurgitation in aortic insufficiency: A neglected subject

ObjectivesMitral regurgitation (MR) is commonly experienced by patients with aortic insufficiency (AI), and in its mild form, it is considered benign. However, the progression of concomitant mild regurgitation after the aortic valve surgery (AVS) for AI is poorly characterized. The current study aimed to define the long-term outcomes of MR after surgery and identify the risk factors involved in deterioration.MethodsPatients presenting with moderate/severe AI and concomitant mild MR (n = 347) between January 2013 and December 2021 were enrolled. MR grade was assessed by transthoracic echocardiography during the follow-up, and deterioration is defined as an increase in grade to moderate or severe MR from the previous follow-up echocardiography. Analysis of risk factors for early mortality, MR deterioration, and long-term mortality was performed.ResultsA total of 278 patients (84.8%) among 328 survivors had at least one follow-up echocardiography, and complete follow-up occurred for 316 patients (96.3%). Mild MR improved to trivial or none in 194 patients (69.8%), progressed to persistent mild MR for 74 patients (26.6%), and deteriorated for 10 patients (3.6%). Preoperative atrial fibrillation [odds ratio (OR), 23.09; 95% confidence interval (CI), 4.35–122.54] and rheumatic AI (OR, 11.61; 95% CI, 1.26–106.85) were shown to be independent risk factors for MR deterioration by generalized linear mixed analysis.ConclusionProgression of concomitant mild MR is rare in patients with AI after AVS. However, rheumatic AI and preoperative atrial fibrillation increase the probability of MR deterioration. Careful follow-up for this cohort of patients is recommended

Two-Dimensional Platinum Telluride with Ordered Te Vacancy Superlattice for Efficient and Robust Hydrogen Evolution

Defect engineering to activate the basal planes of transition metal dichalcogenides (TMDs) is critical for the development of TMD-based electrocatalysts as the chemical inertness of basal planes restrict their potential applications in hydrogen evolution reaction (HER). Here, we report the synthesis and evaluation of few-layer (7x7)-PtTe2-x with an ordered, well-defined and high-density Te vacancy superlattice. Compared with pristine PtTe2, (2x2)-PtTe2-x and Pt(111), (7x7)-PtTe2-x exhibits superior HER activities in both acidic and alkaline electrolytes due to its rich structures of undercoordinated Pt sites. Furthermore, the (7x7)-PtTe2-x sample features outstanding catalytic stability even compared to the state-of-the-art Pt/C catalyst. Theoretical calculations reveal that the interactions between various undercoordinated Pt sites due to proximity effect can provide superior undercoordinated Pt sites for hydrogen adsorption and water dissociation. This work will enrich the understanding of the relationship between defect structures and electrocatalytic activities and provide a promising route to develop efficient Pt-based TMD electrocatalysts

Electrohydraulic lithotripsy through endoscopic retrograde cholangiopancreatography combined with SpyGlass in the treatment of complex pancreatic duct stones: A case report and literature review

The incidence of pancreatic duct stones (PDS) is less than 1%. After the formation of stones, the lumen of the pancreatic duct is blocked, and the pancreatic juice cannot be discharged smoothly, resulting in the impairment of the internal and external secretions of the pancreas. Several national guidelines now recommend endoscopic retrograde cholangiopancreatography (ERCP) as the treatment for PDS. The emergence of SpyGlass makes it possible to visualize the ERCP blind area of the pancreatic system directly. Electrohydraulic lithotripsy (EHL) under SpyGlass can crush large and pressure-resistant stones into smaller fragments, significantly improving the success of the endoscopic treatment of large stones. Here, we report a patient presented with acute alcohol-associated pancreatitis, found to have PDS on imaging, who underwent ERCP combined with SpyGlass (EHL), avoiding surgery, reducing trauma, and being discharged from the hospital with a rapid recovery. Therefore, endoscopic therapy is effective and safe for PDS patients. The combination therapy of this patient is the first use of SpyGlass for PDS in our centre, which marks a new stage in the application of endoscopic therapy for pancreatic diseases

Geniposide Alleviates Glucocorticoid-Induced Inhibition of Osteogenic Differentiation in MC3T3-E1 Cells by ERK Pathway

Glucocorticoid (GC) therapy is the leading cause of secondary osteoporosis and the therapeutic and preventative drugs for GC-induced osteoporosis are limited. In this study, we investigated the protective effects of geniposide on dexamethasone (DEX)-induced osteogenic inhibition in MC3T3-E1 cells. The results showed that there was no obvious toxicity on MC3T3-E1 cells when geniposide was used at the doses ranging from 1 to 75 μM. In DEX-treated MC3T3-E1 cells, geniposide promoted the alkaline phosphatase (ALP) activity and the mineralization. In addition, geniposide also significantly increased the mRNA and protein expression of osteopontin (OPN), Runt-related transcription factor 2 (Runx2), and Osterix (Osx) in DEX-treated MC3T3-E1 cells. Furthermore, geniposide activated ERK pathway in DEX-treated MC3T3-E1 cells. The ERK activation inhibitor U0126 and glucagon-like peptide-1 (GLP-1) receptor antagonist exendin 9-39 abolished the geniposide-induced activation of ERK and inhibited the protective effect of geniposide. Taken together, our study revealed that geniposide alleviated GC-induced osteogenic suppression in MC3T3-E1 cells. The effect of geniposide was at least partially associated with activating ERK signaling pathway via GLP-1 receptor. Geniposide might be a potential therapeutic agent for GC-induced osteoporosis