Implicit Kernel Attention

\textit{Attention} computes the dependency between representations, and it encourages the model to focus on the important selective features. Attention-based models, such as Transformers and graph attention networks (GAT) are widely utilized for sequential data and graph-structured data. This paper suggests a new interpretation and generalized structure of the attention in Transformer and GAT. For the attention in Transformer and GAT, we derive that the attention is a product of two parts: 1) the RBF kernel to measure the similarity of two instances and 2) the exponential of $L^{2}$ norm to compute the importance of individual instances. From this decomposition, we generalize the attention in three ways. First, we propose implicit kernel attention with an implicit kernel function, instead of manual kernel selection. Second, we generalize $L^{2}$ norm as the $L^{p}$ norm. Third, we extend our attention to structured multi-head attention. Our generalized attention shows better performance on classification, translation, and regression tasks

Study of a depressurisation process at low Mach number in a nuclear reactor core

International audienceThis paper deals with the numerical treatment of two additional terms in the Lmnc-system derived and studied in previous publications and modelling the coolant in a nuclear reactor core. On the one hand, we investigate the influence of the thermal conduction upon steady analytical solutions and upon numerical strategies designed in dimensions 1 and 2. On the other hand, we consider a time-varying thermodynamic pressure that enables to simulate a larger variety of physical situations. Taking into account the resulting terms in the equations lead us to adapt numerical methods to ensure accuracy.Le système d'équations Lmnc étudié précédemment par les auteurs permet de modéliser l'eau dans le circuit primaire d'un réacteur nucléaire. Dans ce papier, nous nous intéressons à l'enrichissement du modèle par la prise en compte de deux phénomènes : d'une part la diffusion thermique qui influe sur les états stationnaires et sur les schémas numériques mis en oeuvre en dimensions 1 et 2, et d'autre part la dépendance en temps de la pression thermodynamique an de pouvoir simuler des situations physiques plus variées. Les nouveaux termes intervenant dans les équations nécessitent d'adapter les outils numériques an de maintenir la précision des résultats

Influence of Friction Stir Welding on Mechanical Properties of Butt Joints of AZ61 Magnesium Alloy

In this study, the effect of heat input on the mechanical properties and fracture behaviors of AZ61 magnesium alloy joints has been studied. Magnesium alloy AZ61 plates with thickness of 5 mm were welded at different ratios of tool rotational speed to welding speed (ω/ν). The average ultimate tensile strength of all weld conditions satisfying a ω/ν ratio of 3 reached 100% of the strength of the base material. Fractures occurred at the interface between the thermomechanical affected zone at advancing side and the stir zone in all welded specimens. From the scanning electron microscope and electron backscatter diffraction analysis, it was determined that the interface between the thermomechanical affected zone and the stir zone, which is the region where the grain orientation changes, was the weakest part; the advancing side region was relatively weaker than the retreating side region because the grain orientation change occurred more dramatically in the advancing side region

COVID-19 symptoms at hospital admission vary with age and sex: results from the ISARIC prospective multinational observational study

Background: The ISARIC prospective multinational observational study is the largest cohort of hospitalized patients with COVID-19. We present relationships of age, sex, and nationality to presenting symptoms. Methods: International, prospective observational study of 60 109 hospitalized symptomatic patients with laboratory-confirmed COVID-19 recruited from 43 countries between 30 January and 3 August 2020. Logistic regression was performed to evaluate relationships of age and sex to published COVID-19 case definitions and the most commonly reported symptoms. Results: ‘Typical’ symptoms of fever (69%), cough (68%) and shortness of breath (66%) were the most commonly reported. 92% of patients experienced at least one of these. Prevalence of typical symptoms was greatest in 30- to 60-year-olds (respectively 80, 79, 69%; at least one 95%). They were reported less frequently in children (≤ 18 years: 69, 48, 23; 85%), older adults (≥ 70 years: 61, 62, 65; 90%), and women (66, 66, 64; 90%; vs. men 71, 70, 67; 93%, each P < 0.001). The most common atypical presentations under 60 years of age were nausea and vomiting and abdominal pain, and over 60 years was confusion. Regression models showed significant differences in symptoms with sex, age and country. Interpretation: This international collaboration has allowed us to report reliable symptom data from the largest cohort of patients admitted to hospital with COVID-19. Adults over 60 and children admitted to hospital with COVID-19 are less likely to present with typical symptoms. Nausea and vomiting are common atypical presentations under 30 years. Confusion is a frequent atypical presentation of COVID-19 in adults over 60 years. Women are less likely to experience typical symptoms than men

Research Progress on Conducting Polymer-Based Biomedical Applications

Conducting polymers (CPs) have attracted significant attention in a variety of research fields, particularly in biomedical engineering, because of the ease in controlling their morphology, their high chemical and environmental stability, and their biocompatibility, as well as their unique optical and electrical properties. In particular, the electrical properties of CPs can be simply tuned over the full range from insulator to metal via a doping process, such as chemical, electrochemical, charge injection, and photo-doping. Over the past few decades, remarkable progress has been made in biomedical research including biosensors, tissue engineering, artificial muscles, and drug delivery, as CPs have been utilized as a key component in these fields. In this article, we review CPs from the perspective of biomedical engineering. Specifically, representative biomedical applications of CPs are briefly summarized: biosensors, tissue engineering, artificial muscles, and drug delivery. The motivation for use of and the main function of CPs in these fields above are discussed. Finally, we highlight the technical and scientific challenges regarding electrical conductivity, biodegradability, hydrophilicity, and the loading capacity of biomolecules that are faced by CPs for future work. This is followed by several strategies to overcome these drawbacks

Parasitic-Element-Loaded UWB Antenna with Band-Stop Function for Mobile Handset Wireless USB

A UWB antenna loaded by parasitic elements for wireless USB of mobile handsets is proposed for UWB service in which a band-stop function of 5.725–5.825 GHz WLAN band is required. Two kinds of parasitic elements are incorporated into a rectangular radiator to obtain enhanced impedance bandwidth and band-stop function. The proposed antenna is very compact in size. Wide bandwidths of 3.15–4.75 GHz and 7.2–10.2 GHz are achieved while 5.725–5.825 GHz is notched. Three different shapes of conventional mobile terminals are also considered for measurement

Structural Characterization of Glycerophosphorylated and Succinylated Cyclic β-(1→2)-d-Glucan Produced by Sinorhizobium mliloti 1021

Rhizobia produces different types of surface polysaccharides. Among them, cyclic β-(1→2)-d-glucan is located in the periplasmic space of rhizobia and plays an important role in the adaptation of bacteria to osmotic adaptation. Cyclic β-(1→2)-d-glucan (CG), synthesized from Sinorhiozbbium meliloti 1021, has a neutral and anionic form. In the present study, we characterized the exact chemical structures of anionic CG after purification using size exclusion s (Bio-Gel P-6 and P-2) chromatography, and DEAE-Sephadex anion exchange chromatography. The exact structure of each isolated anionic CG was characterized using various analytical methods such as nuclear magnetic resonance (NMR), attenuated total reflection Fourier transform infrared (ATR-FTIR) spectroscopy and matrix associated laser desorption ionization-time of Flight (MALDI-TOF) mass spectrometry. The precise chemical structures of novel anionic CG molecules were elucidated by various NMR spectroscopic analyses, including 1H, 13C, 31P, and 2D HSQC NMR spectroscopy. As a result, we discovered that anionic CG molecules have either glycerophosphoryl or succinyl residues at C6 positions of a neutral CG. In addition, the results of MALDI-TOF mass spectrometric analysis confirmed that there are two types of patterns for anionic CG peaks, where one type of peak was the succinylated CG (SCG) and the other was glycerophospholated CG (GCG). In addition, it was revealed that each anionic CG has one to four substituents of the succinyl group of SCG and glycerophosphoryl group of GCG, respectively. Anionic CG could have potential as a cyclic polysaccharide for drug delivery systems and a chiral separator based on the complexation with basic target molecules