Implicit Kernel Attention

\textit{Attention} computes the dependency between representations, and it encourages the model to focus on the important selective features. Attention-based models, such as Transformers and graph attention networks (GAT) are widely utilized for sequential data and graph-structured data. This paper suggests a new interpretation and generalized structure of the attention in Transformer and GAT. For the attention in Transformer and GAT, we derive that the attention is a product of two parts: 1) the RBF kernel to measure the similarity of two instances and 2) the exponential of $L^{2}$ norm to compute the importance of individual instances. From this decomposition, we generalize the attention in three ways. First, we propose implicit kernel attention with an implicit kernel function, instead of manual kernel selection. Second, we generalize $L^{2}$ norm as the $L^{p}$ norm. Third, we extend our attention to structured multi-head attention. Our generalized attention shows better performance on classification, translation, and regression tasks

Characterization of Kaposi's sarcoma-associated herpesvirus (KSHV) K1 promoter activation by Rta

The K1 gene of Kaposi's sarcoma-associated herpesvirus (KSHV) encodes a 46-kDa transmembrane glycoprotein that possesses transforming properties, initiates signaling pathways in B cells, and prevents apoptosis. Here, we demonstrate a mechanism for activation of the K1 promoter by the Rta transactivator. Electrophoretic mobility shift assay (EMSA) analysis of the K1 promoter demonstrated that purified Rta protein bound to the K1 promoter at three locations, independent of other DNA-binding factors. Transcriptional assays revealed that only two of these Rta DNA-binding sites are functionally significant, and that they could impart Rta responsiveness to a heterologous E4 TATA box promoter. In addition, TATA-binding protein (TBP) bound to a TATA box element located 25 bp upstream of the K1 transcription start site and was also shown to associate with Rta by coimmunoprecipitation analysis. Rta transactivation may therefore be mediated in part through recruitment of TBP to target promoters

Genetic Comparison of Stemness of Human Umbilical Cord and Dental Pulp

published_or_final_versio

Simple method of measuring ocular rotation in supine position during small incision lenticule extraction

AIM: To introduce a novel measurement method of static cyclotorsion in small incision lenticule extraction (SMILE) and to investigate the effect of preoperative parameters on cyclotorsion and the effect of cyclotorsion on postoperative outcomes. METHODS: The medical records of 242 patients and 484 eyes who underwent SMILE surgery were retrospectively reviewed. Preoperative intraocular pressure, refractive error, and corneal thickness were investigated. Refractive values and visual acuity were measured at 1d, 1, 3, and 6mo. Ocular cyclotorsion in the supine position was measured by calculating the location and angle of the incision site of the cornea in the anterior slit photograph taken after surgery. RESULTS: Of the total 484 eyes in 242 patients, preoperative mean spherical equivalent (SE) was -4.10±1.64 D, and the mean astigmatism was -0.82±0.74 D. Uncorrected distance visual acuity (UCVA) and SE improved significantly after the surgery. Moreover, 219 (45.2%) eyes had excyclotorsion, 235 (48.6%) eyes had incyclotorsion, and 30 (6.2%) eyes had no torsion. The right eyes tended to be excyclotorted, and the left eyes tended to be incyclotorted (P<0.01). The mean cyclotorsion was 1.18°±3.69°, and the mean absolute value of cyclotorsion was 3.14°±2.26°. The range of cyclotorsion was 0.5°–11.4°. It was found that the smaller the preoperative sphere, the higher the amount of cyclotorsion (r=0.11, P=0.016). There was no significant association between the amount of cyclotorsion and preoperative astigmatism. There was no correlation between sex, preoperative corneal thickness, preoperative intraocular pressure, amount of cyclotorsion, and direction of cyclotorsion. The ratio of right eye excyclotorsion and left eye incyclotorsion on 1d was higher than that at 1, 3, and 6mo (all P<0.01). There was no difference between the 1, 3, and 6mo results in the right and left eyes (P=0.15, P=0.16, respectively). CONCLUSION: The newly devised ocular cyclotorsion measurement method can be used to evaluate ocular cyclotorsion after SMILE. Preoperative SE is associated with the amount of cyclotorsion, however, cyclotorsion doesn't have a significant effect on the results of SMILE surgery

Acidic pH shock induces the expressions of a wide range of stress-response genes

<p>Abstract</p> <p>Background</p> <p>Environmental signals usually enhance secondary metabolite production in <it>Streptomycetes </it>by initiating complex signal transduction system. It is known that different sigma factors respond to different types of stresses, respectively in <it>Streptomyces </it>strains, which have a number of unique signal transduction mechanisms depending on the types of environmental shock. In this study, we wanted to know how a pH shock would affect the expression of various sigma factors and shock-related proteins in <it>S. coelicolor </it>A3(2).</p> <p>Results</p> <p>According to the results of transcriptional and proteomic analyses, the major number of sigma factor genes were upregulated by an acidic pH shock. Well-studied sigma factor genes of <it>sigH </it>(heat shock), <it>sigR </it>(oxidative stress), <it>sigB </it>(osmotic shock), and <it>hrdD </it>that play a major role in the secondary metabolism, were all strongly upregulated by the pH shock. A number of heat shock proteins including the DnaK family and chaperones such as GroEL2 were also observed to be upregulated by the pH shock, while their repressor of <it>hspR </it>was strongly downregulated. Oxidative stress-related proteins such as thioredoxin, catalase, superoxide dismutase, peroxidase, and osmotic shock-related protein such as vesicle synthases were also upregulated in overall.</p> <p>Conclusion</p> <p>From these observations, an acidic pH shock was considered to be one of the strongest stresses to influence a wide range of sigma factors and shock-related proteins including general stress response proteins. The upregulation of the sigma factors and shock proteins already found to be related to actinorhodin biosynthesis was considered to have contributed to enhanced actinorhodin productivity by mediating the pH shock signal to regulators or biosynthesis genes for actinorhodin production.</p

Value recognition and eating patterns of Kimchi in female middle school students and their mothers

This study analyzed Kimchi eating culture in 178 households with female middle school children located in Incheon and Seosan areas, investigated the Kimchi eating patterns of female middle school students, and also analyzed the differences in value recognition for Kimchi between mothers and their female middle school students. Results showed that 23.0% of subject households answered eat Kimchi at every meal and the main reason for eating Kimchi in most households was good for taste. Most households made their own Kimchi, and only 12.3% of households bought Kimchi. Subject households preferred hot and spicy taste (34.8%) and pleasing taste (20.2%), and 44.4% of middle school children answered as eating Kimchi at every meal, and the source for information on Kimchi was home in 51.6% and mass media in 33.7%, suggesting the lack of school education. Both mothers and their female middle school students placed high value on Kimchi for its nutritional aspect and on Kimchi from the market for its convenience. Mothers showed significantly higher value (p<0.05) on the storage aspect of Kimchi compared to their middle school students, and female middle school students showed significantly higher value (p<0.05) on the value recognition for Kimchi as an international food compared to their mothers. Also, the value for hot pepper powder was high among other additional ingredients, and both mothers and middle school students had high values for Kimchi stew among other food dishes using Kimchi, and middle school students showed higher values (p<0.001) on foreign dishes using Kimchi such as Kimchi pizza and Kimchi spaghetti compared to the mothers group. Therefore, based on these results, the development of educational programs on Kimchi is needed not only at home but also at schools, by re-emphasizing the importance of value recognition for KImchi in our food culture

Shock ion acceleration by an ultrashort circularly polarized laser pulse via relativistic transparency in an exploded target

We investigated ion acceleration by an electrostatic shock in an exploded target irradiated by an ultrashort, circularly polarized laser pulse by means of one- and three-dimensional particle-in-cell simulations. We discovered that the laser field penetrating via relativistic transparency (RT) rapidly heated the upstream electron plasma to enable the formation of a high-speed electrostatic shock. Owing to the RT-based rapid heating and the fast compression of the initial density spike by a circularly polarized pulse, a new regime of the shock ion acceleration driven by an ultrashort (20-40 fs), moderately intense (1-1.4 PW) laser pulse is envisaged. This regime enables more efficient shock ion acceleration under a limited total pulse energy than a linearly polarized pulse with crystal laser systems of lambda similar to 1 mu mopen