A Visual Interpretation-Based Self-Improved Classification System Using Virtual Adversarial Training

The successful application of large pre-trained models such as BERT in natural language processing has attracted more attention from researchers. Since the BERT typically acts as an end-to-end black box, classification systems based on it usually have difficulty in interpretation and low robustness. This paper proposes a visual interpretation-based self-improving classification model with a combination of virtual adversarial training (VAT) and BERT models to address the above problems. Specifically, a fine-tuned BERT model is used as a classifier to classify the sentiment of the text. Then, the predicted sentiment classification labels are used as part of the input of another BERT for spam classification via a semi-supervised training manner using VAT. Additionally, visualization techniques, including visualizing the importance of words and normalizing the attention head matrix, are employed to analyze the relevance of each component to classification accuracy. Moreover, brand-new features will be found in the visual analysis, and classification performance will be improved. Experimental results on Twitter's tweet dataset demonstrate the effectiveness of the proposed model on the classification task. Furthermore, the ablation study results illustrate the effect of different components of the proposed model on the classification results

In Situ Hybridization Analysis of the Expression of Futsch, Tau, and MESK2 Homologues in the Brain of the European Honeybee (Apis mellifera L.)

BACKGROUND: The importance of visual sense in Hymenopteran social behavior is suggested by the existence of a Hymenopteran insect-specific neural circuit related to visual processing and the fact that worker honeybee brain changes morphologically according to its foraging experience. To analyze molecular and neural bases that underlie the visual abilities of the honeybees, we used a cDNA microarray to search for gene(s) expressed in a neural cell-type preferential manner in a visual center of the honeybee brain, the optic lobes (OLs). METHODOLOGY/PRINCIPAL FINDINGS: Expression analysis of candidate genes using in situ hybridization revealed two genes expressed in a neural cell-type preferential manner in the OLs. One is a homologue of Drosophila futsch, which encodes a microtubule-associated protein and is preferentially expressed in the monopolar cells in the lamina of the OLs. The gene for another microtubule-associated protein, tau, which functionally overlaps with futsch, was also preferentially expressed in the monopolar cells, strongly suggesting the functional importance of these two microtubule-associated proteins in monopolar cells. The other gene encoded a homologue of Misexpression Suppressor of Dominant-negative Kinase Suppressor of Ras 2 (MESK2), which might activate Ras/MAPK-signaling in Drosophila. MESK2 was expressed preferentially in a subclass of neurons located in the ventral region between the lamina and medulla neuropil in the OLs, suggesting that this subclass is a novel OL neuron type characterized by MESK2-expression. These three genes exhibited similar expression patterns in the worker, drone, and queen brains, suggesting that they function similarly irrespective of the honeybee sex or caste. CONCLUSIONS: Here we identified genes that are expressed in a monopolar cell (Amfutsch and Amtau) or ventral medulla-preferential manner (AmMESK2) in insect OLs. These genes may aid in visualizing neurites of monopolar cells and ventral medulla cells, as well as in analyzing the function of these neurons

Endogenous androgens diminish food intake and activation of orexin A neurons in response to reduced glucose availability in male rats

Sex steroids modify feeding behavior and body weight regulation, and androgen reportedly augments food intake and body weight gain. To elucidate the role of endogenous androgens in the feeding regulation induced by reduced glucose availability, we examined the effect of gonadectomy (orchiectomy) on food intake and orexin A neuron’s activity in the lateral hypothalamic/perifornical area (LH/PFA) in response to reduced glucose availability (glucoprivation) induced by 2-deoxy-d-glucose (2DG) administration in male rats. Rats (7W) were bilaterally orchiectomized (ORX group) or sham operated (Sham group). Seventeen days after the surgery, food intake response to 2DG (400 mg/kg, i.v.) was measured for 4 h after the infusion. The same experiment was performed for the immunohistochemical examination of c-Fos-expressing orexin A neurons in the LH/PFA and c-Fos expression in the arcuate nucleus (Arc). Food intake induced by glucoprivation was greater in the ORX group than the Sham group, and the glucoprivation-induced food intake was inversely correlated with plasma testosterone concentration. Glucoprivation stimulated c-Fos expression of the orexin A neurons at the LH/PFA and c-Fos expression in the dorsomedial Arc. The number and percentage of c-Fos-expressing orexin A neurons in the LH/PFA and c-Fos expression in the dorsomedial Arc were significantly higher in the ORX group than the Sham group. This indicates that endogenous androgen, possibly testosterone, diminishes the food intake induced by reduced glucose availability, possibly via the attenuated activity of orexin A neuron in the LH/PFA and neurons in the dorsomedial Arc

若年女性の生活習慣と脂質代謝の関連に関する検討

The purpose of this study is to review the factors influencing lipid metabolism of young women in terms of both exercise and nutrition. From the side of nutrition，we reviewed how lipid metabolism is influenced by taking a commercial fish oil supplement（LIQUAMEN）. Total cholesterol deteriorated significantly by taking LIQUAMEN. Improvement of lipid metabolism by LIQUAMEN was suggested. The value of HDL-cholesterol，adiponectin，and leptin were significantly lower in the group of living activity strength Ⅱ while the values of TG and TNF-α increased significantly. This result suggested the possibility that lipid metabolism deteriorated in subjects whose activity was below a certain amount. It also suggested the possibility that lipid metabolism improved in those whose activity was above a certain amount. In the body fat-to-weight ratio， the living activity strengthⅢ・ Ⅳ group showed a significantly lower tendency compared to the group of living activity strength Ⅱ and the group of living activity strengthⅢ・ Ⅳ . This finding suggested that if activity was greater than a certain amount，the body fat-to-weight ratio tended to be comparatively low

The Constrained Maximal Expression Level Owing to Haploidy Shapes Gene Content on the Mammalian X Chromosome.

X chromosomes are unusual in many regards, not least of which is their nonrandom gene content. The causes of this bias are commonly discussed in the context of sexual antagonism and the avoidance of activity in the male germline. Here, we examine the notion that, at least in some taxa, functionally biased gene content may more profoundly be shaped by limits imposed on gene expression owing to haploid expression of the X chromosome. Notably, if the X, as in primates, is transcribed at rates comparable to the ancestral rate (per promoter) prior to the X chromosome formation, then the X is not a tolerable environment for genes with very high maximal net levels of expression, owing to transcriptional traffic jams. We test this hypothesis using The Encyclopedia of DNA Elements (ENCODE) and data from the Functional Annotation of the Mammalian Genome (FANTOM5) project. As predicted, the maximal expression of human X-linked genes is much lower than that of genes on autosomes: on average, maximal expression is three times lower on the X chromosome than on autosomes. Similarly, autosome-to-X retroposition events are associated with lower maximal expression of retrogenes on the X than seen for X-to-autosome retrogenes on autosomes. Also as expected, X-linked genes have a lesser degree of increase in gene expression than autosomal ones (compared to the human/Chimpanzee common ancestor) if highly expressed, but not if lowly expressed. The traffic jam model also explains the known lower breadth of expression for genes on the X (and the Z of birds), as genes with broad expression are, on average, those with high maximal expression. As then further predicted, highly expressed tissue-specific genes are also rare on the X and broadly expressed genes on the X tend to be lowly expressed, both indicating that the trend is shaped by the maximal expression level not the breadth of expression per se. Importantly, a limit to the maximal expression level explains biased tissue of expression profiles of X-linked genes. Tissues whose tissue-specific genes are very highly expressed (e.g., secretory tissues, tissues abundant in structural proteins) are also tissues in which gene expression is relatively rare on the X chromosome. These trends cannot be fully accounted for in terms of alternative models of biased expression. In conclusion, the notion that it is hard for genes on the Therian X to be highly expressed, owing to transcriptional traffic jams, provides a simple yet robustly supported rationale of many peculiar features of X's gene content, gene expression, and evolution

Data Augmentation Methods for Enhancing Robustness in Text Classification Tasks

Text classification is widely studied in natural language processing (NLP). Deep learning models, including large pre-trained models like BERT and DistilBERT, have achieved impressive results in text classification tasks. However, these models’ robustness against adversarial attacks remains an area of concern. To address this concern, we propose three data augmentation methods to improve the robustness of such pre-trained models. We evaluated our methods on four text classification datasets by fine-tuning DistilBERT on the augmented datasets and exposing the resulting models to adversarial attacks to evaluate their robustness. In addition to enhancing the robustness, our proposed methods can improve the accuracy and F1-score on three datasets. We also conducted comparison experiments with two existing data augmentation methods. We found that one of our proposed methods demonstrates a similar improvement in terms of performance, but all demonstrate a superior robustness improvement

Extensive Macular Atrophy with Pseudodrusen in a Japanese Patient Evaluated by Wide-Field OCTA

Extensive macular atrophy with pseudodrusen (EMAP) is a relatively newly proposed clinical entity that was first reported in 2009. Although no definitive diagnostic criteria have been defined, characteristic findings can distinguish it from other diseases, especially dry age-related macular dystrophy (AMD). Herein, we present the case of a patient with EMAP who underwent a comprehensive ophthalmic examination and whole-exome sequencing (WES). A 72-year-old Japanese man complained of progressive visual impairment in his right eye and nyctalopia. Ophthalmic examination revealed that the best-corrected visual acuity (BCVA) in decimal units was 0.08 on the right and 0.8 on the left. Fundoscopy and fundus autofluorescence (FAF) revealed well-demarcated symmetrical macular atrophy, with a vertical axis larger than the horizontal axis, which reached the vascular arcade inferiorly and exceeded it superiorly. Pseudodrusen were widespread throughout the retina in both eyes. Paving-stone degeneration was not observed in the extreme periphery of either eye. Seven months later, his left BCVA decreased to 0.3 without major changes on multimodal imaging. Based on the above findings, we diagnosed EMAP. Wide-field optical coherence tomography angiography (OCTA) showed no significant changes in the retinal vessels, but the density of choroidal vessels was reduced in the degenerated areas. We thought that this finding suggests that EMAP originates between the deep retina and choroid. WES did not reveal any candidate mutations in known pathogenic genes. To the best of our knowledge, this is the first report of a Japanese patient with EMAP, and no data for analysis of wide-field OCTA or equatorial OCT images of EMAP cases have been found in previous reports. EMAP is not well recognized in Asia and may be incorrectly diagnosed as dry-type AMD. EMAP should be included in the differential diagnosis of dry AMD, and this may lead to more Asians being diagnosed with EMAP in the future

Two Japanese Families with Pigmented Paravenous Retinochoroidal Atrophy and HK1 Mutation: A Case Report

Hexokinase 1 (HK1) gene is the cause of autosomal dominant retinitis pigmentosa (RP) 79. To date, only E874K mutation has been reported as the causative mutation in patients with nonsyndromic RP. As a Caucasian RP case with a pathological variant of HK1 exhibiting pigmented paravenous retinochoroidal atrophy (PPRCA) phenotype was recently reported, we reviewed RP79 cases in our Japanese RP cohort. Consequently, 2 Japanese patients, who were diagnosed with RP79 by genetic tests in our RP cohort, were included in this study. Patient 1 was a 60-year-old woman. Fundus examination revealed symmetrical donut-shaped retinal degeneration, with pigment deposition avoiding the macula. Moreover, degeneration extended in a peripheral direction along the vessels like a starfish, and degeneration was observed around the veins and arteries. Patient 2 was a 75-year-old man. Fundus examination revealed symmetric macula-avoiding donut-shaped retinal degeneration, with paravenous protruding degeneration along the blood vessels like in case 1. Both Japanese cases, which belonged to two separate families, had the same HK1 pathogenic mutation, with a phenotype of PPRCA. Furthermore, atrophy along retinal arteries was noted. Reviewing previous nonsyndromic RP79 cases revealed symptoms that are believed to be those of PPRCA. Ultra-widefield fundus imaging, especially ultra-widefield fundus autofluorescence, has been useful in detecting PPRCA. If these devices become widely available, more cases may be discovered in the future because PPRCA can be used as a clue to suspect RP79, and Sanger sequencing may be used to identify pathogenic mutations in HK1 at a lower cost and more easily than using whole-exome sequencing