Self-Supervised Graph Neural Network for Multi-Source Domain Adaptation

Domain adaptation (DA) tries to tackle the scenarios when the test data does not fully follow the same distribution of the training data, and multi-source domain adaptation (MSDA) is very attractive for real world applications. By learning from large-scale unlabeled samples, self-supervised learning has now become a new trend in deep learning. It is worth noting that both self-supervised learning and multi-source domain adaptation share a similar goal: they both aim to leverage unlabeled data to learn more expressive representations. Unfortunately, traditional multi-task self-supervised learning faces two challenges: (1) the pretext task may not strongly relate to the downstream task, thus it could be difficult to learn useful knowledge being shared from the pretext task to the target task; (2) when the same feature extractor is shared between the pretext task and the downstream one and only different prediction heads are used, it is ineffective to enable inter-task information exchange and knowledge sharing. To address these issues, we propose a novel \textbf{S}elf-\textbf{S}upervised \textbf{G}raph Neural Network (SSG), where a graph neural network is used as the bridge to enable more effective inter-task information exchange and knowledge sharing. More expressive representation is learned by adopting a mask token strategy to mask some domain information. Our extensive experiments have demonstrated that our proposed SSG method has achieved state-of-the-art results over four multi-source domain adaptation datasets, which have shown the effectiveness of our proposed SSG method from different aspects

Graph Attention Transformer Network for Multi-Label Image Classification

Multi-label classification aims to recognize multiple objects or attributes from images. However, it is challenging to learn from proper label graphs to effectively characterize such inter-label correlations or dependencies. Current methods often use the co-occurrence probability of labels based on the training set as the adjacency matrix to model this correlation, which is greatly limited by the dataset and affects the model's generalization ability. In this paper, we propose a Graph Attention Transformer Network (GATN), a general framework for multi-label image classification that can effectively mine complex inter-label relationships. First, we use the cosine similarity based on the label word embedding as the initial correlation matrix, which can represent rich semantic information. Subsequently, we design the graph attention transformer layer to transfer this adjacency matrix to adapt to the current domain. Our extensive experiments have demonstrated that our proposed methods can achieve state-of-the-art performance on three datasets

The gradient projection algorithm with adaptive mutation step length for non-probabilistic reliability index

Ciljajući na probleme odabira parametra korak-veličina i prerane konvergencije koja se dogodila kod pretraživanja na lokalnom optimalnom području u dizajnu adaptivnog gradijenta projekcijskog algoritma u ovom radu, uspostavljena je strategija mehanizma prilagodljive varijable korak-veličina i mehanizma prilagodljive promjenljive varijable korak-veličina. Uvedene su u algoritam gradijenta projekcije i upotrebljene za reguliranje duljine koraka iteracije. Kroz primjere indeksa nevjerojatnosne pouzdanosti može se pokazati da se tom metodom može brzo i točno izračunati indeks pouzdanosti kad model ima višestruke varijable i složenu funkciju graničnog stanja. Kod komparacije i kontrastiranja ovog algoritma s algoritmom gradijenta projekcije, taj algoritam nije osjetljiv na položaj polazne točke. Tako on ne samo da uzima u obzir i lokalnu performansu i globalnu sposobnost pretraživanja već posjeduje i veliku brzinu konvergencije i visoku preciznost. Stoga je to učinkovit i praktičan algoritam optimizacije.Aiming at the problems of selection parameter step-size and premature convergence that occurred when searching the local area in the optimal design of adaptive gradient projection algorithm in this paper, adaptive variable step-size mechanism strategy and adaptive variable step-size mechanism were established. They were introduced into the gradient projection algorithm, and were used to control iteration step length. Through the examples of non-probabilistic reliability index, it can be showed that the method could quickly and accurately calculate the reliability index when the model had multiple variables and complex limit state function. To compare and contrast this algorithm with the simple gradient projection algorithm, this algorithm is not sensitive to the initial point position. And it not only takes into account both local performance and global search ability, but also has fast convergence speed and high precision. So it is an efficient and practical optimization algorithm

Reducing Crosstalk of Silicon-based Optical Switch with All-optical Multi-wavelength Regenerator

Improving crosstalk performance of Mach–Zehnder-interferometer-type optical switches is experimentally investigated by use of an all-optical multi-wavelength regenerator. Extinction ratio and bit error rate of WDM signals are simultaneously improved in proposed regenerative optical switching

Mixed comparison of interventions for different exercise types on students with Internet addiction: a network meta-analysis

BackgroundInternet addiction (IA) has a significant negative impact on students. The condition of students with IA can be improved by exercise, which has been identified as an effective intervention strategy. However, the relative effectiveness of different exercise types and the most effective ones remains unknown. This study presents a network meta-analysis to compare six exercise types (team sport, double sport, single sport, team + double sport, team + single sport, and team + double + single sport) based on their effectiveness in reducing Internet addiction and maintaining mental health.MethodsSystematic searches were conducted in PubMed, EMBASE, Cochrane Library, CNKI, Wan Fang, CQVIP, Web of Science, CBM, EBSCO, APA PsycNet, and Scopus, and all relevant studies from the beginning to 15 July 2022 were included on. According to the Cochrane Handbook 5.1.0 Methodological Quality Evaluation Criteria, the listed studies' bias risk was assessed, while the network meta-analysis was performed using STATA 16.0.ResultsA total of 39 randomized controlled trials that met all inclusion criteria including 2,408 students with IA were examined. The meta-analysis results showed that compared with the control group, exercising significantly improved loneliness, anxiety, depression, and interpersonal sensitivity (p < 0.05). Specifically, the network meta-analysis discovered that the single sport, team sport, double sport, team + double sport, and team + double + single sport had significant effects on improving Internet addiction as compared to the respective control group (p < 0.05); the single sport, team sport, and double sport tend to be effective compared with controls in improving mental health (p < 0.05). Compared with the other five types of sports, the double sport was ranked first and showed the greatest potential to be the best choice (cluster ranking value = 3699.73) in improving Internet addiction (SUCRA = 85.5) and mental health (SUCRA = 93.1).ConclusionExercise could be suggested as the best alternative when treating IA in students, based on the extensive positive effects of exercise on IA, anxiety, depression, interpersonal sensitivity, loneliness, and mental health in IA students. Double sport may be the best type of exercise for Internet-addicted students. However, to further examine the benefits of exercise for IA students, more research is required.Systematic review registrationhttps://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=377035, identifier: CRD42022377035

StaPep: an open-source tool for the structure prediction and feature extraction of hydrocarbon-stapled peptides

Many tools exist for extracting structural and physiochemical descriptors from linear peptides to predict their properties, but similar tools for hydrocarbon-stapled peptides are lacking.Here, we present StaPep, a Python-based toolkit designed for generating 2D/3D structures and calculating 21 distinct features for hydrocarbon-stapled peptides.The current version supports hydrocarbon-stapled peptides containing 2 non-standard amino acids (norleucine and 2-aminoisobutyric acid) and 6 nonnatural anchoring residues (S3, S5, S8, R3, R5 and R8).Then we established a hand-curated dataset of 201 hydrocarbon-stapled peptides and 384 linear peptides with sequence information and experimental membrane permeability, to showcase StaPep's application in artificial intelligence projects.A machine learning-based predictor utilizing above calculated features was developed with AUC of 0.85, for identifying cell-penetrating hydrocarbon-stapled peptides.StaPep's pipeline spans data retrieval, cleaning, structure generation, molecular feature calculation, and machine learning model construction for hydrocarbon-stapled peptides.The source codes and dataset are freely available on Github: https://github.com/dahuilangda/stapep_package.Comment: 26 pages, 6 figure

An improved YOLOv5s model for assessing apple graspability in automated harvesting scene

IntroductionWith continuously increasing labor costs, an urgent need for automated apple- Qpicking equipment has emerged in the agricultural sector. Prior to apple harvesting, it is imperative that the equipment not only accurately locates the apples, but also discerns the graspability of the fruit. While numerous studies on apple detection have been conducted, the challenges related to determining apple graspability remain unresolved.MethodsThis study introduces a method for detecting multi-occluded apples based on an enhanced YOLOv5s model, with the aim of identifying the type of apple occlusion in complex orchard environments and determining apple graspability. Using bootstrap your own atent(BYOL) and knowledge transfer(KT) strategies, we effectively enhance the classification accuracy for multi-occluded apples while reducing data production costs. A selective kernel (SK) module is also incorporated, enabling the network model to more precisely identify various apple occlusion types. To evaluate the performance of our network model, we define three key metrics: APGA, APTUGA, and APUGA, representing the average detection accuracy for graspable, temporarily ungraspable, and ungraspable apples, respectively.ResultsExperimental results indicate that the improved YOLOv5s model performs exceptionally well, achieving detection accuracies of 94.78%, 93.86%, and 94.98% for APGA, APTUGA, and APUGA, respectively.DiscussionCompared to current lightweight network models such as YOLOX-s and YOLOv7s, our proposed method demonstrates significant advantages across multiple evaluation metrics. In future research, we intend to integrate fruit posture and occlusion detection to f]urther enhance the visual perception capabilities of apple-picking equipment

Genome sequences reveal global dispersal routes and suggest convergent genetic adaptations in seahorse evolution

Seahorses have a circum-global distribution in tropical to temperate coastal waters. Yet, seahorses show many adaptations for a sedentary, cryptic lifestyle: they require specific habitats, such as seagrass, kelp or coral reefs, lack pelvic and caudal fins, and give birth to directly developed offspring without pronounced pelagic larval stage, rendering long-range dispersal by conventional means inefficient. Here we investigate seahorses’ worldwide dispersal and biogeographic patterns based on a de novo genome assembly of Hippocampus erectus as well as 358 re-sequenced genomes from 21 species. Seahorses evolved in the late Oligocene and subsequent circum-global colonization routes are identified and linked to changing dynamics in ocean currents and paleo-temporal seaway openings. Furthermore, the genetic basis of the recurring “bony spines” adaptive phenotype is linked to independent substitutions in a key developmental gene. Analyses thus suggest that rafting via ocean currents compensates for poor dispersal and rapid adaptation facilitates colonizing new habitats.Fil: Chunyan, Li. Southern Marine Science and Engineering Guangdong Laboratory; China. Pilot National Laboratory for Marine Science and Technology; China. Chinese Academy of Sciences; República de ChinaFil: Olave, Melisa. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mendoza. Instituto Argentino de Investigaciones de las Zonas Áridas. Provincia de Mendoza. Instituto Argentino de Investigaciones de las Zonas Áridas. Universidad Nacional de Cuyo. Instituto Argentino de Investigaciones de las Zonas Áridas; Argentina. University of Konstanz; AlemaniaFil: Hou, Yali. Chinese Academy of Sciences; República de ChinaFil: Geng, Qi. Chinese Academy of Sciences; República de China. Southern Marine Science and Engineering Guangdong Laboratory; ChinaFil: Schneider, Ralf. University Of Konstanz; Alemania. Helmholtz Centre for Ocean Research Kie; AlemaniaFil: Zeixa, Gao. Huazhong Agricultural University; ChinaFil: Xiaolong, Tu. Allwegene Technologies ; ChinaFil: Xin, Wang. Chinese Academy of Sciences; República de ChinaFil: Furong, Qi. China National Center for Bioinformation; China. University of Chinese Academy of Sciences; ChinaFil: Nater, Alexander. University of Konstanz; AlemaniaFil: Kautt, Andreas F.. University of Konstanz; Alemania. Harvard University; Estados UnidosFil: Wan, Shiming. Chinese Academy of Sciences; República de ChinaFil: Yanhong, Zhang. Chinese Academy of Sciences; República de ChinaFil: Yali, Liu. Chinese Academy of Sciences; República de ChinaFil: Huixian, Zhang. Chinese Academy of Sciences; República de ChinaFil: Bo, Zhang. Chinese Academy of Sciences; República de ChinaFil: Hao, Zhang. Chinese Academy of Sciences; República de ChinaFil: Meng, Qu ,. Chinese Academy of Sciences; República de ChinaFil: Shuaishuai, Liu. Chinese Academy of Sciences; República de ChinaFil: Zeyu, Chen. Chinese Academy of Sciences; República de China. University of Chinese Academy of Sciences; ChinaFil: Zhong, Jia. Chinese Academy of Sciences; República de ChinaFil: Zhang, He. BGI-Shenzhen; ChinaFil: Meng, Lingfeng. BGI-Shenzhen; ChinaFil: Wang, Kai. Ludong University; ChinaFil: Yin, Jianping. Chinese Academy of Sciences; República de ChinaFil: Huang, Liangmin. Chinese Academy of Sciences; República de China. University of Chinese Academy of Sciences; ChinaFil: Venkatesh, Byrappa. Institute of Molecular and Cell Biology; SingapurFil: Meyer, Axel. University of Konstanz; AlemaniaFil: Lu, Xuemei. Chinese Academy of Sciences; República de ChinaFil: Lin, Qiang. Chinese Academy of Sciences; República de China. Southern Marine Science and Engineering Guangdong Laboratory; China. Pilot National Laboratory for Marine Science and Technology; China. University of Chinese Academy of Sciences; Chin