Structural Deep Embedding for Hyper-Networks

Network embedding has recently attracted lots of attentions in data mining. Existing network embedding methods mainly focus on networks with pairwise relationships. In real world, however, the relationships among data points could go beyond pairwise, i.e., three or more objects are involved in each relationship represented by a hyperedge, thus forming hyper-networks. These hyper-networks pose great challenges to existing network embedding methods when the hyperedges are indecomposable, that is to say, any subset of nodes in a hyperedge cannot form another hyperedge. These indecomposable hyperedges are especially common in heterogeneous networks. In this paper, we propose a novel Deep Hyper-Network Embedding (DHNE) model to embed hyper-networks with indecomposable hyperedges. More specifically, we theoretically prove that any linear similarity metric in embedding space commonly used in existing methods cannot maintain the indecomposibility property in hyper-networks, and thus propose a new deep model to realize a non-linear tuplewise similarity function while preserving both local and global proximities in the formed embedding space. We conduct extensive experiments on four different types of hyper-networks, including a GPS network, an online social network, a drug network and a semantic network. The empirical results demonstrate that our method can significantly and consistently outperform the state-of-the-art algorithms.Comment: Accepted by AAAI 1

Graph Attention for Automated Audio Captioning

State-of-the-art audio captioning methods typically use the encoder-decoder structure with pretrained audio neural networks (PANNs) as encoders for feature extraction. However, the convolution operation used in PANNs is limited in capturing the long-time dependencies within an audio signal, thereby leading to potential performance degradation in audio captioning. This letter presents a novel method using graph attention (GraphAC) for encoder-decoder based audio captioning. In the encoder, a graph attention module is introduced after the PANNs to learn contextual association (i.e. the dependency among the audio features over different time frames) through an adjacency graph, and a top-k mask is used to mitigate the interference from noisy nodes. The learnt contextual association leads to a more effective feature representation with feature node aggregation. As a result, the decoder can predict important semantic information about the acoustic scene and events based on the contextual associations learned from the audio signal. Experimental results show that GraphAC outperforms the state-of-the-art methods with PANNs as the encoders, thanks to the incorporation of the graph attention module into the encoder for capturing the long-time dependencies within the audio signal. The source code is available at https://github.com/LittleFlyingSheep/GraphAC.Comment: Accepted by IEEE Signal Processing Letter

Anomalous Sound Detection using Audio Representation with Machine ID based Contrastive Learning Pretraining

Existing contrastive learning methods for anomalous sound detection refine the audio representation of each audio sample by using the contrast between the samples' augmentations (e.g., with time or frequency masking). However, they might be biased by the augmented data, due to the lack of physical properties of machine sound, thereby limiting the detection performance. This paper uses contrastive learning to refine audio representations for each machine ID, rather than for each audio sample. The proposed two-stage method uses contrastive learning to pretrain the audio representation model by incorporating machine ID and a self-supervised ID classifier to fine-tune the learnt model, while enhancing the relation between audio features from the same ID. Experiments show that our method outperforms the state-of-the-art methods using contrastive learning or self-supervised classification in overall anomaly detection performance and stability on DCASE 2020 Challenge Task2 dataset.Comment: To appear in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023

Relationship between soil water content and soil particle size on typical slopes of the Loess Plateau during a drought year

In the context of global climate change as well as local climate warming and drying on the Loess Plateau of China, understanding the relationship between soil particle size and soil water distribution during years of atypical precipitation is important. In this study, fractal geometry theory is used to describe the mechanical composition and texture of soils to improve our understanding of hydropedology and ecohydrology in the critical zone on the Loess Plateau. One grassland slope and two shrubland slopes were selected in the hilly and gully region of the Loess Plateau, and soils were sampled along hillslope transects at depths of 0–500 cm. Fractal theory and redundancy analysis (RDA) were used to identify relationships between the fractal dimension of soil particle-size distributions and the corresponding van Genuchten parameters for the soil-water-characteristic curves. The oven-drying method was used to measure soil water content, and the high-speed centrifugation method was used to generate soil-water-characteristic curves. The results show that (1) the soil water that can be used by Caragana korshinskii during a drought year is distributed below 2 m from the surface, whereas the soil water that can be used by grass is below 1.2 m; (2) Caragana korshinskii promotes the conservation of fine soil particles more than does natural restored grass, and the soil particle-size distribution fractal dimension changes with depth and position; and (3) soil hydraulic properties correlate strongly with soil pedological properties such as bulk density and the soil particle-size distribution fractal dimension. These results provide a case study of the relationships among soil distributions, hydrologic and geomorphic processes for vegetation restoration in drylands with a thick vadose zone. More studies on soil property changes are needed to provide case studies and empirical support for ecological restoration in the Loess Plateau of China

Variations of deep soil moisture under different vegetation types and influencing factors in a watershed of the Loess Plateau, China

Soil moisture in deep soil layers is a relatively stable water resource for vegetation growth in the semi-arid Loess Plateau of China. Characterizing the variations in deep soil moisture and its influencing factors at a moderate watershed scale is important to ensure the sustainability of vegetation restoration efforts. In this study, we focus on analyzing the variations and factors that influence the deep soil moisture (DSM) in 80–500 cm soil layers based on a soil moisture survey of the Ansai watershed in Yan'an in Shanxi Province. Our results can be divided into four main findings. (1) At the watershed scale, higher variations in the DSM occurred at 120–140 and 480–500 cm in the vertical direction. At the comparable depths, the variation in the DSM under native vegetation was much lower than that in human-managed vegetation and introduced vegetation. (2) The DSM in native vegetation and human-managed vegetation was significantly higher than that in introduced vegetation, and different degrees of soil desiccation occurred under all the introduced vegetation types. Caragana korshinskii and black locust caused the most serious desiccation. (3) Taking the DSM conditions of native vegetation as a reference, the DSM in this watershed could be divided into three layers: (i) a rainfall transpiration layer (80–220 cm); (ii) a transition layer (220–400 cm); and (iii) a stable layer (400–500 cm). (4) The factors influencing DSM at the watershed scale varied with vegetation types. The main local controls of the DSM variations were the soil particle composition and mean annual rainfall; human agricultural management measures can alter the soil bulk density, which contributes to higher DSM in farmland and apple orchards. The plant growth conditions, planting density, and litter water holding capacity of introduced vegetation showed significant relationships with the DSM. The results of this study are of practical significance for vegetation restoration strategies, especially for the choice of vegetation types, planting zones, and proper human management measures