Ranking-based Deep Cross-modal Hashing

Cross-modal hashing has been receiving increasing interests for its low storage cost and fast query speed in multi-modal data retrievals. However, most existing hashing methods are based on hand-crafted or raw level features of objects, which may not be optimally compatible with the coding process. Besides, these hashing methods are mainly designed to handle simple pairwise similarity. The complex multilevel ranking semantic structure of instances associated with multiple labels has not been well explored yet. In this paper, we propose a ranking-based deep cross-modal hashing approach (RDCMH). RDCMH firstly uses the feature and label information of data to derive a semi-supervised semantic ranking list. Next, to expand the semantic representation power of hand-crafted features, RDCMH integrates the semantic ranking information into deep cross-modal hashing and jointly optimizes the compatible parameters of deep feature representations and of hashing functions. Experiments on real multi-modal datasets show that RDCMH outperforms other competitive baselines and achieves the state-of-the-art performance in cross-modal retrieval applications

A Quantum Probability Driven Framework for Joint Multi-Modal Sarcasm, Sentiment and Emotion Analysis

Sarcasm, sentiment, and emotion are three typical kinds of spontaneous affective responses of humans to external events and they are tightly intertwined with each other. Such events may be expressed in multiple modalities (e.g., linguistic, visual and acoustic), e.g., multi-modal conversations. Joint analysis of humans' multi-modal sarcasm, sentiment, and emotion is an important yet challenging topic, as it is a complex cognitive process involving both cross-modality interaction and cross-affection correlation. From the probability theory perspective, cross-affection correlation also means that the judgments on sarcasm, sentiment, and emotion are incompatible. However, this exposed phenomenon cannot be sufficiently modelled by classical probability theory due to its assumption of compatibility. Neither do the existing approaches take it into consideration. In view of the recent success of quantum probability (QP) in modeling human cognition, particularly contextual incompatible decision making, we take the first step towards introducing QP into joint multi-modal sarcasm, sentiment, and emotion analysis. Specifically, we propose a QUantum probabIlity driven multi-modal sarcasm, sEntiment and emoTion analysis framework, termed QUIET. Extensive experiments on two datasets and the results show that the effectiveness and advantages of QUIET in comparison with a wide range of the state-of-the-art baselines. We also show the great potential of QP in multi-affect analysis

Physics-informed machine learning for solving partial differential equations in porous media

Physical phenomenon in nature is generally simulated by partial differential equations. Among different sorts of partial differential equations, the problem of two-phase flow in porous media has been paid intense attention. As a promising direction, physics-informed neural networks shed new light on the solution of partial differential equations. However, current physics-informed neural networks’ ability to learn partial differential equations relies on adding artificial diffusion or using prior knowledge to increase the number of training points along the shock trajectory, or adaptive activation functions. To address these issues, this study proposes a physics-informed neural network with long short-term memory and attention mechanism, an ingenious method to solve the Buckley-Leverett partial differential equations representing two-phase flow in porous media. The designed network structure overcomes the dependency on artificial diffusion terms and enhances the importance of shallow features. The experimental results show that the proposed method is in good agreement with analytical solutions. Accurate approximations are shown even when encountering shock points in saturated fields of porous media. Furthermore, experiments show our innovative method outperforms existing traditional physics-informed machine learning approaches.Cited as: Shan, L., Liu, C., Liu, Y., Tu, Y., Dong, L., Hei, X. Physics-informed machine learning for solving partial differential equations in porous media. Advances in Geo-Energy Research, 2023, 8(1): 37-44. https://doi.org/10.46690/ager.2023.04.0

An mechatronics coupling design approach for aerostatic bearing spindles

In this paper, a new design approach for aerostatic bearing spindles (ABS) is firstly proposed which takes into account of the interactions between the mechanical and the servo subsystems, including the integration of electromagnetic effects, static pressure characteristics, servo control and mechanical characteristics. According to the air bearing design principle, the geometry of the spindle rotor is designed. The fluid software is used to analyze the influence of the bearing capacity and stiffness on the stability of the spindle. The simulation shows when the air film thickness is 12 μm, the bearing has good load carrying capacity and rigidity. In addition, the influence of motor harmonics on the spindle shaft modes is considered to avoid the resonance of ABS, and to ensure ABS anti-interference capability, proper inertia of ABS is calculated and analyzed. Finally, ABS has a good follow-up effect on the servo control and machining performance through the experimental prototype. The electromechanical coupling design approach for ABS proposed in this paper, can achieve a peak value better than 0.8 μm (surface size: 9 mm × 9 mm) and a surface roughness better than 8 nm in end face turning experiments