7,872 research outputs found
Multi-modal Semantic Understanding with Contrastive Cross-modal Feature Alignment
Multi-modal semantic understanding requires integrating information from
different modalities to extract users' real intention behind words. Most
previous work applies a dual-encoder structure to separately encode image and
text, but fails to learn cross-modal feature alignment, making it hard to
achieve cross-modal deep information interaction. This paper proposes a novel
CLIP-guided contrastive-learning-based architecture to perform multi-modal
feature alignment, which projects the features derived from different
modalities into a unified deep space. On multi-modal sarcasm detection (MMSD)
and multi-modal sentiment analysis (MMSA) tasks, the experimental results show
that our proposed model significantly outperforms several baselines, and our
feature alignment strategy brings obvious performance gain over models with
different aggregating methods and models even enriched with knowledge. More
importantly, our model is simple to implement without using task-specific
external knowledge, and thus can easily migrate to other multi-modal tasks. Our
source codes are available at https://github.com/ChangKe123/CLFA.Comment: 10 pages, 4 figures, accepted by LREC-COLING 2024(main conference,
long paper
Research on the Stability Structuring of Cooperation and Conflicts between main manufacturers and suppliers of the large airctaft project——analysis based on the game payoff structure matrix
The large aircraft project of China adopted the “main manufacturers – suppliers” mode for research and development (R&D), and the conflict that existed in the process of cooperation between the two sides will affect the results of the large aircraft project. This paper analyzed the cooperation and conflict between the main manufacturers and suppliers from the perspective of the expected return. Through the establishment of the game payoff structure matrix, the factors which affected the stable operation of the "main manufacturers – suppliers "mode were researched. Keywords: the main manufacturers; suppliers; cooperation and conflict; payoff matri
- …