Biosignal Sequence Real-time Prediction for Game Users Based on Features Fusion of Local-Global and Time-Frequency Domain [Elektronisk resurs]

Abstract

Biosignal sequence real-time prediction (BSRP) is essential for predicting the future emotional experience of game users. However, BSRP for game users faces challenges, including poor real-time performance and limited feature fusion dimensions.To address these issues, we proposed a method for BSRP based on the features fusion of Local-Global and Time-Frequency domain (LGTF) for game users, which integrates real-time capabilities with multi-dimensional features fusion. Specifically, LGTF meets real-time requirements and achieves the features fusion of Local-Global through multi-channel synchronized adaptive convolution. In addition, LGTF implements the features fusion of inter- and intra-band in the frequency domain and the features fusion of time-frequency domain by incorporating the Self-Attention mechanism and Fourier Transform. Furthermore, we conducted comprehensive validation experiments on LGTF using the public dataset.The results indicate that: 1) In the comparison study, LGTF outperformed other methods, achieving the lowest average MSE and MAE values across different prediction lengths of 0.61 and 0.47, respectively. 2) Ablation studies revealed that the addition of time-frequency domain feature fusion (TF) and local-global feature fusion (LG) both have the positive effect on the prediction performance, reducing the average MSE by 0.11 and 0.09, respectively. 3) Generalization study shows that LGTF exhibits stable performance and generalization across different subjects and shows performance advantages in specific game scenarios. 4) Time performance analysis suggests LGTF has the real-time performance.5) Case study demonstrates that LGTF is practical for predicting game users' future emotions and enhancing their emotional experiences.</p