TACOformer:Token-channel compounded Cross Attention for Multimodal Emotion Recognition

Recently, emotion recognition based on physiological signals has emerged as a field with intensive research. The utilization of multi-modal, multi-channel physiological signals has significantly improved the performance of emotion recognition systems, due to their complementarity. However, effectively integrating emotion-related semantic information from different modalities and capturing inter-modal dependencies remains a challenging issue. Many existing multimodal fusion methods ignore either token-to-token or channel-to-channel correlations of multichannel signals from different modalities, which limits the classification capability of the models to some extent. In this paper, we propose a comprehensive perspective of multimodal fusion that integrates channel-level and token-level cross-modal interactions. Specifically, we introduce a unified cross attention module called Token-chAnnel COmpound (TACO) Cross Attention to perform multimodal fusion, which simultaneously models channel-level and token-level dependencies between modalities. Additionally, we propose a 2D position encoding method to preserve information about the spatial distribution of EEG signal channels, then we use two transformer encoders ahead of the fusion module to capture long-term temporal dependencies from the EEG signal and the peripheral physiological signal, respectively. Subject-independent experiments on emotional dataset DEAP and Dreamer demonstrate that the proposed model achieves state-of-the-art performance.Comment: Accepted by IJCAI 2023- AI4TS worksho

Improved Model Poisoning Attacks and Defenses in Federated Learning with Clustering

Federated Learning (FL) allows multiple participants to collaboratively train a deep learning model without sharing their private training data. However, due to its distributive nature, FL is vulnerable to various poisoning attacks. An adversary can submit malicious model updates that aim to degrade the joint model's utility. In this thesis, we formulate the adversary's goal as an optimization problem and present an effective model poisoning attack using projected gradient descent. Our empirical results show that our attack has a larger impact on the global model's accuracy than previous attacks. Motivated by this, we design a robust defense algorithm that mitigates existing poisoning attacks. Our defense leverages constraint k-means clustering and uses a small validation dataset for the server to select optimal updates in each FL round. We conduct experiments on three non-iid image classification datasets and demonstrate the robustness of our defense algorithm under various FL settings

Hard/Soft composited materials for stretchable electronics

Convergence between scientific disciplines creates myriads of new opportunities to the problems that traditional approaches have not provided the answers. For example, researches on materials engineering and nanofabrication can shed a light to the current challenges in clinical biomedical science. Specifically, this presentation describes how materials science is employed to solve fundamental and practical problems in the intimate integration of the state-of-art inorganic devices onto living organs or skins for biomedical research. [1] Firstly, bioresorbable elastomers make a basic building block for tissue scaffolds for soft, moving organs (such as heart, blood vessels, and smooth muscles) and for substrate material for resorbable devices for implantation. Poly(glycerol sebacate) (PGS) and its nanocomposite derivatives make up an attractive class of biomaterial owing to their tunable mechanical properties with programmable biodegradability. In practice, however, the application of PGS is often hampered by frequent inconsistency in reproducing process conditions. The inconsistency stems from the volatile nature of glycerol during the esterification process. In this presentation, we suggest that the degree of esterification (DE) can be used to predict precisely the physical status, the mechanical properties, and the degradation of the PGS materials [2]. To provide a processing guideline for researchers, we also provide a physical status map as a function of curing temperature and time (Fig 1). In addition, we demonstrate that the addition of molecularly rigid crosslinking agents and network-structured inorganic nanoparticles are also effective in enhancing the mechanical properties of the PGS-derived materials. Secondly, operation of wearable or implantable bioelectronics requires a power source; piezoelectricity generating device allows the direct harvest of power source from natural movement. We have recently addressed an inexpensive pathway to convert commodity polyurethane foams into piezoelectricity nanogenerators by uniform growth of ZnO nanorods in the pores of the foams, followed by conductive material deposition and encapsulation processes [3]. The hard/soft integrated nanocomposite material has a potential to become an important building block for wearable bioelectronics system. Thirdly, we demonstrate that a skin-adhesive electronic device from hard/soft material integration has a potential to aid patient populations in clinical setup [4]. Here, an emerging technology, called “epidermal electronics”, is introduced, where ultra-thin geometry allows for intimate and comfortable contact to patients’ chin, just like a temporary tattoo (Fig 2). The two objectives of this study were to assess the potential of epidermal electronics technology for swallowing therapy. This study showed comparative signals between the new epidermal sEMG patch and the conventional adhesive patches used by clinicians for swallowing therapy. Convergence between scientific disciplines creates myriads of new opportunities to the problems that traditional approaches have not provided the answers. For example, researches on materials engineering and nanofabrication can shed a light to the current challenges in clinical biomedical science. Specifically, this presentation describes how materials science is employed to solve fundamental and practical problems in the intimate integration of the state-of-art inorganic devices onto living organs or skins for biomedical research. [1] Firstly, bioresorbable elastomers make a basic building block for tissue scaffolds for soft, moving organs (such as heart, blood vessels, and smooth muscles) and for substrate material for resorbable devices for implantation. Poly(glycerol sebacate) (PGS) and its nanocomposite derivatives make up an attractive class of biomaterial owing to their tunable mechanical properties with programmable biodegradability. In practice, however, the application of PGS is often hampered by frequent inconsistency in reproducing process conditions. The inconsistency stems from the volatile nature of glycerol during the esterification process. In this presentation, we suggest that the degree of esterification (DE) can be used to predict precisely the physical status, the mechanical properties, and the degradation of the PGS materials [2]. To provide a processing guideline for researchers, we also provide a physical status map as a function of curing temperature and time (Fig 1). In addition, we demonstrate that the addition of molecularly rigid crosslinking agents and network-structured inorganic nanoparticles are also effective in enhancing the mechanical properties of the PGS-derived materials. Secondly, operation of wearable or implantable bioelectronics requires a power source; piezoelectricity generating device allows the direct harvest of power source from natural movement. We have recently addressed an inexpensive pathway to convert commodity polyurethane foams into piezoelectricity nanogenerators by uniform growth of ZnO nanorods in the pores of the foams, followed by conductive material deposition and encapsulation processes [3]. The hard/soft integrated nanocomposite material has a potential to become an important building block for wearable bioelectronics system. Thirdly, we demonstrate that a skin-adhesive electronic device from hard/soft material integration has a potential to aid patient populations in clinical setup [4]. Here, an emerging technology, called “epidermal electronics”, is introduced, where ultra-thin geometry allows for intimate and comfortable contact to patients’ chin, just like a temporary tattoo (Fig 2). The two objectives of this study were to assess the potential of epidermal electronics technology for swallowing therapy. This study showed comparative signals between the new epidermal sEMG patch and the conventional adhesive patches used by clinicians for swallowing therapy

Research and practice on training mode of applied talents for electrical engineering majors in universities

The training of applied talents focuses on students’ innovation ability and engineering practice ability, which requires electrical engineering teachers to fully embody the integration of theoretical knowledge and engineering practice in their teaching. In the teaching reform work, teachers should pay attention to optimize the teaching Settings, starting from two aspects of theory and practice, to promote students to obtain more knowledge of electricity, eff ectively develop students’ application level of electric electronic technology, and help students develop comprehensively. Colleges and universities should pay more attention to the training of application-oriented talents and train more qualifi ed talents for the development of social production. Based on this, this paper analyzes the practical strategies for the training mode of applied talents for electrical engineering majors in colleges and universities, in order to provide references for educators

Hard/Soft composited materials for stretchable electronics

Convergence between scientific disciplines creates myriads of new opportunities to the problems that traditional approaches have not provided the answers. For example, researches on materials engineering and nanofabrication can shed a light to the current challenges in clinical biomedical science. Specifically, this presentation describes how materials science is employed to solve fundamental and practical problems in the intimate integration of the state-of-art inorganic devices onto living organs or skins for biomedical research. [1] Firstly, bioresorbable elastomers make a basic building block for tissue scaffolds for soft, moving organs (such as heart, blood vessels, and smooth muscles) and for substrate material for resorbable devices for implantation. Poly(glycerol sebacate) (PGS) and its nanocomposite derivatives make up an attractive class of biomaterial owing to their tunable mechanical properties with programmable biodegradability. In practice, however, the application of PGS is often hampered by frequent inconsistency in reproducing process conditions. The inconsistency stems from the volatile nature of glycerol during the esterification process. In this presentation, we suggest that the degree of esterification (DE) can be used to predict precisely the physical status, the mechanical properties, and the degradation of the PGS materials [2]. To provide a processing guideline for researchers, we also provide a physical status map as a function of curing temperature and time (Fig 1). In addition, we demonstrate that the addition of molecularly rigid crosslinking agents and network-structured inorganic nanoparticles are also effective in enhancing the mechanical properties of the PGS-derived materials. Secondly, operation of wearable or implantable bioelectronics requires a power source; piezoelectricity generating device allows the direct harvest of power source from natural movement. We have recently addressed an inexpensive pathway to convert commodity polyurethane foams into piezoelectricity nanogenerators by uniform growth of ZnO nanorods in the pores of the foams, followed by conductive material deposition and encapsulation processes [3]. The hard/soft integrated nanocomposite material has a potential to become an important building block for wearable bioelectronics system. Thirdly, we demonstrate that a skin-adhesive electronic device from hard/soft material integration has a potential to aid patient populations in clinical setup [4]. Here, an emerging technology, called “epidermal electronics”, is introduced, where ultra-thin geometry allows for intimate and comfortable contact to patients’ chin, just like a temporary tattoo (Fig 2). The two objectives of this study were to assess the potential of epidermal electronics technology for swallowing therapy. This study showed comparative signals between the new epidermal sEMG patch and the conventional adhesive patches used by clinicians for swallowing therapy. Convergence between scientific disciplines creates myriads of new opportunities to the problems that traditional approaches have not provided the answers. For example, researches on materials engineering and nanofabrication can shed a light to the current challenges in clinical biomedical science. Specifically, this presentation describes how materials science is employed to solve fundamental and practical problems in the intimate integration of the state-of-art inorganic devices onto living organs or skins for biomedical research. [1] Firstly, bioresorbable elastomers make a basic building block for tissue scaffolds for soft, moving organs (such as heart, blood vessels, and smooth muscles) and for substrate material for resorbable devices for implantation. Poly(glycerol sebacate) (PGS) and its nanocomposite derivatives make up an attractive class of biomaterial owing to their tunable mechanical properties with programmable biodegradability. In practice, however, the application of PGS is often hampered by frequent inconsistency in reproducing process conditions. The inconsistency stems from the volatile nature of glycerol during the esterification process. In this presentation, we suggest that the degree of esterification (DE) can be used to predict precisely the physical status, the mechanical properties, and the degradation of the PGS materials [2]. To provide a processing guideline for researchers, we also provide a physical status map as a function of curing temperature and time (Fig 1). In addition, we demonstrate that the addition of molecularly rigid crosslinking agents and network-structured inorganic nanoparticles are also effective in enhancing the mechanical properties of the PGS-derived materials. Secondly, operation of wearable or implantable bioelectronics requires a power source; piezoelectricity generating device allows the direct harvest of power source from natural movement. We have recently addressed an inexpensive pathway to convert commodity polyurethane foams into piezoelectricity nanogenerators by uniform growth of ZnO nanorods in the pores of the foams, followed by conductive material deposition and encapsulation processes [3]. The hard/soft integrated nanocomposite material has a potential to become an important building block for wearable bioelectronics system. Thirdly, we demonstrate that a skin-adhesive electronic device from hard/soft material integration has a potential to aid patient populations in clinical setup [4]. Here, an emerging technology, called “epidermal electronics”, is introduced, where ultra-thin geometry allows for intimate and comfortable contact to patients’ chin, just like a temporary tattoo (Fig 2). The two objectives of this study were to assess the potential of epidermal electronics technology for swallowing therapy. This study showed comparative signals between the new epidermal sEMG patch and the conventional adhesive patches used by clinicians for swallowing therapy

Research on teaching reform of electrical majors in colleges and universities from the perspective of integration of production and education

Based on the vision of quality-oriented education reform, in order to meet the needs of the development of education and teaching at the present stage, university leaders and teachers should carry out teaching reform under the guidance of advanced ideas, in order to provide students with high-quality teaching services. As an electrical professional teacher, can be based on the integration of production and education under the background of the implementation of talent through training, that is, can teach students basic knowledge at the same time, guide them to master practical skills in practical training, rich practical experience, for their follow-up to adapt to social life and docking post work laid a solid foundation. In order to give full play to the application value of the integration model of production and education, electrical teachers need to explore the appropriate opportunity and path to build this advanced model in combination with automobile production demand, industry development trend, college education strategy and students’ actual learning situation, and then give play to the dominant position of schools, enterprises, governments and other institutions to provide students with quality training services. In the end, they can become the talents needed for social development and national construction. At the same time, they can improve the economic benefi ts of enterprises, promote the reform process of colleges and universities, and achieve win-win cooperation between schools and enterprises

Towards Robust Dataset Learning

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often slow. In this paper, we study the problem of learning a robust dataset such that any classifier naturally trained on the dataset is adversarially robust. Such a dataset benefits the downstream tasks as natural training is much faster than adversarial training, and demonstrates that the desired property of robustness is transferable between models and data. In this work, we propose a principled, tri-level optimization to formulate the robust dataset learning problem. We show that, under an abstraction model that characterizes robust vs. non-robust features, the proposed method provably learns a robust dataset. Extensive experiments on MNIST, CIFAR10, and TinyImageNet demostrate the effectiveness of our algorithm with different network initializations and architectures

Recovery from Non-Decomposable Distance Oracles

A line of work has looked at the problem of recovering an input from distance queries. In this setting, there is an unknown sequence $s \in \{0,1\}^{\leq n}$, and one chooses a set of queries $y \in \{0,1\}^{\mathcal{O}(n)}$ and receives $d(s,y)$ for a distance function $d$. The goal is to make as few queries as possible to recover $s$. Although this problem is well-studied for decomposable distances, i.e., distances of the form $d(s,y) = \sum_{i=1}^n f(s_i, y_i)$ for some function $f$, which includes the important cases of Hamming distance, $\ell_p$-norms, and $M$-estimators, to the best of our knowledge this problem has not been studied for non-decomposable distances, for which there are important special cases such as edit distance, dynamic time warping (DTW), Frechet distance, earth mover's distance, and so on. We initiate the study and develop a general framework for such distances. Interestingly, for some distances such as DTW or Frechet, exact recovery of the sequence $s$ is provably impossible, and so we show by allowing the characters in $y$ to be drawn from a slightly larger alphabet this then becomes possible. In a number of cases we obtain optimal or near-optimal query complexity. We also study the role of adaptivity for a number of different distance functions. One motivation for understanding non-adaptivity is that the query sequence can be fixed and the distances of the input to the queries provide a non-linear embedding of the input, which can be used in downstream applications involving, e.g., neural networks for natural language processing.Comment: This work has been presented at conference The 14th Innovations in Theoretical Computer Science (ITCS 2023) and accepted for publishing in the journal IEEE Transactions on Information Theor

PEPSI: Practically Efficient Private Set Intersection in the Unbalanced Setting

Two parties with private data sets can find shared elements using a Private Set Intersection (PSI) protocol without revealing any information beyond the intersection. Circuit PSI protocols privately compute an arbitrary function of the intersection - such as its cardinality, and are often employed in an unbalanced setting where one party has more data than the other. Existing protocols are either computationally inefficient or require extensive server-client communication on the order of the larger set. We introduce Practically Efficient PSI or PEPSI, a non-interactive solution where only the client sends its encrypted data. PEPSI can process an intersection of 1024 client items with a million server items in under a second, using less than 5 MB of communication. Our work is over 4 orders of magnitude faster than an existing non-interactive circuit PSI protocol and requires only 10% of the communication. It is also up to 20 times faster than the work of Ion et al., which computes a limited set of functions and has communication costs proportional to the larger set. Our work is the first to demonstrate that non-interactive circuit PSI can be practically applied in an unbalanced setting

Adaptive beamforming for optical wireless communication via fiber modal control

High-speed optical wireless communication can address the exponential growth in data traffic. Adaptive beamforming customized for the target location is crucial, but existing solutions such as liquidcrystal spatial light modulators and microelectromechanical systems require costly micro/nano manufacturing, delicate alignment, and a high degree of mechanical stability. These challenges reflect the fragility of integrating a fiber network with micro/nano mechanical or photonic systems. Here, we realize low-cost, low-loss, and fiber-compatible beamforming and continuous beam steering through controlled bending of a multi-mode fiber that modifies its modal coupling, and use it to enable flexible optical wireless communication at 10 Gb/s. By using the fiber modal coupling as degrees of freedom rather than an impediment, this approach offers a promising solution for flexible and cost-effective optical wireless communication networks.Comment: 17 pages, 7 figure