68 research outputs found
TACOformer:Token-channel compounded Cross Attention for Multimodal Emotion Recognition
Recently, emotion recognition based on physiological signals has emerged as a
field with intensive research. The utilization of multi-modal, multi-channel
physiological signals has significantly improved the performance of emotion
recognition systems, due to their complementarity. However, effectively
integrating emotion-related semantic information from different modalities and
capturing inter-modal dependencies remains a challenging issue. Many existing
multimodal fusion methods ignore either token-to-token or channel-to-channel
correlations of multichannel signals from different modalities, which limits
the classification capability of the models to some extent. In this paper, we
propose a comprehensive perspective of multimodal fusion that integrates
channel-level and token-level cross-modal interactions. Specifically, we
introduce a unified cross attention module called Token-chAnnel COmpound (TACO)
Cross Attention to perform multimodal fusion, which simultaneously models
channel-level and token-level dependencies between modalities. Additionally, we
propose a 2D position encoding method to preserve information about the spatial
distribution of EEG signal channels, then we use two transformer encoders ahead
of the fusion module to capture long-term temporal dependencies from the EEG
signal and the peripheral physiological signal, respectively.
Subject-independent experiments on emotional dataset DEAP and Dreamer
demonstrate that the proposed model achieves state-of-the-art performance.Comment: Accepted by IJCAI 2023- AI4TS worksho
Improved Model Poisoning Attacks and Defenses in Federated Learning with Clustering
Federated Learning (FL) allows multiple participants to collaboratively train a deep learning model without sharing their private training data. However, due to its distributive nature, FL is vulnerable to various poisoning attacks. An adversary can submit malicious model updates that aim to degrade the joint model's utility. In this thesis, we formulate the adversary's goal as an optimization problem and present an effective model poisoning attack using projected gradient descent. Our empirical results show that our attack has a larger impact on the global model's accuracy than previous attacks.
Motivated by this, we design a robust defense algorithm that mitigates existing poisoning attacks. Our defense leverages constraint k-means clustering and uses a small validation dataset for the server to select optimal updates in each FL round. We conduct experiments on three non-iid image classification datasets and demonstrate the robustness of our defense algorithm under various FL settings
Hard/Soft composited materials for stretchable electronics
Convergence between scientific disciplines creates myriads of new opportunities to the problems that traditional approaches have not provided the answers. For example, researches on materials engineering and nanofabrication can shed a light to the current challenges in clinical biomedical science. Specifically, this presentation describes how materials science is employed to solve fundamental and practical problems in the intimate integration of the state-of-art inorganic devices onto living organs or skins for biomedical research. [1]
Firstly, bioresorbable elastomers make a basic building block for tissue scaffolds for soft, moving organs (such as heart, blood vessels, and smooth muscles) and for substrate material for resorbable devices for implantation. Poly(glycerol sebacate) (PGS) and its nanocomposite derivatives make up an attractive class of biomaterial owing to their tunable mechanical properties with programmable biodegradability. In practice, however, the application of PGS is often hampered by frequent inconsistency in reproducing process conditions. The inconsistency stems from the volatile nature of glycerol during the esterification process. In this presentation, we suggest that the degree of esterification (DE) can be used to predict precisely the physical status, the mechanical properties, and the degradation of the PGS materials [2]. To provide a processing guideline for researchers, we also provide a physical status map as a function of curing temperature and time (Fig 1). In addition, we demonstrate that the addition of molecularly rigid crosslinking agents and network-structured inorganic nanoparticles are also effective in enhancing the mechanical properties of the PGS-derived materials.
Secondly, operation of wearable or implantable bioelectronics requires a power source; piezoelectricity generating device allows the direct harvest of power source from natural movement. We have recently addressed an inexpensive pathway to convert commodity polyurethane foams into piezoelectricity nanogenerators by uniform growth of ZnO nanorods in the pores of the foams, followed by conductive material deposition and encapsulation processes [3]. The hard/soft integrated nanocomposite material has a potential to become an important building block for wearable bioelectronics system.
Thirdly, we demonstrate that a skin-adhesive electronic device from hard/soft material integration has a potential to aid patient populations in clinical setup [4]. Here, an emerging technology, called “epidermal electronics”, is introduced, where ultra-thin geometry allows for intimate and comfortable contact to patients’ chin, just like a temporary tattoo (Fig 2). The two objectives of this study were to assess the potential of epidermal electronics technology for swallowing therapy. This study showed comparative signals between the new epidermal sEMG patch and the conventional adhesive patches used by clinicians for swallowing therapy.
Convergence between scientific disciplines creates myriads of new opportunities to the problems that traditional approaches have not provided the answers. For example, researches on materials engineering and nanofabrication can shed a light to the current challenges in clinical biomedical science. Specifically, this presentation describes how materials science is employed to solve fundamental and practical problems in the intimate integration of the state-of-art inorganic devices onto living organs or skins for biomedical research. [1]
Firstly, bioresorbable elastomers make a basic building block for tissue scaffolds for soft, moving organs (such as heart, blood vessels, and smooth muscles) and for substrate material for resorbable devices for implantation. Poly(glycerol sebacate) (PGS) and its nanocomposite derivatives make up an attractive class of biomaterial owing to their tunable mechanical properties with programmable biodegradability. In practice, however, the application of PGS is often hampered by frequent inconsistency in reproducing process conditions. The inconsistency stems from the volatile nature of glycerol during the esterification process. In this presentation, we suggest that the degree of esterification (DE) can be used to predict precisely the physical status, the mechanical properties, and the degradation of the PGS materials [2]. To provide a processing guideline for researchers, we also provide a physical status map as a function of curing temperature and time (Fig 1). In addition, we demonstrate that the addition of molecularly rigid crosslinking agents and network-structured inorganic nanoparticles are also effective in enhancing the mechanical properties of the PGS-derived materials.
Secondly, operation of wearable or implantable bioelectronics requires a power source; piezoelectricity generating device allows the direct harvest of power source from natural movement. We have recently addressed an inexpensive pathway to convert commodity polyurethane foams into piezoelectricity nanogenerators by uniform growth of ZnO nanorods in the pores of the foams, followed by conductive material deposition and encapsulation processes [3]. The hard/soft integrated nanocomposite material has a potential to become an important building block for wearable bioelectronics system.
Thirdly, we demonstrate that a skin-adhesive electronic device from hard/soft material integration has a potential to aid patient populations in clinical setup [4]. Here, an emerging technology, called “epidermal electronics”, is introduced, where ultra-thin geometry allows for intimate and comfortable contact to patients’ chin, just like a temporary tattoo (Fig 2). The two objectives of this study were to assess the potential of epidermal electronics technology for swallowing therapy. This study showed comparative signals between the new epidermal sEMG patch and the conventional adhesive patches used by clinicians for swallowing therapy
Research and practice on training mode of applied talents for electrical engineering majors in universities
The training of applied talents focuses on students’ innovation ability and engineering practice ability, which requires
electrical engineering teachers to fully embody the integration of theoretical knowledge and engineering practice in their teaching. In the
teaching reform work, teachers should pay attention to optimize the teaching Settings, starting from two aspects of theory and practice, to
promote students to obtain more knowledge of electricity, eff ectively develop students’ application level of electric electronic technology,
and help students develop comprehensively. Colleges and universities should pay more attention to the training of application-oriented
talents and train more qualifi ed talents for the development of social production. Based on this, this paper analyzes the practical strategies
for the training mode of applied talents for electrical engineering majors in colleges and universities, in order to provide references for
educators
Hard/Soft composited materials for stretchable electronics
Convergence between scientific disciplines creates myriads of new opportunities to the problems that traditional approaches have not provided the answers. For example, researches on materials engineering and nanofabrication can shed a light to the current challenges in clinical biomedical science. Specifically, this presentation describes how materials science is employed to solve fundamental and practical problems in the intimate integration of the state-of-art inorganic devices onto living organs or skins for biomedical research. [1]
Firstly, bioresorbable elastomers make a basic building block for tissue scaffolds for soft, moving organs (such as heart, blood vessels, and smooth muscles) and for substrate material for resorbable devices for implantation. Poly(glycerol sebacate) (PGS) and its nanocomposite derivatives make up an attractive class of biomaterial owing to their tunable mechanical properties with programmable biodegradability. In practice, however, the application of PGS is often hampered by frequent inconsistency in reproducing process conditions. The inconsistency stems from the volatile nature of glycerol during the esterification process. In this presentation, we suggest that the degree of esterification (DE) can be used to predict precisely the physical status, the mechanical properties, and the degradation of the PGS materials [2]. To provide a processing guideline for researchers, we also provide a physical status map as a function of curing temperature and time (Fig 1). In addition, we demonstrate that the addition of molecularly rigid crosslinking agents and network-structured inorganic nanoparticles are also effective in enhancing the mechanical properties of the PGS-derived materials.
Secondly, operation of wearable or implantable bioelectronics requires a power source; piezoelectricity generating device allows the direct harvest of power source from natural movement. We have recently addressed an inexpensive pathway to convert commodity polyurethane foams into piezoelectricity nanogenerators by uniform growth of ZnO nanorods in the pores of the foams, followed by conductive material deposition and encapsulation processes [3]. The hard/soft integrated nanocomposite material has a potential to become an important building block for wearable bioelectronics system.
Thirdly, we demonstrate that a skin-adhesive electronic device from hard/soft material integration has a potential to aid patient populations in clinical setup [4]. Here, an emerging technology, called “epidermal electronics”, is introduced, where ultra-thin geometry allows for intimate and comfortable contact to patients’ chin, just like a temporary tattoo (Fig 2). The two objectives of this study were to assess the potential of epidermal electronics technology for swallowing therapy. This study showed comparative signals between the new epidermal sEMG patch and the conventional adhesive patches used by clinicians for swallowing therapy.
Convergence between scientific disciplines creates myriads of new opportunities to the problems that traditional approaches have not provided the answers. For example, researches on materials engineering and nanofabrication can shed a light to the current challenges in clinical biomedical science. Specifically, this presentation describes how materials science is employed to solve fundamental and practical problems in the intimate integration of the state-of-art inorganic devices onto living organs or skins for biomedical research. [1]
Firstly, bioresorbable elastomers make a basic building block for tissue scaffolds for soft, moving organs (such as heart, blood vessels, and smooth muscles) and for substrate material for resorbable devices for implantation. Poly(glycerol sebacate) (PGS) and its nanocomposite derivatives make up an attractive class of biomaterial owing to their tunable mechanical properties with programmable biodegradability. In practice, however, the application of PGS is often hampered by frequent inconsistency in reproducing process conditions. The inconsistency stems from the volatile nature of glycerol during the esterification process. In this presentation, we suggest that the degree of esterification (DE) can be used to predict precisely the physical status, the mechanical properties, and the degradation of the PGS materials [2]. To provide a processing guideline for researchers, we also provide a physical status map as a function of curing temperature and time (Fig 1). In addition, we demonstrate that the addition of molecularly rigid crosslinking agents and network-structured inorganic nanoparticles are also effective in enhancing the mechanical properties of the PGS-derived materials.
Secondly, operation of wearable or implantable bioelectronics requires a power source; piezoelectricity generating device allows the direct harvest of power source from natural movement. We have recently addressed an inexpensive pathway to convert commodity polyurethane foams into piezoelectricity nanogenerators by uniform growth of ZnO nanorods in the pores of the foams, followed by conductive material deposition and encapsulation processes [3]. The hard/soft integrated nanocomposite material has a potential to become an important building block for wearable bioelectronics system.
Thirdly, we demonstrate that a skin-adhesive electronic device from hard/soft material integration has a potential to aid patient populations in clinical setup [4]. Here, an emerging technology, called “epidermal electronics”, is introduced, where ultra-thin geometry allows for intimate and comfortable contact to patients’ chin, just like a temporary tattoo (Fig 2). The two objectives of this study were to assess the potential of epidermal electronics technology for swallowing therapy. This study showed comparative signals between the new epidermal sEMG patch and the conventional adhesive patches used by clinicians for swallowing therapy
Research on teaching reform of electrical majors in colleges and universities from the perspective of integration of production and education
Based on the vision of quality-oriented education reform, in order to meet the needs of the development of education and
teaching at the present stage, university leaders and teachers should carry out teaching reform under the guidance of advanced ideas, in order
to provide students with high-quality teaching services. As an electrical professional teacher, can be based on the integration of production
and education under the background of the implementation of talent through training, that is, can teach students basic knowledge at the
same time, guide them to master practical skills in practical training, rich practical experience, for their follow-up to adapt to social life
and docking post work laid a solid foundation. In order to give full play to the application value of the integration model of production
and education, electrical teachers need to explore the appropriate opportunity and path to build this advanced model in combination with
automobile production demand, industry development trend, college education strategy and students’ actual learning situation, and then give
play to the dominant position of schools, enterprises, governments and other institutions to provide students with quality training services.
In the end, they can become the talents needed for social development and national construction. At the same time, they can improve the
economic benefi ts of enterprises, promote the reform process of colleges and universities, and achieve win-win cooperation between schools
and enterprises
Towards Robust Dataset Learning
Adversarial training has been actively studied in recent computer vision
research to improve the robustness of models. However, due to the huge
computational cost of generating adversarial samples, adversarial training
methods are often slow. In this paper, we study the problem of learning a
robust dataset such that any classifier naturally trained on the dataset is
adversarially robust. Such a dataset benefits the downstream tasks as natural
training is much faster than adversarial training, and demonstrates that the
desired property of robustness is transferable between models and data. In this
work, we propose a principled, tri-level optimization to formulate the robust
dataset learning problem. We show that, under an abstraction model that
characterizes robust vs. non-robust features, the proposed method provably
learns a robust dataset. Extensive experiments on MNIST, CIFAR10, and
TinyImageNet demostrate the effectiveness of our algorithm with different
network initializations and architectures
Recovery from Non-Decomposable Distance Oracles
A line of work has looked at the problem of recovering an input from distance
queries. In this setting, there is an unknown sequence , and one chooses a set of queries and
receives for a distance function . The goal is to make as few
queries as possible to recover . Although this problem is well-studied for
decomposable distances, i.e., distances of the form for some function , which includes the important cases of
Hamming distance, -norms, and -estimators, to the best of our
knowledge this problem has not been studied for non-decomposable distances, for
which there are important special cases such as edit distance, dynamic time
warping (DTW), Frechet distance, earth mover's distance, and so on. We initiate
the study and develop a general framework for such distances. Interestingly,
for some distances such as DTW or Frechet, exact recovery of the sequence
is provably impossible, and so we show by allowing the characters in to be
drawn from a slightly larger alphabet this then becomes possible. In a number
of cases we obtain optimal or near-optimal query complexity. We also study the
role of adaptivity for a number of different distance functions. One motivation
for understanding non-adaptivity is that the query sequence can be fixed and
the distances of the input to the queries provide a non-linear embedding of the
input, which can be used in downstream applications involving, e.g., neural
networks for natural language processing.Comment: This work has been presented at conference The 14th Innovations in
Theoretical Computer Science (ITCS 2023) and accepted for publishing in the
journal IEEE Transactions on Information Theor
PEPSI: Practically Efficient Private Set Intersection in the Unbalanced Setting
Two parties with private data sets can find shared elements using a Private
Set Intersection (PSI) protocol without revealing any information beyond the
intersection. Circuit PSI protocols privately compute an arbitrary function of
the intersection - such as its cardinality, and are often employed in an
unbalanced setting where one party has more data than the other. Existing
protocols are either computationally inefficient or require extensive
server-client communication on the order of the larger set. We introduce
Practically Efficient PSI or PEPSI, a non-interactive solution where only the
client sends its encrypted data. PEPSI can process an intersection of 1024
client items with a million server items in under a second, using less than 5
MB of communication. Our work is over 4 orders of magnitude faster than an
existing non-interactive circuit PSI protocol and requires only 10% of the
communication. It is also up to 20 times faster than the work of Ion et al.,
which computes a limited set of functions and has communication costs
proportional to the larger set. Our work is the first to demonstrate that
non-interactive circuit PSI can be practically applied in an unbalanced
setting
Adaptive beamforming for optical wireless communication via fiber modal control
High-speed optical wireless communication can address the exponential growth
in data traffic. Adaptive beamforming customized for the target location is
crucial, but existing solutions such as liquidcrystal spatial light modulators
and microelectromechanical systems require costly micro/nano manufacturing,
delicate alignment, and a high degree of mechanical stability. These challenges
reflect the fragility of integrating a fiber network with micro/nano mechanical
or photonic systems. Here, we realize low-cost, low-loss, and fiber-compatible
beamforming and continuous beam steering through controlled bending of a
multi-mode fiber that modifies its modal coupling, and use it to enable
flexible optical wireless communication at 10 Gb/s. By using the fiber modal
coupling as degrees of freedom rather than an impediment, this approach offers
a promising solution for flexible and cost-effective optical wireless
communication networks.Comment: 17 pages, 7 figure
- …